2023-11-29T08:38:10.670 INFO:root:teuthology version: 0.0.1.dev212+g735a43c 2023-11-29T08:38:10.671 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_matan@teuthology --name matan-2023-11-29_08:30:41-crimson-rados-wip-matanb-crimson-snaptrimevent-lifetime-v2-distro-crimson-smithi --verbose --description crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rados_api_tests} --archive /home/teuthworker/archive/matan-2023-11-29_08:30:41-crimson-rados-wip-matanb-crimson-snaptrimevent-lifetime-v2-distro-crimson-smithi/7470475 -- /home/teuthworker/archive/matan-2023-11-29_08:30:41-crimson-rados-wip-matanb-crimson-snaptrimevent-lifetime-v2-distro-crimson-smithi/7470475/orig.config.yaml 2023-11-29T08:38:10.697 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T08:38:10.762 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/matan-2023-11-29_08:30:41-crimson-rados-wip-matanb-crimson-snaptrimevent-lifetime-v2-distro-crimson-smithi/7470475 branch: wip-matanb-crimson-snaptrimevent-lifetime-v2 description: crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rados_api_tests} email: null first_in_suite: false job_id: '7470475' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: matan-2023-11-29_08:30:41-crimson-rados-wip-matanb-crimson-snaptrimevent-lifetime-v2-distro-crimson-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-matanb-crimson-snaptrimevent-lifetime-v2 ceph: conf: client: debug ms: 1 global: enable experimental unrecoverable data corrupting features: crimson ms client mode: crc ms cluster mode: crc ms mon client mode: crc ms mon cluster mode: crc ms mon service mode: crc ms service mode: crc mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon warn on pool no app: false osd pool default crimson: true osd: crimson seastar smp: 3 debug ms: 1 debug osd: 20 osd blocked scrub grace period: 3600 osd class default list: '*' osd class load list: '*' osd shutdown pgref assert: true flavor: crimson log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(POOL_APP_NOT_ENABLED\) - reached quota - but it is still running - overall HEALTH_ - \(POOL_FULL\) - \(SMALLER_PGP_NUM\) - \(CACHE_POOL_NO_HIT_SET\) - \(CACHE_POOL_NEAR_FULL\) - \(POOL_APP_NOT_ENABLED\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) sha1: 412bfade5c44735b71d7c14eb55649269cd32a35 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: crimson sha1: 412bfade5c44735b71d7c14eb55649269cd32a35 workunit: branch: main env: CRIMSON_COMPAT: '1' sha1: 3d760f113bd9f3a2e513474d34227633cd06f1ea owner: scheduled_matan@teuthology priority: 60 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - osd.0 - osd.1 - client.0 - node-exporter.a - - mgr.x - osd.2 - osd.3 - client.1 - prometheus.a - node-exporter.b seed: 4297 sha1: 412bfade5c44735b71d7c14eb55649269cd32a35 sleep_before_teardown: 0 suite: crimson-rados suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph_3d760f113bd9f3a2e513474d34227633cd06f1ea/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph.git suite_sha1: 3d760f113bd9f3a2e513474d34227633cd06f1ea targets: smithi027.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLQR7FSsM2WG3bXLSyzCfiqjoRZynboasDBaX+6yp30CSoYVR34oL7LJIIvOpNSVnLht3UOfgZV/B9cLBjK3TCQ= smithi139.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFcL3nDrki+eYUfUljt+Tv4/NglX6E0ioeMMbcbLmTVq5cwRywPFKOvY7pMHRugFQhr24ZNA8MTH7lpIphM1hh0= tasks: - install: null - ceph: conf: mon: mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 paxos service trim min: 10 osd: debug monc: 20 flavor: crimson - workunit: clients: client.0: - rados/test.sh - rados/test_pool_quota.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 735a43c3d8e74286f980f1d14817fb093cd8147e timestamp: 2023-11-29_08:30:41 tube: smithi user: matan verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-11-29T08:38:10.763 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph_3d760f113bd9f3a2e513474d34227633cd06f1ea/qa; will attempt to use it 2023-11-29T08:38:10.763 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph_3d760f113bd9f3a2e513474d34227633cd06f1ea/qa/tasks 2023-11-29T08:38:10.763 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-11-29T08:38:10.765 INFO:teuthology.task.internal:Checking packages... 2023-11-29T08:38:10.786 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'crimson' and ceph hash '412bfade5c44735b71d7c14eb55649269cd32a35' 2023-11-29T08:38:10.786 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-11-29T08:38:10.787 INFO:teuthology.packaging:ref: None 2023-11-29T08:38:10.787 INFO:teuthology.packaging:tag: None 2023-11-29T08:38:10.787 INFO:teuthology.packaging:branch: wip-matanb-crimson-snaptrimevent-lifetime-v2 2023-11-29T08:38:10.787 INFO:teuthology.packaging:sha1: 412bfade5c44735b71d7c14eb55649269cd32a35 2023-11-29T08:38:10.787 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&ref=wip-matanb-crimson-snaptrimevent-lifetime-v2 2023-11-29T08:38:10.920 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-7483.g412bfade 2023-11-29T08:38:10.920 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-11-29T08:38:10.926 INFO:teuthology.task.internal:no buildpackages task found 2023-11-29T08:38:10.926 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-11-29T08:38:10.935 INFO:teuthology.task.internal:Saving configuration 2023-11-29T08:38:10.945 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-11-29T08:38:10.950 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-29T08:38:10.974 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi027.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2023-11-29_08:30:41-crimson-rados-wip-matanb-crimson-snaptrimevent-lifetime-v2-distro-crimson-smithi/7470475', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-29 08:31:43.306484', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLQR7FSsM2WG3bXLSyzCfiqjoRZynboasDBaX+6yp30CSoYVR34oL7LJIIvOpNSVnLht3UOfgZV/B9cLBjK3TCQ='} 2023-11-29T08:38:10.997 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi139.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2023-11-29_08:30:41-crimson-rados-wip-matanb-crimson-snaptrimevent-lifetime-v2-distro-crimson-smithi/7470475', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-29 08:31:43.304627', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFcL3nDrki+eYUfUljt+Tv4/NglX6E0ioeMMbcbLmTVq5cwRywPFKOvY7pMHRugFQhr24ZNA8MTH7lpIphM1hh0='} 2023-11-29T08:38:10.998 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-11-29T08:38:11.003 INFO:teuthology.task.internal:roles: ubuntu@smithi027.front.sepia.ceph.com - ['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'] 2023-11-29T08:38:11.004 INFO:teuthology.task.internal:roles: ubuntu@smithi139.front.sepia.ceph.com - ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b'] 2023-11-29T08:38:11.004 INFO:teuthology.run_tasks:Running task console_log... 2023-11-29T08:38:11.071 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc674b6c9d0>, signals=[15]) 2023-11-29T08:38:11.071 INFO:teuthology.run_tasks:Running task internal.connect... 2023-11-29T08:38:11.077 INFO:teuthology.task.internal:Opening connections... 2023-11-29T08:38:11.077 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi027.front.sepia.ceph.com 2023-11-29T08:38:11.079 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T08:38:11.175 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi139.front.sepia.ceph.com 2023-11-29T08:38:11.176 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T08:38:11.257 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-11-29T08:38:11.263 DEBUG:teuthology.orchestra.run.smithi027:> uname -m 2023-11-29T08:38:11.281 INFO:teuthology.orchestra.run.smithi027.stdout:x86_64 2023-11-29T08:38:11.281 DEBUG:teuthology.orchestra.run.smithi027:> cat /etc/os-release 2023-11-29T08:38:11.338 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="CentOS Stream" 2023-11-29T08:38:11.338 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="9" 2023-11-29T08:38:11.338 INFO:teuthology.orchestra.run.smithi027.stdout:ID="centos" 2023-11-29T08:38:11.338 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE="rhel fedora" 2023-11-29T08:38:11.338 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="9" 2023-11-29T08:38:11.338 INFO:teuthology.orchestra.run.smithi027.stdout:PLATFORM_ID="platform:el9" 2023-11-29T08:38:11.338 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-29T08:38:11.338 INFO:teuthology.orchestra.run.smithi027.stdout:ANSI_COLOR="0;31" 2023-11-29T08:38:11.339 INFO:teuthology.orchestra.run.smithi027.stdout:LOGO="fedora-logo-icon" 2023-11-29T08:38:11.339 INFO:teuthology.orchestra.run.smithi027.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-29T08:38:11.339 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://centos.org/" 2023-11-29T08:38:11.339 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-29T08:38:11.339 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-29T08:38:11.339 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-29T08:38:11.339 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server 2023-11-29T08:38:11.360 DEBUG:teuthology.orchestra.run.smithi139:> uname -m 2023-11-29T08:38:11.376 INFO:teuthology.orchestra.run.smithi139.stdout:x86_64 2023-11-29T08:38:11.377 DEBUG:teuthology.orchestra.run.smithi139:> cat /etc/os-release 2023-11-29T08:38:11.433 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="CentOS Stream" 2023-11-29T08:38:11.433 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="9" 2023-11-29T08:38:11.434 INFO:teuthology.orchestra.run.smithi139.stdout:ID="centos" 2023-11-29T08:38:11.434 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE="rhel fedora" 2023-11-29T08:38:11.434 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="9" 2023-11-29T08:38:11.434 INFO:teuthology.orchestra.run.smithi139.stdout:PLATFORM_ID="platform:el9" 2023-11-29T08:38:11.434 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-29T08:38:11.434 INFO:teuthology.orchestra.run.smithi139.stdout:ANSI_COLOR="0;31" 2023-11-29T08:38:11.434 INFO:teuthology.orchestra.run.smithi139.stdout:LOGO="fedora-logo-icon" 2023-11-29T08:38:11.434 INFO:teuthology.orchestra.run.smithi139.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-29T08:38:11.434 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://centos.org/" 2023-11-29T08:38:11.434 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-29T08:38:11.434 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-29T08:38:11.434 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-29T08:38:11.434 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server 2023-11-29T08:38:11.451 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-11-29T08:38:11.460 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-11-29T08:38:11.489 INFO:teuthology.task.internal:Checking for old test directory... 2023-11-29T08:38:11.490 DEBUG:teuthology.orchestra.run.smithi027:> test '!' -e /home/ubuntu/cephtest 2023-11-29T08:38:11.492 DEBUG:teuthology.orchestra.run.smithi139:> test '!' -e /home/ubuntu/cephtest 2023-11-29T08:38:11.507 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-11-29T08:38:11.513 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-11-29T08:38:11.513 DEBUG:teuthology.orchestra.run.smithi027:> test -z $(ls -A /var/lib/ceph) 2023-11-29T08:38:11.549 DEBUG:teuthology.orchestra.run.smithi139:> test -z $(ls -A /var/lib/ceph) 2023-11-29T08:38:11.573 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-11-29T08:38:11.624 INFO:teuthology.run_tasks:Running task kernel... 2023-11-29T08:38:11.637 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-11-29T08:38:11.638 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-11-29T08:38:11.638 DEBUG:teuthology.orchestra.run.smithi027:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-29T08:38:11.638 DEBUG:teuthology.orchestra.run.smithi139:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-29T08:38:11.654 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-29T08:38:11.654 DEBUG:teuthology.orchestra.run.smithi139:> uname -r 2023-11-29T08:38:11.655 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-29T08:38:11.655 DEBUG:teuthology.orchestra.run.smithi027:> uname -r 2023-11-29T08:38:11.711 INFO:teuthology.orchestra.run.smithi139.stdout:5.14.0-361.el9.x86_64 2023-11-29T08:38:11.711 INFO:teuthology.task.kernel:Running kernel on smithi139: 5.14.0-361.el9.x86_64 2023-11-29T08:38:11.711 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum install -y kernel 2023-11-29T08:38:11.713 INFO:teuthology.orchestra.run.smithi027.stdout:5.14.0-361.el9.x86_64 2023-11-29T08:38:11.713 INFO:teuthology.task.kernel:Running kernel on smithi027: 5.14.0-361.el9.x86_64 2023-11-29T08:38:11.713 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum install -y kernel 2023-11-29T08:38:13.847 INFO:teuthology.orchestra.run.smithi027.stdout:CentOS-9 - AppStream 12 MB/s | 6.4 MB 00:00 2023-11-29T08:38:13.972 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS-9 - AppStream 9.5 MB/s | 6.4 MB 00:00 2023-11-29T08:38:15.364 INFO:teuthology.orchestra.run.smithi027.stdout:CentOS-9 - BaseOS 5.1 MB/s | 2.0 MB 00:00 2023-11-29T08:38:15.406 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS-9 - BaseOS 5.0 MB/s | 2.0 MB 00:00 2023-11-29T08:38:16.171 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - BaseOS 18 MB/s | 7.9 MB 00:00 2023-11-29T08:38:16.696 INFO:teuthology.orchestra.run.smithi027.stdout:CentOS Stream 9 - BaseOS 8.0 MB/s | 7.9 MB 00:00 2023-11-29T08:38:19.806 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - AppStream 7.2 MB/s | 18 MB 00:02 2023-11-29T08:38:23.964 INFO:teuthology.orchestra.run.smithi027.stdout:CentOS Stream 9 - AppStream 3.0 MB/s | 18 MB 00:06 2023-11-29T08:38:24.023 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - CRB 6.8 MB/s | 5.8 MB 00:00 2023-11-29T08:38:25.806 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - Extras packages 22 kB/s | 15 kB 00:00 2023-11-29T08:38:27.519 INFO:teuthology.orchestra.run.smithi139.stdout:Extra Packages for Enterprise Linux 13 MB/s | 20 MB 00:01 2023-11-29T08:38:28.106 INFO:teuthology.orchestra.run.smithi027.stdout:CentOS Stream 9 - CRB 9.4 MB/s | 5.8 MB 00:00 2023-11-29T08:38:29.465 INFO:teuthology.orchestra.run.smithi027.stdout:CentOS Stream 9 - Extras packages 78 kB/s | 15 kB 00:00 2023-11-29T08:38:32.466 INFO:teuthology.orchestra.run.smithi139.stdout:lab-extras 7.3 kB/s | 1.7 kB 00:00 2023-11-29T08:38:34.831 INFO:teuthology.orchestra.run.smithi139.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-11-29T08:38:34.831 INFO:teuthology.orchestra.run.smithi139.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-11-29T08:38:34.916 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2023-11-29T08:38:34.928 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2023-11-29T08:38:34.928 INFO:teuthology.orchestra.run.smithi139.stdout: Package Architecture Version Repository Size 2023-11-29T08:38:34.928 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2023-11-29T08:38:34.928 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2023-11-29T08:38:34.929 INFO:teuthology.orchestra.run.smithi139.stdout: kernel x86_64 5.14.0-388.el9 baseos 5.6 M 2023-11-29T08:38:34.929 INFO:teuthology.orchestra.run.smithi139.stdout:Installing dependencies: 2023-11-29T08:38:34.929 INFO:teuthology.orchestra.run.smithi139.stdout: kernel-core x86_64 5.14.0-388.el9 baseos 20 M 2023-11-29T08:38:34.929 INFO:teuthology.orchestra.run.smithi139.stdout: kernel-modules x86_64 5.14.0-388.el9 baseos 38 M 2023-11-29T08:38:34.929 INFO:teuthology.orchestra.run.smithi139.stdout: kernel-modules-core x86_64 5.14.0-388.el9 baseos 32 M 2023-11-29T08:38:34.929 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:38:34.929 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2023-11-29T08:38:34.929 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2023-11-29T08:38:34.929 INFO:teuthology.orchestra.run.smithi139.stdout:Install 4 Packages 2023-11-29T08:38:34.929 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:38:34.930 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 96 M 2023-11-29T08:38:34.930 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 121 M 2023-11-29T08:38:34.930 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2023-11-29T08:38:35.884 INFO:teuthology.orchestra.run.smithi139.stdout:(1/4): kernel-5.14.0-388.el9.x86_64.rpm 8.2 MB/s | 5.6 MB 00:00 2023-11-29T08:38:37.461 INFO:teuthology.orchestra.run.smithi027.stdout:Extra Packages for Enterprise Linux 2.5 MB/s | 20 MB 00:07 2023-11-29T08:38:38.134 INFO:teuthology.orchestra.run.smithi139.stdout:(2/4): kernel-core-5.14.0-388.el9.x86_64.rpm 6.9 MB/s | 20 MB 00:02 2023-11-29T08:38:39.992 INFO:teuthology.orchestra.run.smithi139.stdout:(3/4): kernel-modules-5.14.0-388.el9.x86_64.rpm 7.9 MB/s | 38 MB 00:04 2023-11-29T08:38:41.734 INFO:teuthology.orchestra.run.smithi139.stdout:(4/4): kernel-modules-core-5.14.0-388.el9.x86_6 5.5 MB/s | 32 MB 00:05 2023-11-29T08:38:41.734 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2023-11-29T08:38:41.735 INFO:teuthology.orchestra.run.smithi139.stdout:Total 14 MB/s | 96 MB 00:06 2023-11-29T08:38:42.391 INFO:teuthology.orchestra.run.smithi027.stdout:lab-extras 20 kB/s | 1.7 kB 00:00 2023-11-29T08:38:42.589 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2023-11-29T08:38:42.947 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2023-11-29T08:38:42.947 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2023-11-29T08:38:44.275 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2023-11-29T08:38:44.275 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2023-11-29T08:38:44.823 INFO:teuthology.orchestra.run.smithi027.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-11-29T08:38:44.823 INFO:teuthology.orchestra.run.smithi027.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-11-29T08:38:44.914 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. 2023-11-29T08:38:44.920 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2023-11-29T08:38:44.920 INFO:teuthology.orchestra.run.smithi027.stdout: Package Architecture Version Repository Size 2023-11-29T08:38:44.920 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2023-11-29T08:38:44.920 INFO:teuthology.orchestra.run.smithi027.stdout:Installing: 2023-11-29T08:38:44.921 INFO:teuthology.orchestra.run.smithi027.stdout: kernel x86_64 5.14.0-388.el9 baseos 5.6 M 2023-11-29T08:38:44.921 INFO:teuthology.orchestra.run.smithi027.stdout:Installing dependencies: 2023-11-29T08:38:44.921 INFO:teuthology.orchestra.run.smithi027.stdout: kernel-core x86_64 5.14.0-388.el9 baseos 20 M 2023-11-29T08:38:44.921 INFO:teuthology.orchestra.run.smithi027.stdout: kernel-modules x86_64 5.14.0-388.el9 baseos 38 M 2023-11-29T08:38:44.921 INFO:teuthology.orchestra.run.smithi027.stdout: kernel-modules-core x86_64 5.14.0-388.el9 baseos 32 M 2023-11-29T08:38:44.921 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:38:44.921 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction Summary 2023-11-29T08:38:44.921 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2023-11-29T08:38:44.921 INFO:teuthology.orchestra.run.smithi027.stdout:Install 4 Packages 2023-11-29T08:38:44.922 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:38:44.922 INFO:teuthology.orchestra.run.smithi027.stdout:Total download size: 96 M 2023-11-29T08:38:44.922 INFO:teuthology.orchestra.run.smithi027.stdout:Installed size: 121 M 2023-11-29T08:38:44.922 INFO:teuthology.orchestra.run.smithi027.stdout:Downloading Packages: 2023-11-29T08:38:45.367 INFO:teuthology.orchestra.run.smithi027.stdout:(1/4): kernel-5.14.0-388.el9.x86_64.rpm 15 MB/s | 5.6 MB 00:00 2023-11-29T08:38:46.643 INFO:teuthology.orchestra.run.smithi027.stdout:(2/4): kernel-core-5.14.0-388.el9.x86_64.rpm 12 MB/s | 20 MB 00:01 2023-11-29T08:38:47.167 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2023-11-29T08:38:47.285 INFO:teuthology.orchestra.run.smithi027.stdout:(3/4): kernel-modules-5.14.0-388.el9.x86_64.rpm 16 MB/s | 38 MB 00:02 2023-11-29T08:38:47.694 INFO:teuthology.orchestra.run.smithi027.stdout:(4/4): kernel-modules-core-5.14.0-388.el9.x86_6 14 MB/s | 32 MB 00:02 2023-11-29T08:38:47.694 INFO:teuthology.orchestra.run.smithi027.stdout:-------------------------------------------------------------------------------- 2023-11-29T08:38:47.694 INFO:teuthology.orchestra.run.smithi027.stdout:Total 35 MB/s | 96 MB 00:02 2023-11-29T08:38:47.802 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : kernel-modules-core-5.14.0-388.el9.x86_64 1/4 2023-11-29T08:38:47.934 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : kernel-core-5.14.0-388.el9.x86_64 2/4 2023-11-29T08:38:48.601 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction check 2023-11-29T08:38:49.025 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction check succeeded. 2023-11-29T08:38:49.025 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction test 2023-11-29T08:38:50.415 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction test succeeded. 2023-11-29T08:38:50.416 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction 2023-11-29T08:38:50.701 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: kernel-core-5.14.0-388.el9.x86_64 2/4 2023-11-29T08:38:50.869 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : kernel-modules-5.14.0-388.el9.x86_64 3/4 2023-11-29T08:38:53.227 INFO:teuthology.orchestra.run.smithi027.stdout: Preparing : 1/1 2023-11-29T08:38:53.893 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : kernel-modules-core-5.14.0-388.el9.x86_64 1/4 2023-11-29T08:38:54.019 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : kernel-core-5.14.0-388.el9.x86_64 2/4 2023-11-29T08:38:55.492 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: kernel-modules-5.14.0-388.el9.x86_64 3/4 2023-11-29T08:38:55.776 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : kernel-5.14.0-388.el9.x86_64 4/4 2023-11-29T08:38:56.939 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: kernel-core-5.14.0-388.el9.x86_64 2/4 2023-11-29T08:38:57.114 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : kernel-modules-5.14.0-388.el9.x86_64 3/4 2023-11-29T08:39:00.430 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: kernel-modules-core-5.14.0-388.el9.x86_64 4/4 2023-11-29T08:39:02.097 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: kernel-modules-5.14.0-388.el9.x86_64 3/4 2023-11-29T08:39:02.215 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : kernel-5.14.0-388.el9.x86_64 4/4 2023-11-29T08:39:07.232 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: kernel-modules-core-5.14.0-388.el9.x86_64 4/4 2023-11-29T08:39:29.606 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: kernel-core-5.14.0-388.el9.x86_64 4/4 2023-11-29T08:39:29.649 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: kernel-modules-5.14.0-388.el9.x86_64 4/4 2023-11-29T08:39:30.075 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: kernel-5.14.0-388.el9.x86_64 4/4 2023-11-29T08:39:30.075 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : kernel-5.14.0-388.el9.x86_64 1/4 2023-11-29T08:39:30.076 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : kernel-core-5.14.0-388.el9.x86_64 2/4 2023-11-29T08:39:30.076 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : kernel-modules-5.14.0-388.el9.x86_64 3/4 2023-11-29T08:39:30.490 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : kernel-modules-core-5.14.0-388.el9.x86_64 4/4 2023-11-29T08:39:30.491 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:39:30.491 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2023-11-29T08:39:30.491 INFO:teuthology.orchestra.run.smithi139.stdout: kernel-5.14.0-388.el9.x86_64 2023-11-29T08:39:30.491 INFO:teuthology.orchestra.run.smithi139.stdout: kernel-core-5.14.0-388.el9.x86_64 2023-11-29T08:39:30.491 INFO:teuthology.orchestra.run.smithi139.stdout: kernel-modules-5.14.0-388.el9.x86_64 2023-11-29T08:39:30.491 INFO:teuthology.orchestra.run.smithi139.stdout: kernel-modules-core-5.14.0-388.el9.x86_64 2023-11-29T08:39:30.491 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:39:30.491 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2023-11-29T08:39:31.004 DEBUG:teuthology.orchestra.run.smithi139:> rpm -q kernel | sort -rV | head -n 1 2023-11-29T08:39:31.157 INFO:teuthology.orchestra.run.smithi139.stdout:kernel-5.14.0-388.el9.x86_64 2023-11-29T08:39:31.157 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-388.el9.x86_64 2023-11-29T08:39:31.157 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-388.el9.x86_64 2023-11-29T08:39:31.157 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-11-29T08:39:31.157 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-11-29T08:39:31.157 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2023-11-29T08:39:31.157 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi139.front.sepia.ceph.com, path=None, version=distro) 2023-11-29T08:39:31.158 DEBUG:teuthology.orchestra.run.smithi139:> rpm -q kernel | sort -rV | head -n 1 2023-11-29T08:39:31.274 INFO:teuthology.orchestra.run.smithi139.stdout:kernel-5.14.0-388.el9.x86_64 2023-11-29T08:39:31.274 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-388.el9.x86_64 2023-11-29T08:39:31.274 DEBUG:teuthology.orchestra.run.smithi139:> sudo rpm -qi grub2-tools 2023-11-29T08:39:31.308 INFO:teuthology.orchestra.run.smithi139.stdout:Name : grub2-tools 2023-11-29T08:39:31.308 INFO:teuthology.orchestra.run.smithi139.stdout:Epoch : 1 2023-11-29T08:39:31.308 INFO:teuthology.orchestra.run.smithi139.stdout:Version : 2.06 2023-11-29T08:39:31.308 INFO:teuthology.orchestra.run.smithi139.stdout:Release : 68.el9 2023-11-29T08:39:31.308 INFO:teuthology.orchestra.run.smithi139.stdout:Architecture: x86_64 2023-11-29T08:39:31.308 INFO:teuthology.orchestra.run.smithi139.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-11-29T08:39:31.308 INFO:teuthology.orchestra.run.smithi139.stdout:Group : Unspecified 2023-11-29T08:39:31.308 INFO:teuthology.orchestra.run.smithi139.stdout:Size : 8264254 2023-11-29T08:39:31.308 INFO:teuthology.orchestra.run.smithi139.stdout:License : GPLv3+ 2023-11-29T08:39:31.308 INFO:teuthology.orchestra.run.smithi139.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-11-29T08:39:31.308 INFO:teuthology.orchestra.run.smithi139.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-11-29T08:39:31.308 INFO:teuthology.orchestra.run.smithi139.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-11-29T08:39:31.308 INFO:teuthology.orchestra.run.smithi139.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-11-29T08:39:31.309 INFO:teuthology.orchestra.run.smithi139.stdout:Packager : builder@centos.org 2023-11-29T08:39:31.309 INFO:teuthology.orchestra.run.smithi139.stdout:Vendor : CentOS 2023-11-29T08:39:31.309 INFO:teuthology.orchestra.run.smithi139.stdout:URL : http://www.gnu.org/software/grub/ 2023-11-29T08:39:31.309 INFO:teuthology.orchestra.run.smithi139.stdout:Summary : Support tools for GRUB. 2023-11-29T08:39:31.309 INFO:teuthology.orchestra.run.smithi139.stdout:Description : 2023-11-29T08:39:31.309 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:39:31.309 INFO:teuthology.orchestra.run.smithi139.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-11-29T08:39:31.309 INFO:teuthology.orchestra.run.smithi139.stdout:customizable bootloader with modular architecture. It supports a rich 2023-11-29T08:39:31.309 INFO:teuthology.orchestra.run.smithi139.stdout:variety of kernel formats, file systems, computer architectures and 2023-11-29T08:39:31.309 INFO:teuthology.orchestra.run.smithi139.stdout:hardware devices. 2023-11-29T08:39:31.309 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:39:31.309 INFO:teuthology.orchestra.run.smithi139.stdout:This subpackage provides tools for support of all platforms. 2023-11-29T08:39:31.310 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-11-29T08:39:31.310 INFO:teuthology.task.kernel:Updating grub on smithi139 to boot 5.14.0-388.el9.x86_64 2023-11-29T08:39:31.310 DEBUG:teuthology.orchestra.run.smithi139:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-11-29T08:39:31.932 INFO:teuthology.orchestra.run.smithi139.stderr:Generating grub configuration file ... 2023-11-29T08:39:33.315 INFO:teuthology.orchestra.run.smithi139.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-11-29T08:39:33.354 INFO:teuthology.orchestra.run.smithi139.stderr:done 2023-11-29T08:39:33.356 DEBUG:teuthology.orchestra.run.smithi139:> mktemp 2023-11-29T08:39:33.383 INFO:teuthology.orchestra.run.smithi139.stdout:/tmp/tmp.5cXewHR9Tz 2023-11-29T08:39:33.383 DEBUG:teuthology.orchestra.run.smithi139:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.5cXewHR9Tz 2023-11-29T08:39:33.452 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 0666 /tmp/tmp.5cXewHR9Tz 2023-11-29T08:39:33.584 DEBUG:teuthology.orchestra.remote:smithi139:/tmp/tmp.5cXewHR9Tz is 6KB 2023-11-29T08:39:33.632 DEBUG:teuthology.orchestra.run.smithi139:> rm -fr /tmp/tmp.5cXewHR9Tz 2023-11-29T08:39:33.646 DEBUG:teuthology.orchestra.run.smithi139:> sudo /bin/ls /boot/loader/entries || true 2023-11-29T08:39:33.710 INFO:teuthology.orchestra.run.smithi139.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-11-29T08:39:33.710 INFO:teuthology.orchestra.run.smithi139.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-11-29T08:39:33.710 INFO:teuthology.orchestra.run.smithi139.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-11-29T08:39:33.710 INFO:teuthology.orchestra.run.smithi139.stdout:15949e3c88704300882482eddfd7baae-5.14.0-388.el9.x86_64.conf 2023-11-29T08:39:33.712 DEBUG:teuthology.orchestra.run.smithi139:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-388.el9.x86_64 2023-11-29T08:39:33.847 DEBUG:teuthology.orchestra.run.smithi139:> sudo shutdown -r now 2023-11-29T08:39:37.803 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: kernel-core-5.14.0-388.el9.x86_64 4/4 2023-11-29T08:39:37.848 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: kernel-modules-5.14.0-388.el9.x86_64 4/4 2023-11-29T08:39:38.318 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: kernel-5.14.0-388.el9.x86_64 4/4 2023-11-29T08:39:38.318 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : kernel-5.14.0-388.el9.x86_64 1/4 2023-11-29T08:39:38.318 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : kernel-core-5.14.0-388.el9.x86_64 2/4 2023-11-29T08:39:38.318 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : kernel-modules-5.14.0-388.el9.x86_64 3/4 2023-11-29T08:39:38.778 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : kernel-modules-core-5.14.0-388.el9.x86_64 4/4 2023-11-29T08:39:38.779 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:39:38.779 INFO:teuthology.orchestra.run.smithi027.stdout:Installed: 2023-11-29T08:39:38.779 INFO:teuthology.orchestra.run.smithi027.stdout: kernel-5.14.0-388.el9.x86_64 2023-11-29T08:39:38.779 INFO:teuthology.orchestra.run.smithi027.stdout: kernel-core-5.14.0-388.el9.x86_64 2023-11-29T08:39:38.779 INFO:teuthology.orchestra.run.smithi027.stdout: kernel-modules-5.14.0-388.el9.x86_64 2023-11-29T08:39:38.779 INFO:teuthology.orchestra.run.smithi027.stdout: kernel-modules-core-5.14.0-388.el9.x86_64 2023-11-29T08:39:38.779 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:39:38.779 INFO:teuthology.orchestra.run.smithi027.stdout:Complete! 2023-11-29T08:39:39.300 DEBUG:teuthology.orchestra.run.smithi027:> rpm -q kernel | sort -rV | head -n 1 2023-11-29T08:39:39.486 INFO:teuthology.orchestra.run.smithi027.stdout:kernel-5.14.0-388.el9.x86_64 2023-11-29T08:39:39.486 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-388.el9.x86_64 2023-11-29T08:39:39.486 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-388.el9.x86_64 2023-11-29T08:39:39.486 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-11-29T08:39:39.487 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-11-29T08:39:39.487 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-11-29T08:39:39.487 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi027.front.sepia.ceph.com, path=None, version=distro) 2023-11-29T08:39:39.487 DEBUG:teuthology.orchestra.run.smithi027:> rpm -q kernel | sort -rV | head -n 1 2023-11-29T08:39:39.609 INFO:teuthology.orchestra.run.smithi027.stdout:kernel-5.14.0-388.el9.x86_64 2023-11-29T08:39:39.610 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-388.el9.x86_64 2023-11-29T08:39:39.610 DEBUG:teuthology.orchestra.run.smithi027:> sudo rpm -qi grub2-tools 2023-11-29T08:39:39.658 INFO:teuthology.orchestra.run.smithi027.stdout:Name : grub2-tools 2023-11-29T08:39:39.658 INFO:teuthology.orchestra.run.smithi027.stdout:Epoch : 1 2023-11-29T08:39:39.658 INFO:teuthology.orchestra.run.smithi027.stdout:Version : 2.06 2023-11-29T08:39:39.659 INFO:teuthology.orchestra.run.smithi027.stdout:Release : 68.el9 2023-11-29T08:39:39.659 INFO:teuthology.orchestra.run.smithi027.stdout:Architecture: x86_64 2023-11-29T08:39:39.659 INFO:teuthology.orchestra.run.smithi027.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-11-29T08:39:39.659 INFO:teuthology.orchestra.run.smithi027.stdout:Group : Unspecified 2023-11-29T08:39:39.659 INFO:teuthology.orchestra.run.smithi027.stdout:Size : 8264254 2023-11-29T08:39:39.659 INFO:teuthology.orchestra.run.smithi027.stdout:License : GPLv3+ 2023-11-29T08:39:39.659 INFO:teuthology.orchestra.run.smithi027.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-11-29T08:39:39.659 INFO:teuthology.orchestra.run.smithi027.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-11-29T08:39:39.659 INFO:teuthology.orchestra.run.smithi027.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-11-29T08:39:39.659 INFO:teuthology.orchestra.run.smithi027.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-11-29T08:39:39.659 INFO:teuthology.orchestra.run.smithi027.stdout:Packager : builder@centos.org 2023-11-29T08:39:39.659 INFO:teuthology.orchestra.run.smithi027.stdout:Vendor : CentOS 2023-11-29T08:39:39.659 INFO:teuthology.orchestra.run.smithi027.stdout:URL : http://www.gnu.org/software/grub/ 2023-11-29T08:39:39.659 INFO:teuthology.orchestra.run.smithi027.stdout:Summary : Support tools for GRUB. 2023-11-29T08:39:39.659 INFO:teuthology.orchestra.run.smithi027.stdout:Description : 2023-11-29T08:39:39.660 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:39:39.660 INFO:teuthology.orchestra.run.smithi027.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-11-29T08:39:39.660 INFO:teuthology.orchestra.run.smithi027.stdout:customizable bootloader with modular architecture. It supports a rich 2023-11-29T08:39:39.660 INFO:teuthology.orchestra.run.smithi027.stdout:variety of kernel formats, file systems, computer architectures and 2023-11-29T08:39:39.660 INFO:teuthology.orchestra.run.smithi027.stdout:hardware devices. 2023-11-29T08:39:39.660 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:39:39.660 INFO:teuthology.orchestra.run.smithi027.stdout:This subpackage provides tools for support of all platforms. 2023-11-29T08:39:39.661 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-11-29T08:39:39.661 INFO:teuthology.task.kernel:Updating grub on smithi027 to boot 5.14.0-388.el9.x86_64 2023-11-29T08:39:39.661 DEBUG:teuthology.orchestra.run.smithi027:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-11-29T08:39:40.304 INFO:teuthology.orchestra.run.smithi027.stderr:Generating grub configuration file ... 2023-11-29T08:39:41.667 INFO:teuthology.orchestra.run.smithi027.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-11-29T08:39:41.699 INFO:teuthology.orchestra.run.smithi027.stderr:done 2023-11-29T08:39:41.701 DEBUG:teuthology.orchestra.run.smithi027:> mktemp 2023-11-29T08:39:41.716 INFO:teuthology.orchestra.run.smithi027.stdout:/tmp/tmp.yhx1e6nZNQ 2023-11-29T08:39:41.716 DEBUG:teuthology.orchestra.run.smithi027:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.yhx1e6nZNQ 2023-11-29T08:39:41.788 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 0666 /tmp/tmp.yhx1e6nZNQ 2023-11-29T08:39:41.929 DEBUG:teuthology.orchestra.remote:smithi027:/tmp/tmp.yhx1e6nZNQ is 6KB 2023-11-29T08:39:41.977 DEBUG:teuthology.orchestra.run.smithi027:> rm -fr /tmp/tmp.yhx1e6nZNQ 2023-11-29T08:39:41.991 DEBUG:teuthology.orchestra.run.smithi027:> sudo /bin/ls /boot/loader/entries || true 2023-11-29T08:39:42.064 INFO:teuthology.orchestra.run.smithi027.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-11-29T08:39:42.064 INFO:teuthology.orchestra.run.smithi027.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-11-29T08:39:42.064 INFO:teuthology.orchestra.run.smithi027.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-11-29T08:39:42.064 INFO:teuthology.orchestra.run.smithi027.stdout:15949e3c88704300882482eddfd7baae-5.14.0-388.el9.x86_64.conf 2023-11-29T08:39:42.066 DEBUG:teuthology.orchestra.run.smithi027:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-388.el9.x86_64 2023-11-29T08:39:42.206 DEBUG:teuthology.orchestra.run.smithi027:> sudo shutdown -r now 2023-11-29T08:40:03.870 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2023-11-29T08:40:03.871 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2023-11-29T08:40:03.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T08:40:12.214 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-11-29T08:40:12.215 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2023-11-29T08:40:12.215 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T08:41:03.923 DEBUG:teuthology.orchestra.remote:timed out 2023-11-29T08:41:12.222 DEBUG:teuthology.orchestra.remote:timed out 2023-11-29T08:41:12.924 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2023-11-29T08:41:12.925 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T08:41:16.377 DEBUG:teuthology.orchestra.run.smithi139:> true 2023-11-29T08:41:16.793 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi139.front.sepia.ceph.com' 2023-11-29T08:41:16.793 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.14.0-388.el9.x86_64"... 2023-11-29T08:41:16.793 DEBUG:teuthology.orchestra.run.smithi139:> uname -r 2023-11-29T08:41:16.807 INFO:teuthology.orchestra.run.smithi139.stdout:5.14.0-388.el9.x86_64 2023-11-29T08:41:16.808 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-388.el9.x86_64 vs 5.14.0-388.el9.x86_64 2023-11-29T08:41:16.808 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-29T08:41:16.808 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-11-29T08:41:17.809 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2023-11-29T08:41:17.809 DEBUG:teuthology.orchestra.run.smithi139:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-29T08:41:17.893 INFO:teuthology.orchestra.run.smithi139.stdout:ttyS1 2023-11-29T08:41:17.928 DEBUG:teuthology.parallel:result is None 2023-11-29T08:41:21.223 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2023-11-29T08:41:21.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T08:41:24.294 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-11-29T08:41:36.296 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2023-11-29T08:41:36.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T08:41:54.790 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-11-29T08:42:09.791 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2023-11-29T08:42:09.792 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T08:42:10.088 DEBUG:teuthology.orchestra.run.smithi027:> true 2023-11-29T08:42:10.474 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi027.front.sepia.ceph.com' 2023-11-29T08:42:10.474 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-388.el9.x86_64"... 2023-11-29T08:42:10.474 DEBUG:teuthology.orchestra.run.smithi027:> uname -r 2023-11-29T08:42:10.492 INFO:teuthology.orchestra.run.smithi027.stdout:5.14.0-388.el9.x86_64 2023-11-29T08:42:10.492 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-388.el9.x86_64 vs 5.14.0-388.el9.x86_64 2023-11-29T08:42:10.492 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-29T08:42:10.493 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-11-29T08:42:11.493 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-11-29T08:42:11.494 DEBUG:teuthology.orchestra.run.smithi027:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-29T08:42:11.612 INFO:teuthology.orchestra.run.smithi027.stdout:ttyS1 2023-11-29T08:42:11.642 DEBUG:teuthology.parallel:result is None 2023-11-29T08:42:11.643 INFO:teuthology.run_tasks:Running task internal.base... 2023-11-29T08:42:11.661 INFO:teuthology.task.internal:Creating test directory... 2023-11-29T08:42:11.661 DEBUG:teuthology.orchestra.run.smithi027:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-29T08:42:11.664 DEBUG:teuthology.orchestra.run.smithi139:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-29T08:42:11.687 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-11-29T08:42:11.696 INFO:teuthology.run_tasks:Running task internal.archive... 2023-11-29T08:42:11.701 INFO:teuthology.task.internal:Creating archive directory... 2023-11-29T08:42:11.702 DEBUG:teuthology.orchestra.run.smithi027:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-29T08:42:11.719 DEBUG:teuthology.orchestra.run.smithi139:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-29T08:42:11.786 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-11-29T08:42:11.794 INFO:teuthology.task.internal:Enabling coredump saving... 2023-11-29T08:42:11.795 DEBUG:teuthology.orchestra.run.smithi027:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-29T08:42:11.797 DEBUG:teuthology.orchestra.run.smithi139:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-29T08:42:11.836 INFO:teuthology.orchestra.run.smithi139.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-29T08:42:11.849 INFO:teuthology.orchestra.run.smithi139.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-29T08:42:12.023 INFO:teuthology.orchestra.run.smithi027.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-29T08:42:12.041 INFO:teuthology.orchestra.run.smithi027.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-29T08:42:12.042 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-11-29T08:42:12.055 INFO:teuthology.task.internal:Configuring sudo... 2023-11-29T08:42:12.055 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-29T08:42:12.058 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-29T08:42:12.090 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-11-29T08:42:12.107 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-11-29T08:42:12.107 DEBUG:teuthology.orchestra.run.smithi027:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-29T08:42:12.128 DEBUG:teuthology.orchestra.run.smithi139:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-29T08:42:12.150 DEBUG:teuthology.orchestra.run.smithi027:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-29T08:42:12.233 DEBUG:teuthology.orchestra.run.smithi027:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-29T08:42:12.301 DEBUG:teuthology.orchestra.run.smithi027:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-29T08:42:12.357 DEBUG:teuthology.orchestra.run.smithi027:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-29T08:42:12.419 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-11-29T08:42:12.419 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-29T08:42:12.510 DEBUG:teuthology.orchestra.run.smithi139:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-29T08:42:12.556 DEBUG:teuthology.orchestra.run.smithi139:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-29T08:42:12.612 DEBUG:teuthology.orchestra.run.smithi139:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-29T08:42:12.698 DEBUG:teuthology.orchestra.run.smithi139:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-29T08:42:12.743 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2023-11-29T08:42:12.743 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-29T08:42:12.813 DEBUG:teuthology.orchestra.run.smithi027:> sudo service rsyslog restart 2023-11-29T08:42:12.815 DEBUG:teuthology.orchestra.run.smithi139:> sudo service rsyslog restart 2023-11-29T08:42:12.880 INFO:teuthology.orchestra.run.smithi027.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-29T08:42:12.898 INFO:teuthology.orchestra.run.smithi139.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-29T08:42:13.372 INFO:teuthology.run_tasks:Running task internal.timer... 2023-11-29T08:42:13.389 INFO:teuthology.task.internal:Starting timer... 2023-11-29T08:42:13.389 INFO:teuthology.run_tasks:Running task pcp... 2023-11-29T08:42:13.400 INFO:teuthology.run_tasks:Running task selinux... 2023-11-29T08:42:13.409 DEBUG:teuthology.orchestra.run.smithi027:> sudo service auditd rotate 2023-11-29T08:42:13.476 INFO:teuthology.orchestra.run.smithi027.stdout:Rotating logs: 2023-11-29T08:42:13.478 DEBUG:teuthology.orchestra.run.smithi139:> sudo service auditd rotate 2023-11-29T08:42:13.529 INFO:teuthology.orchestra.run.smithi139.stdout:Rotating logs: 2023-11-29T08:42:13.531 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-11-29T08:42:13.531 DEBUG:teuthology.orchestra.run.smithi027:> /usr/sbin/getenforce 2023-11-29T08:42:13.613 INFO:teuthology.orchestra.run.smithi027.stdout:Permissive 2023-11-29T08:42:13.614 DEBUG:teuthology.orchestra.run.smithi139:> /usr/sbin/getenforce 2023-11-29T08:42:13.641 INFO:teuthology.orchestra.run.smithi139.stdout:Permissive 2023-11-29T08:42:13.641 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi027.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi139.front.sepia.ceph.com': 'permissive'} 2023-11-29T08:42:13.641 DEBUG:teuthology.orchestra.run.smithi027:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-29T08:42:13.673 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-29T08:42:13.674 DEBUG:teuthology.orchestra.run.smithi139:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-29T08:42:13.711 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-29T08:42:13.712 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-11-29T08:42:13.712 DEBUG:teuthology.orchestra.run.smithi027:> sudo /usr/sbin/setenforce permissive 2023-11-29T08:42:13.749 DEBUG:teuthology.orchestra.run.smithi139:> sudo /usr/sbin/setenforce permissive 2023-11-29T08:42:13.793 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-11-29T08:42:13.803 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-11-29T08:42:13.803 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-11-29T08:42:13.836 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-11-29T08:42:13.837 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi027.front.sepia.ceph.com,smithi139.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-11-29T08:48:23.164 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi027.front.sepia.ceph.com'), Remote(name='ubuntu@smithi139.front.sepia.ceph.com')] 2023-11-29T08:48:23.166 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2023-11-29T08:48:23.167 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T08:48:23.263 DEBUG:teuthology.orchestra.run.smithi027:> true 2023-11-29T08:48:23.333 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi027.front.sepia.ceph.com' 2023-11-29T08:48:23.333 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2023-11-29T08:48:23.334 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T08:48:23.415 DEBUG:teuthology.orchestra.run.smithi139:> true 2023-11-29T08:48:23.481 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi139.front.sepia.ceph.com' 2023-11-29T08:48:23.481 INFO:teuthology.run_tasks:Running task clock... 2023-11-29T08:48:23.492 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-11-29T08:48:23.492 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-29T08:48:23.492 DEBUG:teuthology.orchestra.run.smithi027:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-29T08:48:23.495 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-29T08:48:23.495 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-29T08:48:23.528 INFO:teuthology.orchestra.run.smithi027.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-29T08:48:23.548 INFO:teuthology.orchestra.run.smithi027.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-29T08:48:23.553 INFO:teuthology.orchestra.run.smithi139.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-29T08:48:23.569 INFO:teuthology.orchestra.run.smithi139.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-29T08:48:23.583 INFO:teuthology.orchestra.run.smithi027.stderr:sudo: ntpd: command not found 2023-11-29T08:48:23.599 INFO:teuthology.orchestra.run.smithi139.stderr:sudo: ntpd: command not found 2023-11-29T08:48:23.600 INFO:teuthology.orchestra.run.smithi027.stdout:506 Cannot talk to daemon 2023-11-29T08:48:23.613 INFO:teuthology.orchestra.run.smithi139.stdout:506 Cannot talk to daemon 2023-11-29T08:48:23.620 INFO:teuthology.orchestra.run.smithi027.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-29T08:48:23.629 INFO:teuthology.orchestra.run.smithi139.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-29T08:48:23.639 INFO:teuthology.orchestra.run.smithi027.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-29T08:48:23.645 INFO:teuthology.orchestra.run.smithi139.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-29T08:48:23.686 INFO:teuthology.orchestra.run.smithi027.stderr:bash: line 1: ntpq: command not found 2023-11-29T08:48:23.688 INFO:teuthology.orchestra.run.smithi139.stderr:bash: line 1: ntpq: command not found 2023-11-29T08:48:23.690 INFO:teuthology.orchestra.run.smithi027.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-29T08:48:23.690 INFO:teuthology.orchestra.run.smithi027.stdout:=============================================================================== 2023-11-29T08:48:23.690 INFO:teuthology.orchestra.run.smithi027.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-29T08:48:23.690 INFO:teuthology.orchestra.run.smithi027.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-29T08:48:23.691 INFO:teuthology.orchestra.run.smithi027.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-29T08:48:23.691 INFO:teuthology.orchestra.run.smithi027.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-29T08:48:23.691 INFO:teuthology.orchestra.run.smithi139.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-29T08:48:23.691 INFO:teuthology.orchestra.run.smithi139.stdout:=============================================================================== 2023-11-29T08:48:23.691 INFO:teuthology.orchestra.run.smithi139.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-29T08:48:23.691 INFO:teuthology.orchestra.run.smithi139.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-29T08:48:23.691 INFO:teuthology.orchestra.run.smithi139.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-29T08:48:23.692 INFO:teuthology.orchestra.run.smithi139.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-29T08:48:23.693 INFO:teuthology.run_tasks:Running task install... 2023-11-29T08:48:23.701 DEBUG:teuthology.task.install:project ceph 2023-11-29T08:48:23.701 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'crimson', 'sha1': '412bfade5c44735b71d7c14eb55649269cd32a35'}} 2023-11-29T08:48:23.701 DEBUG:teuthology.task.install:config {'flavor': 'crimson', 'sha1': '412bfade5c44735b71d7c14eb55649269cd32a35'} 2023-11-29T08:48:23.701 INFO:teuthology.task.install:Using flavor: crimson 2023-11-29T08:48:23.706 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-11-29T08:48:23.707 INFO:teuthology.task.install:extra packages: [] 2023-11-29T08:48:23.707 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'crimson', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '412bfade5c44735b71d7c14eb55649269cd32a35', 'tag': None, 'wait_for_package': False} 2023-11-29T08:48:23.708 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=412bfade5c44735b71d7c14eb55649269cd32a35 2023-11-29T08:48:23.710 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'crimson', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '412bfade5c44735b71d7c14eb55649269cd32a35', 'tag': None, 'wait_for_package': False} 2023-11-29T08:48:23.710 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=412bfade5c44735b71d7c14eb55649269cd32a35 2023-11-29T08:48:23.850 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-matanb-crimson-snaptrimevent-lifetime-v2/412bfade5c44735b71d7c14eb55649269cd32a35/centos/9/flavors/crimson/ 2023-11-29T08:48:23.850 INFO:teuthology.task.install.rpm:Package version is 18.0.0-7483.g412bfade 2023-11-29T08:48:23.924 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-matanb-crimson-snaptrimevent-lifetime-v2/412bfade5c44735b71d7c14eb55649269cd32a35/centos/9/flavors/crimson/ 2023-11-29T08:48:23.924 INFO:teuthology.task.install.rpm:Package version is 18.0.0-7483.g412bfade 2023-11-29T08:48:24.249 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-matanb-crimson-snaptrimevent-lifetime-v2/412bfade5c44735b71d7c14eb55649269cd32a35/centos/9/flavors/crimson/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-matanb-crimson-snaptrimevent-lifetime-v2/412bfade5c44735b71d7c14eb55649269cd32a35/centos/9/flavors/crimson/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-matanb-crimson-snaptrimevent-lifetime-v2/412bfade5c44735b71d7c14eb55649269cd32a35/centos/9/flavors/crimson/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-29T08:48:24.249 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-11-29T08:48:24.249 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-29T08:48:24.282 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-11-29T08:48:24.282 DEBUG:teuthology.orchestra.run.smithi027:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/412bfade5c44735b71d7c14eb55649269cd32a35/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-29T08:48:24.311 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-matanb-crimson-snaptrimevent-lifetime-v2/412bfade5c44735b71d7c14eb55649269cd32a35/centos/9/flavors/crimson/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-matanb-crimson-snaptrimevent-lifetime-v2/412bfade5c44735b71d7c14eb55649269cd32a35/centos/9/flavors/crimson/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-matanb-crimson-snaptrimevent-lifetime-v2/412bfade5c44735b71d7c14eb55649269cd32a35/centos/9/flavors/crimson/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-29T08:48:24.311 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2023-11-29T08:48:24.311 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-29T08:48:24.341 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-11-29T08:48:24.342 DEBUG:teuthology.orchestra.run.smithi139:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/412bfade5c44735b71d7c14eb55649269cd32a35/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-29T08:48:24.355 DEBUG:teuthology.orchestra.run.smithi027:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-29T08:48:24.411 DEBUG:teuthology.orchestra.run.smithi139:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-29T08:48:24.444 DEBUG:teuthology.orchestra.run.smithi027:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-29T08:48:24.474 INFO:teuthology.orchestra.run.smithi027.stdout:check_obsoletes = 1 2023-11-29T08:48:24.475 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum clean all 2023-11-29T08:48:24.493 DEBUG:teuthology.orchestra.run.smithi139:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-29T08:48:24.560 INFO:teuthology.orchestra.run.smithi139.stdout:check_obsoletes = 1 2023-11-29T08:48:24.562 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum clean all 2023-11-29T08:48:24.728 INFO:teuthology.orchestra.run.smithi027.stdout:73 files removed 2023-11-29T08:48:24.756 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum -y install ceph-radosgw 2023-11-29T08:48:24.805 INFO:teuthology.orchestra.run.smithi139.stdout:73 files removed 2023-11-29T08:48:24.832 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install ceph-radosgw 2023-11-29T08:48:26.025 INFO:teuthology.orchestra.run.smithi027.stdout:ceph packages for x86_64 87 kB/s | 81 kB 00:00 2023-11-29T08:48:26.304 INFO:teuthology.orchestra.run.smithi139.stdout:ceph packages for x86_64 70 kB/s | 81 kB 00:01 2023-11-29T08:48:26.842 INFO:teuthology.orchestra.run.smithi027.stdout:ceph noarch packages 12 kB/s | 9.5 kB 00:00 2023-11-29T08:48:27.204 INFO:teuthology.orchestra.run.smithi139.stdout:ceph noarch packages 11 kB/s | 9.5 kB 00:00 2023-11-29T08:48:27.593 INFO:teuthology.orchestra.run.smithi027.stdout:ceph source packages 2.7 kB/s | 1.9 kB 00:00 2023-11-29T08:48:28.013 INFO:teuthology.orchestra.run.smithi027.stdout:CentOS-9 - AppStream 17 MB/s | 6.4 MB 00:00 2023-11-29T08:48:28.072 INFO:teuthology.orchestra.run.smithi139.stdout:ceph source packages 2.4 kB/s | 1.9 kB 00:00 2023-11-29T08:48:28.532 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS-9 - AppStream 15 MB/s | 6.4 MB 00:00 2023-11-29T08:48:29.429 INFO:teuthology.orchestra.run.smithi027.stdout:CentOS-9 - BaseOS 7.1 MB/s | 2.0 MB 00:00 2023-11-29T08:48:30.115 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS-9 - BaseOS 3.8 MB/s | 2.0 MB 00:00 2023-11-29T08:48:30.320 INFO:teuthology.orchestra.run.smithi027.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 7.9 MB 00:00 2023-11-29T08:48:32.357 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - BaseOS 4.1 MB/s | 7.9 MB 00:01 2023-11-29T08:48:33.971 INFO:teuthology.orchestra.run.smithi027.stdout:CentOS Stream 9 - AppStream 7.3 MB/s | 18 MB 00:02 2023-11-29T08:48:34.590 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - AppStream 16 MB/s | 18 MB 00:01 2023-11-29T08:48:37.988 INFO:teuthology.orchestra.run.smithi027.stdout:CentOS Stream 9 - CRB 13 MB/s | 5.8 MB 00:00 2023-11-29T08:48:38.332 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - CRB 14 MB/s | 5.8 MB 00:00 2023-11-29T08:48:39.916 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - Extras packages 33 kB/s | 15 kB 00:00 2023-11-29T08:48:40.497 INFO:teuthology.orchestra.run.smithi027.stdout:CentOS Stream 9 - Extras packages 11 kB/s | 15 kB 00:01 2023-11-29T08:48:41.603 INFO:teuthology.orchestra.run.smithi139.stdout:Extra Packages for Enterprise Linux 13 MB/s | 20 MB 00:01 2023-11-29T08:48:42.610 INFO:teuthology.orchestra.run.smithi027.stdout:Extra Packages for Enterprise Linux 10 MB/s | 20 MB 00:01 2023-11-29T08:48:46.526 INFO:teuthology.orchestra.run.smithi139.stdout:lab-extras 5.4 kB/s | 1.7 kB 00:00 2023-11-29T08:48:47.649 INFO:teuthology.orchestra.run.smithi027.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2023-11-29T08:48:49.196 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2023-11-29T08:48:49.204 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2023-11-29T08:48:49.204 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repository Size 2023-11-29T08:48:49.204 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2023-11-29T08:48:49.204 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2023-11-29T08:48:49.204 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-radosgw x86_64 2:18.0.0-7483.g412bfade.el9 ceph 8.4 M 2023-11-29T08:48:49.204 INFO:teuthology.orchestra.run.smithi139.stdout:Upgrading: 2023-11-29T08:48:49.204 INFO:teuthology.orchestra.run.smithi139.stdout: librados2 x86_64 2:18.0.0-7483.g412bfade.el9 ceph 3.1 M 2023-11-29T08:48:49.204 INFO:teuthology.orchestra.run.smithi139.stdout: librbd1 x86_64 2:18.0.0-7483.g412bfade.el9 ceph 3.0 M 2023-11-29T08:48:49.204 INFO:teuthology.orchestra.run.smithi139.stdout:Installing dependencies: 2023-11-29T08:48:49.205 INFO:teuthology.orchestra.run.smithi139.stdout: boost-program-options 2023-11-29T08:48:49.205 INFO:teuthology.orchestra.run.smithi139.stdout: x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-11-29T08:48:49.205 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-base x86_64 2:18.0.0-7483.g412bfade.el9 ceph 6.6 M 2023-11-29T08:48:49.205 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-common x86_64 2:18.0.0-7483.g412bfade.el9 ceph 17 M 2023-11-29T08:48:49.205 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-selinux x86_64 2:18.0.0-7483.g412bfade.el9 ceph 24 k 2023-11-29T08:48:49.205 INFO:teuthology.orchestra.run.smithi139.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-11-29T08:48:49.205 INFO:teuthology.orchestra.run.smithi139.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-11-29T08:48:49.205 INFO:teuthology.orchestra.run.smithi139.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-11-29T08:48:49.205 INFO:teuthology.orchestra.run.smithi139.stdout: libcephfs2 x86_64 2:18.0.0-7483.g412bfade.el9 ceph 728 k 2023-11-29T08:48:49.205 INFO:teuthology.orchestra.run.smithi139.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-11-29T08:48:49.206 INFO:teuthology.orchestra.run.smithi139.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-11-29T08:48:49.206 INFO:teuthology.orchestra.run.smithi139.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-11-29T08:48:49.206 INFO:teuthology.orchestra.run.smithi139.stdout: libradosstriper1 x86_64 2:18.0.0-7483.g412bfade.el9 ceph 470 k 2023-11-29T08:48:49.206 INFO:teuthology.orchestra.run.smithi139.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-11-29T08:48:49.206 INFO:teuthology.orchestra.run.smithi139.stdout: librgw2 x86_64 2:18.0.0-7483.g412bfade.el9 ceph 4.5 M 2023-11-29T08:48:49.206 INFO:teuthology.orchestra.run.smithi139.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-11-29T08:48:49.206 INFO:teuthology.orchestra.run.smithi139.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-11-29T08:48:49.206 INFO:teuthology.orchestra.run.smithi139.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-11-29T08:48:49.206 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ceph-argparse 2023-11-29T08:48:49.206 INFO:teuthology.orchestra.run.smithi139.stdout: x86_64 2:18.0.0-7483.g412bfade.el9 ceph 45 k 2023-11-29T08:48:49.207 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ceph-common x86_64 2:18.0.0-7483.g412bfade.el9 ceph 129 k 2023-11-29T08:48:49.207 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cephfs x86_64 2:18.0.0-7483.g412bfade.el9 ceph 161 k 2023-11-29T08:48:49.207 INFO:teuthology.orchestra.run.smithi139.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-11-29T08:48:49.207 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rados x86_64 2:18.0.0-7483.g412bfade.el9 ceph 321 k 2023-11-29T08:48:49.207 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rbd x86_64 2:18.0.0-7483.g412bfade.el9 ceph 298 k 2023-11-29T08:48:49.207 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rgw x86_64 2:18.0.0-7483.g412bfade.el9 ceph 99 k 2023-11-29T08:48:49.207 INFO:teuthology.orchestra.run.smithi139.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-11-29T08:48:49.207 INFO:teuthology.orchestra.run.smithi139.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-11-29T08:48:49.207 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:48:49.207 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2023-11-29T08:48:49.207 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2023-11-29T08:48:49.207 INFO:teuthology.orchestra.run.smithi139.stdout:Install 27 Packages 2023-11-29T08:48:49.208 INFO:teuthology.orchestra.run.smithi139.stdout:Upgrade 2 Packages 2023-11-29T08:48:49.208 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:48:49.208 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 54 M 2023-11-29T08:48:49.208 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2023-11-29T08:48:50.474 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. 2023-11-29T08:48:50.484 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2023-11-29T08:48:50.484 INFO:teuthology.orchestra.run.smithi027.stdout: Package Arch Version Repository Size 2023-11-29T08:48:50.484 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2023-11-29T08:48:50.485 INFO:teuthology.orchestra.run.smithi027.stdout:Installing: 2023-11-29T08:48:50.485 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-radosgw x86_64 2:18.0.0-7483.g412bfade.el9 ceph 8.4 M 2023-11-29T08:48:50.485 INFO:teuthology.orchestra.run.smithi027.stdout:Upgrading: 2023-11-29T08:48:50.485 INFO:teuthology.orchestra.run.smithi027.stdout: librados2 x86_64 2:18.0.0-7483.g412bfade.el9 ceph 3.1 M 2023-11-29T08:48:50.485 INFO:teuthology.orchestra.run.smithi027.stdout: librbd1 x86_64 2:18.0.0-7483.g412bfade.el9 ceph 3.0 M 2023-11-29T08:48:50.485 INFO:teuthology.orchestra.run.smithi027.stdout:Installing dependencies: 2023-11-29T08:48:50.485 INFO:teuthology.orchestra.run.smithi027.stdout: boost-program-options 2023-11-29T08:48:50.485 INFO:teuthology.orchestra.run.smithi027.stdout: x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-11-29T08:48:50.485 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-base x86_64 2:18.0.0-7483.g412bfade.el9 ceph 6.6 M 2023-11-29T08:48:50.485 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-common x86_64 2:18.0.0-7483.g412bfade.el9 ceph 17 M 2023-11-29T08:48:50.485 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-selinux x86_64 2:18.0.0-7483.g412bfade.el9 ceph 24 k 2023-11-29T08:48:50.485 INFO:teuthology.orchestra.run.smithi027.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-11-29T08:48:50.485 INFO:teuthology.orchestra.run.smithi027.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-11-29T08:48:50.485 INFO:teuthology.orchestra.run.smithi027.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-11-29T08:48:50.485 INFO:teuthology.orchestra.run.smithi027.stdout: libcephfs2 x86_64 2:18.0.0-7483.g412bfade.el9 ceph 728 k 2023-11-29T08:48:50.485 INFO:teuthology.orchestra.run.smithi027.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-11-29T08:48:50.486 INFO:teuthology.orchestra.run.smithi027.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-11-29T08:48:50.486 INFO:teuthology.orchestra.run.smithi027.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-11-29T08:48:50.486 INFO:teuthology.orchestra.run.smithi027.stdout: libradosstriper1 x86_64 2:18.0.0-7483.g412bfade.el9 ceph 470 k 2023-11-29T08:48:50.486 INFO:teuthology.orchestra.run.smithi027.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-11-29T08:48:50.486 INFO:teuthology.orchestra.run.smithi027.stdout: librgw2 x86_64 2:18.0.0-7483.g412bfade.el9 ceph 4.5 M 2023-11-29T08:48:50.486 INFO:teuthology.orchestra.run.smithi027.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-11-29T08:48:50.486 INFO:teuthology.orchestra.run.smithi027.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-11-29T08:48:50.486 INFO:teuthology.orchestra.run.smithi027.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-11-29T08:48:50.486 INFO:teuthology.orchestra.run.smithi027.stdout: python3-ceph-argparse 2023-11-29T08:48:50.486 INFO:teuthology.orchestra.run.smithi027.stdout: x86_64 2:18.0.0-7483.g412bfade.el9 ceph 45 k 2023-11-29T08:48:50.486 INFO:teuthology.orchestra.run.smithi027.stdout: python3-ceph-common x86_64 2:18.0.0-7483.g412bfade.el9 ceph 129 k 2023-11-29T08:48:50.486 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cephfs x86_64 2:18.0.0-7483.g412bfade.el9 ceph 161 k 2023-11-29T08:48:50.486 INFO:teuthology.orchestra.run.smithi027.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-11-29T08:48:50.486 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rados x86_64 2:18.0.0-7483.g412bfade.el9 ceph 321 k 2023-11-29T08:48:50.486 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rbd x86_64 2:18.0.0-7483.g412bfade.el9 ceph 298 k 2023-11-29T08:48:50.486 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rgw x86_64 2:18.0.0-7483.g412bfade.el9 ceph 99 k 2023-11-29T08:48:50.487 INFO:teuthology.orchestra.run.smithi027.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-11-29T08:48:50.487 INFO:teuthology.orchestra.run.smithi027.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-11-29T08:48:50.487 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:48:50.487 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction Summary 2023-11-29T08:48:50.487 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2023-11-29T08:48:50.487 INFO:teuthology.orchestra.run.smithi027.stdout:Install 27 Packages 2023-11-29T08:48:50.487 INFO:teuthology.orchestra.run.smithi027.stdout:Upgrade 2 Packages 2023-11-29T08:48:50.487 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:48:50.487 INFO:teuthology.orchestra.run.smithi027.stdout:Total download size: 54 M 2023-11-29T08:48:50.487 INFO:teuthology.orchestra.run.smithi027.stdout:Downloading Packages: 2023-11-29T08:49:01.929 INFO:teuthology.orchestra.run.smithi139.stdout:(1/29): ceph-base-18.0.0-7483.g412bfade.el9.x86 535 kB/s | 6.6 MB 00:12 2023-11-29T08:49:02.271 INFO:teuthology.orchestra.run.smithi139.stdout:(2/29): ceph-selinux-18.0.0-7483.g412bfade.el9. 70 kB/s | 24 kB 00:00 2023-11-29T08:49:02.490 INFO:teuthology.orchestra.run.smithi027.stdout:(1/29): ceph-base-18.0.0-7483.g412bfade.el9.x86 567 kB/s | 6.6 MB 00:11 2023-11-29T08:49:02.582 INFO:teuthology.orchestra.run.smithi027.stdout:(2/29): ceph-selinux-18.0.0-7483.g412bfade.el9. 263 kB/s | 24 kB 00:00 2023-11-29T08:49:03.721 INFO:teuthology.orchestra.run.smithi139.stdout:(3/29): ceph-radosgw-18.0.0-7483.g412bfade.el9. 594 kB/s | 8.4 MB 00:14 2023-11-29T08:49:03.854 INFO:teuthology.orchestra.run.smithi139.stdout:(4/29): libcephfs2-18.0.0-7483.g412bfade.el9.x8 460 kB/s | 728 kB 00:01 2023-11-29T08:49:04.116 INFO:teuthology.orchestra.run.smithi027.stdout:(3/29): libcephfs2-18.0.0-7483.g412bfade.el9.x8 475 kB/s | 728 kB 00:01 2023-11-29T08:49:04.571 INFO:teuthology.orchestra.run.smithi139.stdout:(5/29): libradosstriper1-18.0.0-7483.g412bfade. 553 kB/s | 470 kB 00:00 2023-11-29T08:49:04.738 INFO:teuthology.orchestra.run.smithi139.stdout:(6/29): python3-ceph-argparse-18.0.0-7483.g412b 270 kB/s | 45 kB 00:00 2023-11-29T08:49:04.974 INFO:teuthology.orchestra.run.smithi027.stdout:(4/29): libradosstriper1-18.0.0-7483.g412bfade. 548 kB/s | 470 kB 00:00 2023-11-29T08:49:05.021 INFO:teuthology.orchestra.run.smithi139.stdout:(7/29): python3-ceph-common-18.0.0-7483.g412bfa 455 kB/s | 129 kB 00:00 2023-11-29T08:49:05.355 INFO:teuthology.orchestra.run.smithi139.stdout:(8/29): python3-cephfs-18.0.0-7483.g412bfade.el 484 kB/s | 161 kB 00:00 2023-11-29T08:49:05.955 INFO:teuthology.orchestra.run.smithi139.stdout:(9/29): python3-rados-18.0.0-7483.g412bfade.el9 535 kB/s | 321 kB 00:00 2023-11-29T08:49:06.414 INFO:teuthology.orchestra.run.smithi139.stdout:(10/29): python3-rbd-18.0.0-7483.g412bfade.el9. 650 kB/s | 298 kB 00:00 2023-11-29T08:49:06.606 INFO:teuthology.orchestra.run.smithi139.stdout:(11/29): python3-rgw-18.0.0-7483.g412bfade.el9. 519 kB/s | 99 kB 00:00 2023-11-29T08:49:06.715 INFO:teuthology.orchestra.run.smithi139.stdout:(12/29): boost-program-options-1.75.0-8.el9.x86 977 kB/s | 106 kB 00:00 2023-11-29T08:49:06.757 INFO:teuthology.orchestra.run.smithi139.stdout:(13/29): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.8 MB/s | 159 kB 00:00 2023-11-29T08:49:06.790 INFO:teuthology.orchestra.run.smithi139.stdout:(14/29): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2023-11-29T08:49:06.840 INFO:teuthology.orchestra.run.smithi139.stdout:(15/29): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 661 kB 00:00 2023-11-29T08:49:06.883 INFO:teuthology.orchestra.run.smithi139.stdout:(16/29): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.6 MB/s | 282 kB 00:00 2023-11-29T08:49:06.916 INFO:teuthology.orchestra.run.smithi139.stdout:(17/29): python3-prettytable-0.7.2-27.el9.noarc 1.2 MB/s | 41 kB 00:00 2023-11-29T08:49:07.116 INFO:teuthology.orchestra.run.smithi027.stdout:(5/29): ceph-radosgw-18.0.0-7483.g412bfade.el9. 518 kB/s | 8.4 MB 00:16 2023-11-29T08:49:07.166 INFO:teuthology.orchestra.run.smithi139.stdout:(18/29): gperftools-libs-2.9.1-2.el9.x86_64.rpm 1.2 MB/s | 309 kB 00:00 2023-11-29T08:49:07.233 INFO:teuthology.orchestra.run.smithi027.stdout:(6/29): python3-ceph-argparse-18.0.0-7483.g412b 387 kB/s | 45 kB 00:00 2023-11-29T08:49:07.442 INFO:teuthology.orchestra.run.smithi027.stdout:(7/29): python3-ceph-common-18.0.0-7483.g412bfa 619 kB/s | 129 kB 00:00 2023-11-29T08:49:07.650 INFO:teuthology.orchestra.run.smithi027.stdout:(8/29): python3-cephfs-18.0.0-7483.g412bfade.el 775 kB/s | 161 kB 00:00 2023-11-29T08:49:07.683 INFO:teuthology.orchestra.run.smithi139.stdout:(19/29): libarrow-9.0.0-9.el9.x86_64.rpm 8.6 MB/s | 4.4 MB 00:00 2023-11-29T08:49:07.792 INFO:teuthology.orchestra.run.smithi139.stdout:(20/29): libarrow-doc-9.0.0-9.el9.noarch.rpm 225 kB/s | 24 kB 00:00 2023-11-29T08:49:07.908 INFO:teuthology.orchestra.run.smithi139.stdout:(21/29): liboath-2.6.7-2.el9.x86_64.rpm 418 kB/s | 49 kB 00:00 2023-11-29T08:49:08.034 INFO:teuthology.orchestra.run.smithi139.stdout:(22/29): libunwind-1.6.2-1.el9.x86_64.rpm 540 kB/s | 67 kB 00:00 2023-11-29T08:49:08.142 INFO:teuthology.orchestra.run.smithi027.stdout:(9/29): python3-rados-18.0.0-7483.g412bfade.el9 652 kB/s | 321 kB 00:00 2023-11-29T08:49:08.226 INFO:teuthology.orchestra.run.smithi139.stdout:(23/29): parquet-libs-9.0.0-9.el9.x86_64.rpm 4.3 MB/s | 837 kB 00:00 2023-11-29T08:49:08.409 INFO:teuthology.orchestra.run.smithi139.stdout:(24/29): re2-20211101-3.el9.x86_64.rpm 1.0 MB/s | 192 kB 00:00 2023-11-29T08:49:08.651 INFO:teuthology.orchestra.run.smithi139.stdout:(25/29): thrift-0.15.0-2.el9.x86_64.rpm 6.5 MB/s | 1.6 MB 00:00 2023-11-29T08:49:08.801 INFO:teuthology.orchestra.run.smithi027.stdout:(10/29): python3-rbd-18.0.0-7483.g412bfade.el9. 453 kB/s | 298 kB 00:00 2023-11-29T08:49:09.101 INFO:teuthology.orchestra.run.smithi027.stdout:(11/29): python3-rgw-18.0.0-7483.g412bfade.el9. 331 kB/s | 99 kB 00:00 2023-11-29T08:49:09.209 INFO:teuthology.orchestra.run.smithi027.stdout:(12/29): boost-program-options-1.75.0-8.el9.x86 977 kB/s | 106 kB 00:00 2023-11-29T08:49:09.260 INFO:teuthology.orchestra.run.smithi027.stdout:(13/29): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 159 kB 00:00 2023-11-29T08:49:09.294 INFO:teuthology.orchestra.run.smithi027.stdout:(14/29): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2023-11-29T08:49:09.344 INFO:teuthology.orchestra.run.smithi027.stdout:(15/29): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 661 kB 00:00 2023-11-29T08:49:09.394 INFO:teuthology.orchestra.run.smithi027.stdout:(16/29): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.5 MB/s | 282 kB 00:00 2023-11-29T08:49:09.428 INFO:teuthology.orchestra.run.smithi027.stdout:(17/29): python3-prettytable-0.7.2-27.el9.noarc 1.2 MB/s | 41 kB 00:00 2023-11-29T08:49:09.695 INFO:teuthology.orchestra.run.smithi027.stdout:(18/29): gperftools-libs-2.9.1-2.el9.x86_64.rpm 1.1 MB/s | 309 kB 00:00 2023-11-29T08:49:09.920 INFO:teuthology.orchestra.run.smithi027.stdout:(19/29): libarrow-9.0.0-9.el9.x86_64.rpm 20 MB/s | 4.4 MB 00:00 2023-11-29T08:49:09.979 INFO:teuthology.orchestra.run.smithi027.stdout:(20/29): libarrow-doc-9.0.0-9.el9.noarch.rpm 419 kB/s | 24 kB 00:00 2023-11-29T08:49:10.020 INFO:teuthology.orchestra.run.smithi027.stdout:(21/29): liboath-2.6.7-2.el9.x86_64.rpm 1.1 MB/s | 49 kB 00:00 2023-11-29T08:49:10.062 INFO:teuthology.orchestra.run.smithi027.stdout:(22/29): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2023-11-29T08:49:10.113 INFO:teuthology.orchestra.run.smithi027.stdout:(23/29): parquet-libs-9.0.0-9.el9.x86_64.rpm 16 MB/s | 837 kB 00:00 2023-11-29T08:49:10.155 INFO:teuthology.orchestra.run.smithi027.stdout:(24/29): re2-20211101-3.el9.x86_64.rpm 4.5 MB/s | 192 kB 00:00 2023-11-29T08:49:10.222 INFO:teuthology.orchestra.run.smithi027.stdout:(25/29): thrift-0.15.0-2.el9.x86_64.rpm 24 MB/s | 1.6 MB 00:00 2023-11-29T08:49:10.468 INFO:teuthology.orchestra.run.smithi139.stdout:(26/29): librgw2-18.0.0-7483.g412bfade.el9.x86_ 695 kB/s | 4.5 MB 00:06 2023-11-29T08:49:12.688 INFO:teuthology.orchestra.run.smithi027.stdout:(26/29): librgw2-18.0.0-7483.g412bfade.el9.x86_ 596 kB/s | 4.5 MB 00:07 2023-11-29T08:49:13.185 INFO:teuthology.orchestra.run.smithi139.stdout:(27/29): librados2-18.0.0-7483.g412bfade.el9.x8 702 kB/s | 3.1 MB 00:04 2023-11-29T08:49:14.801 INFO:teuthology.orchestra.run.smithi139.stdout:(28/29): librbd1-18.0.0-7483.g412bfade.el9.x86_ 714 kB/s | 3.0 MB 00:04 2023-11-29T08:49:15.088 INFO:teuthology.orchestra.run.smithi027.stdout:(27/29): librados2-18.0.0-7483.g412bfade.el9.x8 654 kB/s | 3.1 MB 00:04 2023-11-29T08:49:15.551 INFO:teuthology.orchestra.run.smithi139.stdout:(29/29): ceph-common-18.0.0-7483.g412bfade.el9. 671 kB/s | 17 MB 00:26 2023-11-29T08:49:15.556 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2023-11-29T08:49:15.556 INFO:teuthology.orchestra.run.smithi139.stdout:Total 2.0 MB/s | 54 MB 00:26 2023-11-29T08:49:15.556 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2023-11-29T08:49:15.592 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2023-11-29T08:49:15.592 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2023-11-29T08:49:16.049 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2023-11-29T08:49:16.049 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2023-11-29T08:49:17.238 INFO:teuthology.orchestra.run.smithi027.stdout:(28/29): librbd1-18.0.0-7483.g412bfade.el9.x86_ 680 kB/s | 3.0 MB 00:04 2023-11-29T08:49:17.373 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2023-11-29T08:49:17.802 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/31 2023-11-29T08:49:17.836 INFO:teuthology.orchestra.run.smithi139.stdout: Upgrading : librados2-2:18.0.0-7483.g412bfade.el9.x86_64 2/31 2023-11-29T08:49:17.920 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librados2-2:18.0.0-7483.g412bfade.el9.x86_64 2/31 2023-11-29T08:49:18.013 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-rados-2:18.0.0-7483.g412bfade.el9.x86_64 3/31 2023-11-29T08:49:18.038 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libcephfs2-2:18.0.0-7483.g412bfade.el9.x86_64 4/31 2023-11-29T08:49:18.100 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: libcephfs2-2:18.0.0-7483.g412bfade.el9.x86_64 4/31 2023-11-29T08:49:18.125 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/31 2023-11-29T08:49:18.150 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 6/31 2023-11-29T08:49:18.198 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : liboath-2.6.7-2.el9.x86_64 7/31 2023-11-29T08:49:18.233 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-ceph-argparse-2:18.0.0-7483.g412bfade.el9. 8/31 2023-11-29T08:49:18.299 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cephfs-2:18.0.0-7483.g412bfade.el9.x86_64 9/31 2023-11-29T08:49:18.325 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libradosstriper1-2:18.0.0-7483.g412bfade.el9.x86_6 10/31 2023-11-29T08:49:18.413 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: libradosstriper1-2:18.0.0-7483.g412bfade.el9.x86_6 10/31 2023-11-29T08:49:18.449 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : thrift-0.15.0-2.el9.x86_64 11/31 2023-11-29T08:49:18.555 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : re2-1:20211101-3.el9.x86_64 12/31 2023-11-29T08:49:18.583 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 13/31 2023-11-29T08:49:18.624 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/31 2023-11-29T08:49:18.665 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/31 2023-11-29T08:49:18.694 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 16/31 2023-11-29T08:49:18.726 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 17/31 2023-11-29T08:49:19.050 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 18/31 2023-11-29T08:49:19.073 INFO:teuthology.orchestra.run.smithi139.stdout: Upgrading : librbd1-2:18.0.0-7483.g412bfade.el9.x86_64 19/31 2023-11-29T08:49:19.162 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librbd1-2:18.0.0-7483.g412bfade.el9.x86_64 19/31 2023-11-29T08:49:19.194 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-rbd-2:18.0.0-7483.g412bfade.el9.x86_64 20/31 2023-11-29T08:49:19.229 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 21/31 2023-11-29T08:49:19.658 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 22/31 2023-11-29T08:49:19.692 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : librgw2-2:18.0.0-7483.g412bfade.el9.x86_64 23/31 2023-11-29T08:49:19.763 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librgw2-2:18.0.0-7483.g412bfade.el9.x86_64 23/31 2023-11-29T08:49:19.840 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-rgw-2:18.0.0-7483.g412bfade.el9.x86_64 24/31 2023-11-29T08:49:19.869 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-ceph-common-2:18.0.0-7483.g412bfade.el9.x8 25/31 2023-11-29T08:49:21.926 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-common-2:18.0.0-7483.g412bfade.el9.x86_64 26/31 2023-11-29T08:49:21.974 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-common-2:18.0.0-7483.g412bfade.el9.x86_64 26/31 2023-11-29T08:49:22.725 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-common-2:18.0.0-7483.g412bfade.el9.x86_64 26/31 2023-11-29T08:49:22.777 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-base-2:18.0.0-7483.g412bfade.el9.x86_64 27/31 2023-11-29T08:49:22.863 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-base-2:18.0.0-7483.g412bfade.el9.x86_64 27/31 2023-11-29T08:49:22.863 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-11-29T08:49:22.863 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-11-29T08:49:22.863 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:49:22.895 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-selinux-2:18.0.0-7483.g412bfade.el9.x86_64 28/31 2023-11-29T08:49:24.430 INFO:teuthology.orchestra.run.smithi027.stdout:(29/29): ceph-common-18.0.0-7483.g412bfade.el9. 521 kB/s | 17 MB 00:33 2023-11-29T08:49:24.434 INFO:teuthology.orchestra.run.smithi027.stdout:-------------------------------------------------------------------------------- 2023-11-29T08:49:24.434 INFO:teuthology.orchestra.run.smithi027.stdout:Total 1.6 MB/s | 54 MB 00:33 2023-11-29T08:49:24.434 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction check 2023-11-29T08:49:24.469 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction check succeeded. 2023-11-29T08:49:24.469 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction test 2023-11-29T08:49:24.955 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction test succeeded. 2023-11-29T08:49:24.955 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction 2023-11-29T08:49:26.350 INFO:teuthology.orchestra.run.smithi027.stdout: Preparing : 1/1 2023-11-29T08:49:26.711 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/31 2023-11-29T08:49:26.760 INFO:teuthology.orchestra.run.smithi027.stdout: Upgrading : librados2-2:18.0.0-7483.g412bfade.el9.x86_64 2/31 2023-11-29T08:49:26.853 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: librados2-2:18.0.0-7483.g412bfade.el9.x86_64 2/31 2023-11-29T08:49:26.944 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-rados-2:18.0.0-7483.g412bfade.el9.x86_64 3/31 2023-11-29T08:49:26.971 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libcephfs2-2:18.0.0-7483.g412bfade.el9.x86_64 4/31 2023-11-29T08:49:27.054 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: libcephfs2-2:18.0.0-7483.g412bfade.el9.x86_64 4/31 2023-11-29T08:49:27.083 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/31 2023-11-29T08:49:27.108 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 6/31 2023-11-29T08:49:27.138 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : liboath-2.6.7-2.el9.x86_64 7/31 2023-11-29T08:49:27.174 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-ceph-argparse-2:18.0.0-7483.g412bfade.el9. 8/31 2023-11-29T08:49:27.242 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-cephfs-2:18.0.0-7483.g412bfade.el9.x86_64 9/31 2023-11-29T08:49:27.265 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libradosstriper1-2:18.0.0-7483.g412bfade.el9.x86_6 10/31 2023-11-29T08:49:27.353 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: libradosstriper1-2:18.0.0-7483.g412bfade.el9.x86_6 10/31 2023-11-29T08:49:27.389 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : thrift-0.15.0-2.el9.x86_64 11/31 2023-11-29T08:49:27.500 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : re2-1:20211101-3.el9.x86_64 12/31 2023-11-29T08:49:27.532 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 13/31 2023-11-29T08:49:27.573 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/31 2023-11-29T08:49:27.613 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/31 2023-11-29T08:49:27.642 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 16/31 2023-11-29T08:49:27.675 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 17/31 2023-11-29T08:49:28.011 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 18/31 2023-11-29T08:49:28.038 INFO:teuthology.orchestra.run.smithi027.stdout: Upgrading : librbd1-2:18.0.0-7483.g412bfade.el9.x86_64 19/31 2023-11-29T08:49:28.121 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: librbd1-2:18.0.0-7483.g412bfade.el9.x86_64 19/31 2023-11-29T08:49:28.151 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-rbd-2:18.0.0-7483.g412bfade.el9.x86_64 20/31 2023-11-29T08:49:28.187 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 21/31 2023-11-29T08:49:28.640 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 22/31 2023-11-29T08:49:28.673 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : librgw2-2:18.0.0-7483.g412bfade.el9.x86_64 23/31 2023-11-29T08:49:28.754 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: librgw2-2:18.0.0-7483.g412bfade.el9.x86_64 23/31 2023-11-29T08:49:28.833 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-rgw-2:18.0.0-7483.g412bfade.el9.x86_64 24/31 2023-11-29T08:49:28.876 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-ceph-common-2:18.0.0-7483.g412bfade.el9.x8 25/31 2023-11-29T08:49:31.011 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-common-2:18.0.0-7483.g412bfade.el9.x86_64 26/31 2023-11-29T08:49:31.048 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-common-2:18.0.0-7483.g412bfade.el9.x86_64 26/31 2023-11-29T08:49:31.834 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-common-2:18.0.0-7483.g412bfade.el9.x86_64 26/31 2023-11-29T08:49:31.876 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-base-2:18.0.0-7483.g412bfade.el9.x86_64 27/31 2023-11-29T08:49:31.961 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-base-2:18.0.0-7483.g412bfade.el9.x86_64 27/31 2023-11-29T08:49:31.961 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-11-29T08:49:31.961 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-11-29T08:49:31.961 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:49:32.002 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-selinux-2:18.0.0-7483.g412bfade.el9.x86_64 28/31 2023-11-29T08:49:32.285 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-selinux-2:18.0.0-7483.g412bfade.el9.x86_64 28/31 2023-11-29T08:49:32.286 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /sys 2023-11-29T08:49:32.286 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /proc 2023-11-29T08:49:32.286 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /mnt 2023-11-29T08:49:32.286 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /var/tmp 2023-11-29T08:49:32.286 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /home 2023-11-29T08:49:32.286 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /root 2023-11-29T08:49:32.286 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /tmp 2023-11-29T08:49:32.286 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:49:33.136 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-radosgw-2:18.0.0-7483.g412bfade.el9.x86_64 29/31 2023-11-29T08:49:33.159 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-7483.g412bfade.el9.x86_64 29/31 2023-11-29T08:49:33.160 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-29T08:49:33.160 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-11-29T08:49:33.160 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-29T08:49:33.160 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-29T08:49:33.160 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:49:33.161 INFO:teuthology.orchestra.run.smithi139.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 30/31 2023-11-29T08:49:33.230 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 30/31 2023-11-29T08:49:33.230 INFO:teuthology.orchestra.run.smithi139.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 31/31 2023-11-29T08:49:34.348 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 31/31 2023-11-29T08:49:34.348 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-base-2:18.0.0-7483.g412bfade.el9.x86_64 1/31 2023-11-29T08:49:34.348 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-common-2:18.0.0-7483.g412bfade.el9.x86_64 2/31 2023-11-29T08:49:34.348 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-radosgw-2:18.0.0-7483.g412bfade.el9.x86_64 3/31 2023-11-29T08:49:34.348 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-selinux-2:18.0.0-7483.g412bfade.el9.x86_64 4/31 2023-11-29T08:49:34.348 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libcephfs2-2:18.0.0-7483.g412bfade.el9.x86_64 5/31 2023-11-29T08:49:34.348 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libradosstriper1-2:18.0.0-7483.g412bfade.el9.x86_6 6/31 2023-11-29T08:49:34.348 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librgw2-2:18.0.0-7483.g412bfade.el9.x86_64 7/31 2023-11-29T08:49:34.349 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-ceph-argparse-2:18.0.0-7483.g412bfade.el9. 8/31 2023-11-29T08:49:34.349 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-ceph-common-2:18.0.0-7483.g412bfade.el9.x8 9/31 2023-11-29T08:49:34.349 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cephfs-2:18.0.0-7483.g412bfade.el9.x86_64 10/31 2023-11-29T08:49:34.349 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-rados-2:18.0.0-7483.g412bfade.el9.x86_64 11/31 2023-11-29T08:49:34.349 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-rbd-2:18.0.0-7483.g412bfade.el9.x86_64 12/31 2023-11-29T08:49:34.349 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-rgw-2:18.0.0-7483.g412bfade.el9.x86_64 13/31 2023-11-29T08:49:34.349 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/31 2023-11-29T08:49:34.349 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/31 2023-11-29T08:49:34.349 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/31 2023-11-29T08:49:34.349 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/31 2023-11-29T08:49:34.349 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/31 2023-11-29T08:49:34.349 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/31 2023-11-29T08:49:34.349 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 20/31 2023-11-29T08:49:34.349 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 21/31 2023-11-29T08:49:34.349 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 22/31 2023-11-29T08:49:34.349 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 23/31 2023-11-29T08:49:34.350 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 24/31 2023-11-29T08:49:34.350 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 25/31 2023-11-29T08:49:34.350 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : re2-1:20211101-3.el9.x86_64 26/31 2023-11-29T08:49:34.350 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 27/31 2023-11-29T08:49:34.350 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librados2-2:18.0.0-7483.g412bfade.el9.x86_64 28/31 2023-11-29T08:49:34.350 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 29/31 2023-11-29T08:49:34.350 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librbd1-2:18.0.0-7483.g412bfade.el9.x86_64 30/31 2023-11-29T08:49:35.401 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 31/31 2023-11-29T08:49:35.401 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:49:35.401 INFO:teuthology.orchestra.run.smithi139.stdout:Upgraded: 2023-11-29T08:49:35.401 INFO:teuthology.orchestra.run.smithi139.stdout: librados2-2:18.0.0-7483.g412bfade.el9.x86_64 2023-11-29T08:49:35.402 INFO:teuthology.orchestra.run.smithi139.stdout: librbd1-2:18.0.0-7483.g412bfade.el9.x86_64 2023-11-29T08:49:35.402 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2023-11-29T08:49:35.402 INFO:teuthology.orchestra.run.smithi139.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-11-29T08:49:35.402 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-base-2:18.0.0-7483.g412bfade.el9.x86_64 2023-11-29T08:49:35.402 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-common-2:18.0.0-7483.g412bfade.el9.x86_64 2023-11-29T08:49:35.402 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-radosgw-2:18.0.0-7483.g412bfade.el9.x86_64 2023-11-29T08:49:35.402 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-selinux-2:18.0.0-7483.g412bfade.el9.x86_64 2023-11-29T08:49:35.402 INFO:teuthology.orchestra.run.smithi139.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-11-29T08:49:35.402 INFO:teuthology.orchestra.run.smithi139.stdout: libarrow-9.0.0-9.el9.x86_64 2023-11-29T08:49:35.402 INFO:teuthology.orchestra.run.smithi139.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-11-29T08:49:35.402 INFO:teuthology.orchestra.run.smithi139.stdout: libcephfs2-2:18.0.0-7483.g412bfade.el9.x86_64 2023-11-29T08:49:35.402 INFO:teuthology.orchestra.run.smithi139.stdout: liboath-2.6.7-2.el9.x86_64 2023-11-29T08:49:35.402 INFO:teuthology.orchestra.run.smithi139.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-11-29T08:49:35.403 INFO:teuthology.orchestra.run.smithi139.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-11-29T08:49:35.403 INFO:teuthology.orchestra.run.smithi139.stdout: libradosstriper1-2:18.0.0-7483.g412bfade.el9.x86_64 2023-11-29T08:49:35.403 INFO:teuthology.orchestra.run.smithi139.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-11-29T08:49:35.403 INFO:teuthology.orchestra.run.smithi139.stdout: librgw2-2:18.0.0-7483.g412bfade.el9.x86_64 2023-11-29T08:49:35.403 INFO:teuthology.orchestra.run.smithi139.stdout: libunwind-1.6.2-1.el9.x86_64 2023-11-29T08:49:35.403 INFO:teuthology.orchestra.run.smithi139.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-11-29T08:49:35.403 INFO:teuthology.orchestra.run.smithi139.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-11-29T08:49:35.403 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ceph-argparse-2:18.0.0-7483.g412bfade.el9.x86_64 2023-11-29T08:49:35.403 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ceph-common-2:18.0.0-7483.g412bfade.el9.x86_64 2023-11-29T08:49:35.403 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cephfs-2:18.0.0-7483.g412bfade.el9.x86_64 2023-11-29T08:49:35.403 INFO:teuthology.orchestra.run.smithi139.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-11-29T08:49:35.403 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rados-2:18.0.0-7483.g412bfade.el9.x86_64 2023-11-29T08:49:35.403 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rbd-2:18.0.0-7483.g412bfade.el9.x86_64 2023-11-29T08:49:35.403 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rgw-2:18.0.0-7483.g412bfade.el9.x86_64 2023-11-29T08:49:35.403 INFO:teuthology.orchestra.run.smithi139.stdout: re2-1:20211101-3.el9.x86_64 2023-11-29T08:49:35.403 INFO:teuthology.orchestra.run.smithi139.stdout: thrift-0.15.0-2.el9.x86_64 2023-11-29T08:49:35.403 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:49:35.404 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2023-11-29T08:49:35.725 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install ceph-test 2023-11-29T08:49:36.299 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:00:50 ago on Wed 29 Nov 2023 08:48:46 AM UTC. 2023-11-29T08:49:36.450 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2023-11-29T08:49:36.451 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2023-11-29T08:49:36.451 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repository Size 2023-11-29T08:49:36.451 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2023-11-29T08:49:36.451 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2023-11-29T08:49:36.451 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-test x86_64 2:18.0.0-7483.g412bfade.el9 ceph 118 M 2023-11-29T08:49:36.451 INFO:teuthology.orchestra.run.smithi139.stdout:Installing dependencies: 2023-11-29T08:49:36.451 INFO:teuthology.orchestra.run.smithi139.stdout: cryptopp x86_64 8.6.0-1.el9 epel 1.3 M 2023-11-29T08:49:36.451 INFO:teuthology.orchestra.run.smithi139.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-11-29T08:49:36.452 INFO:teuthology.orchestra.run.smithi139.stdout: libasan x86_64 11.4.1-2.3.el9 CentOS-AppStream 418 k 2023-11-29T08:49:36.452 INFO:teuthology.orchestra.run.smithi139.stdout: libcephsqlite x86_64 2:18.0.0-7483.g412bfade.el9 ceph 158 k 2023-11-29T08:49:36.452 INFO:teuthology.orchestra.run.smithi139.stdout: libubsan x86_64 11.4.1-2.3.el9 CentOS-AppStream 186 k 2023-11-29T08:49:36.452 INFO:teuthology.orchestra.run.smithi139.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-11-29T08:49:36.452 INFO:teuthology.orchestra.run.smithi139.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-11-29T08:49:36.452 INFO:teuthology.orchestra.run.smithi139.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-11-29T08:49:36.452 INFO:teuthology.orchestra.run.smithi139.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2023-11-29T08:49:36.452 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:49:36.452 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2023-11-29T08:49:36.452 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2023-11-29T08:49:36.452 INFO:teuthology.orchestra.run.smithi139.stdout:Install 10 Packages 2023-11-29T08:49:36.452 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:49:36.453 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 121 M 2023-11-29T08:49:36.453 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 1.1 G 2023-11-29T08:49:36.453 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2023-11-29T08:49:36.676 INFO:teuthology.orchestra.run.smithi139.stdout:(1/10): jq-1.6-16.el9.x86_64.rpm 1.3 MB/s | 186 kB 00:00 2023-11-29T08:49:36.776 INFO:teuthology.orchestra.run.smithi139.stdout:(2/10): libasan-11.4.1-2.3.el9.x86_64.rpm 5.3 MB/s | 418 kB 00:00 2023-11-29T08:49:36.810 INFO:teuthology.orchestra.run.smithi139.stdout:(3/10): libubsan-11.4.1-2.3.el9.x86_64.rpm 5.5 MB/s | 186 kB 00:00 2023-11-29T08:49:36.844 INFO:teuthology.orchestra.run.smithi139.stdout:(4/10): oniguruma-6.9.6-1.el9.5.x86_64.rpm 6.3 MB/s | 217 kB 00:00 2023-11-29T08:49:36.885 INFO:teuthology.orchestra.run.smithi139.stdout:(5/10): socat-1.7.4.1-5.el9.x86_64.rpm 7.1 MB/s | 300 kB 00:00 2023-11-29T08:49:36.919 INFO:teuthology.orchestra.run.smithi139.stdout:(6/10): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.8 MB/s | 63 kB 00:00 2023-11-29T08:49:37.211 INFO:teuthology.orchestra.run.smithi139.stdout:(7/10): libcephsqlite-18.0.0-7483.g412bfade.el9 233 kB/s | 158 kB 00:00 2023-11-29T08:49:37.861 INFO:teuthology.orchestra.run.smithi139.stdout:(8/10): yaml-cpp-0.6.3-5.el9.x86_64.rpm 187 kB/s | 122 kB 00:00 2023-11-29T08:49:37.894 INFO:teuthology.orchestra.run.smithi139.stdout:(9/10): cryptopp-8.6.0-1.el9.x86_64.rpm 1.3 MB/s | 1.3 MB 00:00 2023-11-29T08:49:41.873 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-selinux-2:18.0.0-7483.g412bfade.el9.x86_64 28/31 2023-11-29T08:49:41.873 INFO:teuthology.orchestra.run.smithi027.stdout:skipping the directory /sys 2023-11-29T08:49:41.874 INFO:teuthology.orchestra.run.smithi027.stdout:skipping the directory /proc 2023-11-29T08:49:41.874 INFO:teuthology.orchestra.run.smithi027.stdout:skipping the directory /mnt 2023-11-29T08:49:41.874 INFO:teuthology.orchestra.run.smithi027.stdout:skipping the directory /var/tmp 2023-11-29T08:49:41.874 INFO:teuthology.orchestra.run.smithi027.stdout:skipping the directory /home 2023-11-29T08:49:41.874 INFO:teuthology.orchestra.run.smithi027.stdout:skipping the directory /root 2023-11-29T08:49:41.874 INFO:teuthology.orchestra.run.smithi027.stdout:skipping the directory /tmp 2023-11-29T08:49:41.874 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:49:42.737 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-radosgw-2:18.0.0-7483.g412bfade.el9.x86_64 29/31 2023-11-29T08:49:42.762 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-7483.g412bfade.el9.x86_64 29/31 2023-11-29T08:49:42.762 INFO:teuthology.orchestra.run.smithi027.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-29T08:49:42.762 INFO:teuthology.orchestra.run.smithi027.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-11-29T08:49:42.762 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-29T08:49:42.762 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-29T08:49:42.763 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:49:42.764 INFO:teuthology.orchestra.run.smithi027.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 30/31 2023-11-29T08:49:42.848 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 30/31 2023-11-29T08:49:42.848 INFO:teuthology.orchestra.run.smithi027.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 31/31 2023-11-29T08:49:43.942 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 31/31 2023-11-29T08:49:43.942 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-base-2:18.0.0-7483.g412bfade.el9.x86_64 1/31 2023-11-29T08:49:43.943 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-common-2:18.0.0-7483.g412bfade.el9.x86_64 2/31 2023-11-29T08:49:43.943 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-radosgw-2:18.0.0-7483.g412bfade.el9.x86_64 3/31 2023-11-29T08:49:43.943 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-selinux-2:18.0.0-7483.g412bfade.el9.x86_64 4/31 2023-11-29T08:49:43.943 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libcephfs2-2:18.0.0-7483.g412bfade.el9.x86_64 5/31 2023-11-29T08:49:43.943 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libradosstriper1-2:18.0.0-7483.g412bfade.el9.x86_6 6/31 2023-11-29T08:49:43.943 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : librgw2-2:18.0.0-7483.g412bfade.el9.x86_64 7/31 2023-11-29T08:49:43.943 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-ceph-argparse-2:18.0.0-7483.g412bfade.el9. 8/31 2023-11-29T08:49:43.943 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-ceph-common-2:18.0.0-7483.g412bfade.el9.x8 9/31 2023-11-29T08:49:43.943 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-cephfs-2:18.0.0-7483.g412bfade.el9.x86_64 10/31 2023-11-29T08:49:43.943 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-rados-2:18.0.0-7483.g412bfade.el9.x86_64 11/31 2023-11-29T08:49:43.944 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-rbd-2:18.0.0-7483.g412bfade.el9.x86_64 12/31 2023-11-29T08:49:43.944 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-rgw-2:18.0.0-7483.g412bfade.el9.x86_64 13/31 2023-11-29T08:49:43.944 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/31 2023-11-29T08:49:43.944 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/31 2023-11-29T08:49:43.944 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/31 2023-11-29T08:49:43.944 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/31 2023-11-29T08:49:43.944 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/31 2023-11-29T08:49:43.944 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/31 2023-11-29T08:49:43.944 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 20/31 2023-11-29T08:49:43.944 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 21/31 2023-11-29T08:49:43.944 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 22/31 2023-11-29T08:49:43.944 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 23/31 2023-11-29T08:49:43.945 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 24/31 2023-11-29T08:49:43.945 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 25/31 2023-11-29T08:49:43.945 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : re2-1:20211101-3.el9.x86_64 26/31 2023-11-29T08:49:43.945 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 27/31 2023-11-29T08:49:43.945 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : librados2-2:18.0.0-7483.g412bfade.el9.x86_64 28/31 2023-11-29T08:49:43.945 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 29/31 2023-11-29T08:49:43.945 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : librbd1-2:18.0.0-7483.g412bfade.el9.x86_64 30/31 2023-11-29T08:49:44.964 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 31/31 2023-11-29T08:49:44.964 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:49:44.964 INFO:teuthology.orchestra.run.smithi027.stdout:Upgraded: 2023-11-29T08:49:44.964 INFO:teuthology.orchestra.run.smithi027.stdout: librados2-2:18.0.0-7483.g412bfade.el9.x86_64 2023-11-29T08:49:44.964 INFO:teuthology.orchestra.run.smithi027.stdout: librbd1-2:18.0.0-7483.g412bfade.el9.x86_64 2023-11-29T08:49:44.964 INFO:teuthology.orchestra.run.smithi027.stdout:Installed: 2023-11-29T08:49:44.964 INFO:teuthology.orchestra.run.smithi027.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-11-29T08:49:44.964 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-base-2:18.0.0-7483.g412bfade.el9.x86_64 2023-11-29T08:49:44.965 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-common-2:18.0.0-7483.g412bfade.el9.x86_64 2023-11-29T08:49:44.965 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-radosgw-2:18.0.0-7483.g412bfade.el9.x86_64 2023-11-29T08:49:44.965 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-selinux-2:18.0.0-7483.g412bfade.el9.x86_64 2023-11-29T08:49:44.965 INFO:teuthology.orchestra.run.smithi027.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-11-29T08:49:44.965 INFO:teuthology.orchestra.run.smithi027.stdout: libarrow-9.0.0-9.el9.x86_64 2023-11-29T08:49:44.965 INFO:teuthology.orchestra.run.smithi027.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-11-29T08:49:44.965 INFO:teuthology.orchestra.run.smithi027.stdout: libcephfs2-2:18.0.0-7483.g412bfade.el9.x86_64 2023-11-29T08:49:44.965 INFO:teuthology.orchestra.run.smithi027.stdout: liboath-2.6.7-2.el9.x86_64 2023-11-29T08:49:44.965 INFO:teuthology.orchestra.run.smithi027.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-11-29T08:49:44.965 INFO:teuthology.orchestra.run.smithi027.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-11-29T08:49:44.965 INFO:teuthology.orchestra.run.smithi027.stdout: libradosstriper1-2:18.0.0-7483.g412bfade.el9.x86_64 2023-11-29T08:49:44.965 INFO:teuthology.orchestra.run.smithi027.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-11-29T08:49:44.966 INFO:teuthology.orchestra.run.smithi027.stdout: librgw2-2:18.0.0-7483.g412bfade.el9.x86_64 2023-11-29T08:49:44.966 INFO:teuthology.orchestra.run.smithi027.stdout: libunwind-1.6.2-1.el9.x86_64 2023-11-29T08:49:44.966 INFO:teuthology.orchestra.run.smithi027.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-11-29T08:49:44.966 INFO:teuthology.orchestra.run.smithi027.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-11-29T08:49:44.966 INFO:teuthology.orchestra.run.smithi027.stdout: python3-ceph-argparse-2:18.0.0-7483.g412bfade.el9.x86_64 2023-11-29T08:49:44.966 INFO:teuthology.orchestra.run.smithi027.stdout: python3-ceph-common-2:18.0.0-7483.g412bfade.el9.x86_64 2023-11-29T08:49:44.966 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cephfs-2:18.0.0-7483.g412bfade.el9.x86_64 2023-11-29T08:49:44.966 INFO:teuthology.orchestra.run.smithi027.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-11-29T08:49:44.966 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rados-2:18.0.0-7483.g412bfade.el9.x86_64 2023-11-29T08:49:44.966 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rbd-2:18.0.0-7483.g412bfade.el9.x86_64 2023-11-29T08:49:44.967 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rgw-2:18.0.0-7483.g412bfade.el9.x86_64 2023-11-29T08:49:44.967 INFO:teuthology.orchestra.run.smithi027.stdout: re2-1:20211101-3.el9.x86_64 2023-11-29T08:49:44.967 INFO:teuthology.orchestra.run.smithi027.stdout: thrift-0.15.0-2.el9.x86_64 2023-11-29T08:49:44.967 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:49:44.967 INFO:teuthology.orchestra.run.smithi027.stdout:Complete! 2023-11-29T08:49:45.302 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum -y install ceph-test 2023-11-29T08:49:45.925 INFO:teuthology.orchestra.run.smithi027.stdout:Last metadata expiration check: 0:00:58 ago on Wed 29 Nov 2023 08:48:47 AM UTC. 2023-11-29T08:49:46.080 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. 2023-11-29T08:49:46.081 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2023-11-29T08:49:46.082 INFO:teuthology.orchestra.run.smithi027.stdout: Package Arch Version Repository Size 2023-11-29T08:49:46.082 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2023-11-29T08:49:46.082 INFO:teuthology.orchestra.run.smithi027.stdout:Installing: 2023-11-29T08:49:46.082 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-test x86_64 2:18.0.0-7483.g412bfade.el9 ceph 118 M 2023-11-29T08:49:46.082 INFO:teuthology.orchestra.run.smithi027.stdout:Installing dependencies: 2023-11-29T08:49:46.083 INFO:teuthology.orchestra.run.smithi027.stdout: cryptopp x86_64 8.6.0-1.el9 epel 1.3 M 2023-11-29T08:49:46.083 INFO:teuthology.orchestra.run.smithi027.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-11-29T08:49:46.083 INFO:teuthology.orchestra.run.smithi027.stdout: libasan x86_64 11.4.1-2.3.el9 CentOS-AppStream 418 k 2023-11-29T08:49:46.083 INFO:teuthology.orchestra.run.smithi027.stdout: libcephsqlite x86_64 2:18.0.0-7483.g412bfade.el9 ceph 158 k 2023-11-29T08:49:46.083 INFO:teuthology.orchestra.run.smithi027.stdout: libubsan x86_64 11.4.1-2.3.el9 CentOS-AppStream 186 k 2023-11-29T08:49:46.083 INFO:teuthology.orchestra.run.smithi027.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-11-29T08:49:46.083 INFO:teuthology.orchestra.run.smithi027.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-11-29T08:49:46.083 INFO:teuthology.orchestra.run.smithi027.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-11-29T08:49:46.083 INFO:teuthology.orchestra.run.smithi027.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2023-11-29T08:49:46.083 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:49:46.083 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction Summary 2023-11-29T08:49:46.084 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2023-11-29T08:49:46.084 INFO:teuthology.orchestra.run.smithi027.stdout:Install 10 Packages 2023-11-29T08:49:46.084 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:49:46.084 INFO:teuthology.orchestra.run.smithi027.stdout:Total download size: 121 M 2023-11-29T08:49:46.085 INFO:teuthology.orchestra.run.smithi027.stdout:Installed size: 1.1 G 2023-11-29T08:49:46.085 INFO:teuthology.orchestra.run.smithi027.stdout:Downloading Packages: 2023-11-29T08:49:46.327 INFO:teuthology.orchestra.run.smithi027.stdout:(1/10): jq-1.6-16.el9.x86_64.rpm 1.1 MB/s | 186 kB 00:00 2023-11-29T08:49:46.386 INFO:teuthology.orchestra.run.smithi027.stdout:(2/10): libasan-11.4.1-2.3.el9.x86_64.rpm 7.0 MB/s | 418 kB 00:00 2023-11-29T08:49:46.427 INFO:teuthology.orchestra.run.smithi027.stdout:(3/10): libubsan-11.4.1-2.3.el9.x86_64.rpm 4.5 MB/s | 186 kB 00:00 2023-11-29T08:49:46.461 INFO:teuthology.orchestra.run.smithi027.stdout:(4/10): oniguruma-6.9.6-1.el9.5.x86_64.rpm 6.4 MB/s | 217 kB 00:00 2023-11-29T08:49:46.503 INFO:teuthology.orchestra.run.smithi027.stdout:(5/10): socat-1.7.4.1-5.el9.x86_64.rpm 7.1 MB/s | 300 kB 00:00 2023-11-29T08:49:46.528 INFO:teuthology.orchestra.run.smithi027.stdout:(6/10): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.4 MB/s | 63 kB 00:00 2023-11-29T08:49:46.795 INFO:teuthology.orchestra.run.smithi027.stdout:(7/10): cryptopp-8.6.0-1.el9.x86_64.rpm 4.7 MB/s | 1.3 MB 00:00 2023-11-29T08:49:46.845 INFO:teuthology.orchestra.run.smithi027.stdout:(8/10): yaml-cpp-0.6.3-5.el9.x86_64.rpm 2.4 MB/s | 122 kB 00:00 2023-11-29T08:49:47.079 INFO:teuthology.orchestra.run.smithi027.stdout:(9/10): libcephsqlite-18.0.0-7483.g412bfade.el9 173 kB/s | 158 kB 00:00 2023-11-29T08:51:38.986 INFO:teuthology.orchestra.run.smithi139.stdout:(10/10): ceph-test-18.0.0-7483.g412bfade.el9.x8 984 kB/s | 118 MB 02:02 2023-11-29T08:51:38.990 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2023-11-29T08:51:38.990 INFO:teuthology.orchestra.run.smithi139.stdout:Total 1.0 MB/s | 121 MB 02:02 2023-11-29T08:51:38.990 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2023-11-29T08:51:39.009 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2023-11-29T08:51:39.009 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2023-11-29T08:51:39.836 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2023-11-29T08:51:39.836 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2023-11-29T08:51:40.993 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2023-11-29T08:51:41.084 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/10 2023-11-29T08:51:41.118 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : cryptopp-8.6.0-1.el9.x86_64 2/10 2023-11-29T08:51:41.161 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/10 2023-11-29T08:51:41.204 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 4/10 2023-11-29T08:51:41.236 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 5/10 2023-11-29T08:51:41.268 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : jq-1.6-16.el9.x86_64 6/10 2023-11-29T08:51:41.298 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libubsan-11.4.1-2.3.el9.x86_64 7/10 2023-11-29T08:51:41.346 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libasan-11.4.1-2.3.el9.x86_64 8/10 2023-11-29T08:51:41.373 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libcephsqlite-2:18.0.0-7483.g412bfade.el9.x86_64 9/10 2023-11-29T08:51:52.793 INFO:teuthology.orchestra.run.smithi027.stdout:(10/10): ceph-test-18.0.0-7483.g412bfade.el9.x8 951 kB/s | 118 MB 02:06 2023-11-29T08:51:52.796 INFO:teuthology.orchestra.run.smithi027.stdout:-------------------------------------------------------------------------------- 2023-11-29T08:51:52.796 INFO:teuthology.orchestra.run.smithi027.stdout:Total 974 kB/s | 121 MB 02:06 2023-11-29T08:51:52.796 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction check 2023-11-29T08:51:52.816 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction check succeeded. 2023-11-29T08:51:52.817 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction test 2023-11-29T08:51:53.665 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction test succeeded. 2023-11-29T08:51:53.666 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction 2023-11-29T08:51:54.843 INFO:teuthology.orchestra.run.smithi027.stdout: Preparing : 1/1 2023-11-29T08:51:54.935 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/10 2023-11-29T08:51:54.967 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : cryptopp-8.6.0-1.el9.x86_64 2/10 2023-11-29T08:51:55.010 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/10 2023-11-29T08:51:55.044 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 4/10 2023-11-29T08:51:55.084 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 5/10 2023-11-29T08:51:55.116 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : jq-1.6-16.el9.x86_64 6/10 2023-11-29T08:51:55.148 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libubsan-11.4.1-2.3.el9.x86_64 7/10 2023-11-29T08:51:55.187 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libasan-11.4.1-2.3.el9.x86_64 8/10 2023-11-29T08:51:55.213 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libcephsqlite-2:18.0.0-7483.g412bfade.el9.x86_64 9/10 2023-11-29T08:51:57.889 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: libcephsqlite-2:18.0.0-7483.g412bfade.el9.x86_64 9/10 2023-11-29T08:51:57.980 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-test-2:18.0.0-7483.g412bfade.el9.x86_64 10/10 2023-11-29T08:52:05.816 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-test-2:18.0.0-7483.g412bfade.el9.x86_64 10/10 2023-11-29T08:52:05.816 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-test-2:18.0.0-7483.g412bfade.el9.x86_64 1/10 2023-11-29T08:52:05.816 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libcephsqlite-2:18.0.0-7483.g412bfade.el9.x86_64 2/10 2023-11-29T08:52:05.816 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : jq-1.6-16.el9.x86_64 3/10 2023-11-29T08:52:05.817 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libasan-11.4.1-2.3.el9.x86_64 4/10 2023-11-29T08:52:05.817 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libubsan-11.4.1-2.3.el9.x86_64 5/10 2023-11-29T08:52:05.817 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 6/10 2023-11-29T08:52:05.817 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 7/10 2023-11-29T08:52:05.817 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 8/10 2023-11-29T08:52:05.817 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : cryptopp-8.6.0-1.el9.x86_64 9/10 2023-11-29T08:52:06.274 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 10/10 2023-11-29T08:52:06.275 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:52:06.275 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2023-11-29T08:52:06.275 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-test-2:18.0.0-7483.g412bfade.el9.x86_64 2023-11-29T08:52:06.276 INFO:teuthology.orchestra.run.smithi139.stdout: cryptopp-8.6.0-1.el9.x86_64 2023-11-29T08:52:06.276 INFO:teuthology.orchestra.run.smithi139.stdout: jq-1.6-16.el9.x86_64 2023-11-29T08:52:06.276 INFO:teuthology.orchestra.run.smithi139.stdout: libasan-11.4.1-2.3.el9.x86_64 2023-11-29T08:52:06.276 INFO:teuthology.orchestra.run.smithi139.stdout: libcephsqlite-2:18.0.0-7483.g412bfade.el9.x86_64 2023-11-29T08:52:06.277 INFO:teuthology.orchestra.run.smithi139.stdout: libubsan-11.4.1-2.3.el9.x86_64 2023-11-29T08:52:06.277 INFO:teuthology.orchestra.run.smithi139.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-11-29T08:52:06.277 INFO:teuthology.orchestra.run.smithi139.stdout: socat-1.7.4.1-5.el9.x86_64 2023-11-29T08:52:06.277 INFO:teuthology.orchestra.run.smithi139.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-11-29T08:52:06.278 INFO:teuthology.orchestra.run.smithi139.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2023-11-29T08:52:06.278 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:52:06.278 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2023-11-29T08:52:06.626 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install ceph 2023-11-29T08:52:07.205 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:03:21 ago on Wed 29 Nov 2023 08:48:46 AM UTC. 2023-11-29T08:52:07.351 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2023-11-29T08:52:07.353 INFO:teuthology.orchestra.run.smithi139.stdout:========================================================================================= 2023-11-29T08:52:07.354 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repository Size 2023-11-29T08:52:07.354 INFO:teuthology.orchestra.run.smithi139.stdout:========================================================================================= 2023-11-29T08:52:07.354 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2023-11-29T08:52:07.354 INFO:teuthology.orchestra.run.smithi139.stdout: ceph x86_64 2:18.0.0-7483.g412bfade.el9 ceph 6.5 k 2023-11-29T08:52:07.354 INFO:teuthology.orchestra.run.smithi139.stdout:Installing dependencies: 2023-11-29T08:52:07.354 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mds x86_64 2:18.0.0-7483.g412bfade.el9 ceph 2.0 M 2023-11-29T08:52:07.354 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr x86_64 2:18.0.0-7483.g412bfade.el9 ceph 1.5 M 2023-11-29T08:52:07.355 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-modules-core noarch 2:18.0.0-7483.g412bfade.el9 ceph-noarch 243 k 2023-11-29T08:52:07.355 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mon x86_64 2:18.0.0-7483.g412bfade.el9 ceph 8.9 M 2023-11-29T08:52:07.355 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-osd x86_64 2:18.0.0-7483.g412bfade.el9 ceph 117 M 2023-11-29T08:52:07.355 INFO:teuthology.orchestra.run.smithi139.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-11-29T08:52:07.355 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-11-29T08:52:07.355 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-11-29T08:52:07.355 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-11-29T08:52:07.355 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-11-29T08:52:07.355 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-11-29T08:52:07.355 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-11-29T08:52:07.356 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-11-29T08:52:07.356 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-11-29T08:52:07.356 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-11-29T08:52:07.356 INFO:teuthology.orchestra.run.smithi139.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-11-29T08:52:07.356 INFO:teuthology.orchestra.run.smithi139.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-11-29T08:52:07.356 INFO:teuthology.orchestra.run.smithi139.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-11-29T08:52:07.356 INFO:teuthology.orchestra.run.smithi139.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-11-29T08:52:07.356 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-11-29T08:52:07.356 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-11-29T08:52:07.356 INFO:teuthology.orchestra.run.smithi139.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-11-29T08:52:07.357 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-11-29T08:52:07.357 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-11-29T08:52:07.357 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-11-29T08:52:07.357 INFO:teuthology.orchestra.run.smithi139.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-11-29T08:52:07.357 INFO:teuthology.orchestra.run.smithi139.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-11-29T08:52:07.357 INFO:teuthology.orchestra.run.smithi139.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-11-29T08:52:07.357 INFO:teuthology.orchestra.run.smithi139.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-11-29T08:52:07.357 INFO:teuthology.orchestra.run.smithi139.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-11-29T08:52:07.357 INFO:teuthology.orchestra.run.smithi139.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-11-29T08:52:07.357 INFO:teuthology.orchestra.run.smithi139.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-11-29T08:52:07.358 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:52:07.358 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2023-11-29T08:52:07.358 INFO:teuthology.orchestra.run.smithi139.stdout:========================================================================================= 2023-11-29T08:52:07.358 INFO:teuthology.orchestra.run.smithi139.stdout:Install 33 Packages 2023-11-29T08:52:07.358 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:52:07.359 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 134 M 2023-11-29T08:52:07.359 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 1.4 G 2023-11-29T08:52:07.359 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2023-11-29T08:52:07.944 INFO:teuthology.orchestra.run.smithi139.stdout:(1/33): ceph-18.0.0-7483.g412bfade.el9.x86_64.r 15 kB/s | 6.5 kB 00:00 2023-11-29T08:52:09.528 INFO:teuthology.orchestra.run.smithi139.stdout:(2/33): ceph-mgr-18.0.0-7483.g412bfade.el9.x86_ 739 kB/s | 1.5 MB 00:02 2023-11-29T08:52:12.406 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: libcephsqlite-2:18.0.0-7483.g412bfade.el9.x86_64 9/10 2023-11-29T08:52:12.481 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-test-2:18.0.0-7483.g412bfade.el9.x86_64 10/10 2023-11-29T08:52:13.885 INFO:teuthology.orchestra.run.smithi139.stdout:(3/33): ceph-mds-18.0.0-7483.g412bfade.el9.x86_ 321 kB/s | 2.0 MB 00:06 2023-11-29T08:52:14.502 INFO:teuthology.orchestra.run.smithi139.stdout:(4/33): ceph-mgr-modules-core-18.0.0-7483.g412b 394 kB/s | 243 kB 00:00 2023-11-29T08:52:14.611 INFO:teuthology.orchestra.run.smithi139.stdout:(5/33): python3-mako-1.1.4-6.el9.noarch.rpm 1.3 MB/s | 144 kB 00:00 2023-11-29T08:52:14.636 INFO:teuthology.orchestra.run.smithi139.stdout:(6/33): python3-markupsafe-1.1.1-12.el9.x86_64. 1.2 MB/s | 32 kB 00:00 2023-11-29T08:52:14.661 INFO:teuthology.orchestra.run.smithi139.stdout:(7/33): python3-pytz-2021.1-5.el9.noarch.rpm 1.9 MB/s | 47 kB 00:00 2023-11-29T08:52:14.703 INFO:teuthology.orchestra.run.smithi139.stdout:(8/33): python3-toml-0.10.2-6.el9.noarch.rpm 927 kB/s | 39 kB 00:00 2023-11-29T08:52:14.753 INFO:teuthology.orchestra.run.smithi139.stdout:(9/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2023-11-29T08:52:14.820 INFO:teuthology.orchestra.run.smithi139.stdout:(10/33): python3-cryptography-36.0.1-4.el9.x86_ 17 MB/s | 1.1 MB 00:00 2023-11-29T08:52:14.854 INFO:teuthology.orchestra.run.smithi139.stdout:(11/33): python3-ply-3.11-14.el9.noarch.rpm 3.0 MB/s | 103 kB 00:00 2023-11-29T08:52:14.954 INFO:teuthology.orchestra.run.smithi139.stdout:(12/33): python3-pycparser-2.20-6.el9.noarch.rp 1.2 MB/s | 124 kB 00:00 2023-11-29T08:52:14.996 INFO:teuthology.orchestra.run.smithi139.stdout:(13/33): python3-requests-2.25.1-7.el9.noarch.r 2.6 MB/s | 113 kB 00:00 2023-11-29T08:52:15.046 INFO:teuthology.orchestra.run.smithi139.stdout:(14/33): python3-urllib3-1.26.5-4.el9.noarch.rp 3.7 MB/s | 187 kB 00:00 2023-11-29T08:52:15.596 INFO:teuthology.orchestra.run.smithi139.stdout:(15/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 79 kB/s | 43 kB 00:00 2023-11-29T08:52:15.880 INFO:teuthology.orchestra.run.smithi139.stdout:(16/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 606 kB/s | 172 kB 00:00 2023-11-29T08:52:16.064 INFO:teuthology.orchestra.run.smithi139.stdout:(17/33): python3-cherrypy-18.6.1-2.el9.noarch.r 1.9 MB/s | 358 kB 00:00 2023-11-29T08:52:16.164 INFO:teuthology.orchestra.run.smithi139.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 107 kB/s | 11 kB 00:00 2023-11-29T08:52:16.264 INFO:teuthology.orchestra.run.smithi139.stdout:(19/33): python3-jaraco-classes-3.2.1-5.el9.noa 177 kB/s | 18 kB 00:00 2023-11-29T08:52:16.364 INFO:teuthology.orchestra.run.smithi139.stdout:(20/33): python3-jaraco-collections-3.0.0-8.el9 232 kB/s | 23 kB 00:00 2023-11-29T08:52:16.473 INFO:teuthology.orchestra.run.smithi139.stdout:(21/33): python3-jaraco-functools-3.5.0-2.el9.n 179 kB/s | 19 kB 00:00 2023-11-29T08:52:16.573 INFO:teuthology.orchestra.run.smithi139.stdout:(22/33): python3-jaraco-text-3.2.0-6.el9.noarch 197 kB/s | 20 kB 00:00 2023-11-29T08:52:16.674 INFO:teuthology.orchestra.run.smithi139.stdout:(23/33): python3-logutils-0.3.5-21.el9.noarch.r 463 kB/s | 46 kB 00:00 2023-11-29T08:52:16.782 INFO:teuthology.orchestra.run.smithi139.stdout:(24/33): python3-more-itertools-8.12.0-2.el9.no 728 kB/s | 79 kB 00:00 2023-11-29T08:52:16.891 INFO:teuthology.orchestra.run.smithi139.stdout:(25/33): python3-pecan-1.4.2-3.el9.noarch.rpm 2.5 MB/s | 272 kB 00:00 2023-11-29T08:52:17.000 INFO:teuthology.orchestra.run.smithi139.stdout:(26/33): python3-portend-3.1.0-2.el9.noarch.rpm 151 kB/s | 16 kB 00:00 2023-11-29T08:52:17.108 INFO:teuthology.orchestra.run.smithi139.stdout:(27/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 831 kB/s | 90 kB 00:00 2023-11-29T08:52:17.217 INFO:teuthology.orchestra.run.smithi139.stdout:(28/33): python3-tempora-5.0.0-2.el9.noarch.rpm 331 kB/s | 36 kB 00:00 2023-11-29T08:52:17.325 INFO:teuthology.orchestra.run.smithi139.stdout:(29/33): python3-webob-1.8.7-6.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2023-11-29T08:52:17.442 INFO:teuthology.orchestra.run.smithi139.stdout:(30/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.6 MB/s | 427 kB 00:00 2023-11-29T08:52:17.551 INFO:teuthology.orchestra.run.smithi139.stdout:(31/33): python3-zc-lockfile-2.0-10.el9.noarch. 184 kB/s | 20 kB 00:00 2023-11-29T08:52:20.663 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-test-2:18.0.0-7483.g412bfade.el9.x86_64 10/10 2023-11-29T08:52:20.664 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-test-2:18.0.0-7483.g412bfade.el9.x86_64 1/10 2023-11-29T08:52:20.664 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libcephsqlite-2:18.0.0-7483.g412bfade.el9.x86_64 2/10 2023-11-29T08:52:20.664 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : jq-1.6-16.el9.x86_64 3/10 2023-11-29T08:52:20.664 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libasan-11.4.1-2.3.el9.x86_64 4/10 2023-11-29T08:52:20.664 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libubsan-11.4.1-2.3.el9.x86_64 5/10 2023-11-29T08:52:20.664 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 6/10 2023-11-29T08:52:20.664 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 7/10 2023-11-29T08:52:20.664 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 8/10 2023-11-29T08:52:20.664 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : cryptopp-8.6.0-1.el9.x86_64 9/10 2023-11-29T08:52:20.734 INFO:teuthology.orchestra.run.smithi139.stdout:(32/33): ceph-mon-18.0.0-7483.g412bfade.el9.x86 710 kB/s | 8.9 MB 00:12 2023-11-29T08:52:21.113 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 10/10 2023-11-29T08:52:21.113 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:52:21.113 INFO:teuthology.orchestra.run.smithi027.stdout:Installed: 2023-11-29T08:52:21.113 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-test-2:18.0.0-7483.g412bfade.el9.x86_64 2023-11-29T08:52:21.113 INFO:teuthology.orchestra.run.smithi027.stdout: cryptopp-8.6.0-1.el9.x86_64 2023-11-29T08:52:21.113 INFO:teuthology.orchestra.run.smithi027.stdout: jq-1.6-16.el9.x86_64 2023-11-29T08:52:21.113 INFO:teuthology.orchestra.run.smithi027.stdout: libasan-11.4.1-2.3.el9.x86_64 2023-11-29T08:52:21.113 INFO:teuthology.orchestra.run.smithi027.stdout: libcephsqlite-2:18.0.0-7483.g412bfade.el9.x86_64 2023-11-29T08:52:21.113 INFO:teuthology.orchestra.run.smithi027.stdout: libubsan-11.4.1-2.3.el9.x86_64 2023-11-29T08:52:21.113 INFO:teuthology.orchestra.run.smithi027.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-11-29T08:52:21.113 INFO:teuthology.orchestra.run.smithi027.stdout: socat-1.7.4.1-5.el9.x86_64 2023-11-29T08:52:21.113 INFO:teuthology.orchestra.run.smithi027.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-11-29T08:52:21.113 INFO:teuthology.orchestra.run.smithi027.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2023-11-29T08:52:21.114 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:52:21.114 INFO:teuthology.orchestra.run.smithi027.stdout:Complete! 2023-11-29T08:52:21.444 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum -y install ceph 2023-11-29T08:52:22.048 INFO:teuthology.orchestra.run.smithi027.stdout:Last metadata expiration check: 0:03:35 ago on Wed 29 Nov 2023 08:48:47 AM UTC. 2023-11-29T08:52:22.203 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. 2023-11-29T08:52:22.206 INFO:teuthology.orchestra.run.smithi027.stdout:========================================================================================= 2023-11-29T08:52:22.206 INFO:teuthology.orchestra.run.smithi027.stdout: Package Arch Version Repository Size 2023-11-29T08:52:22.206 INFO:teuthology.orchestra.run.smithi027.stdout:========================================================================================= 2023-11-29T08:52:22.206 INFO:teuthology.orchestra.run.smithi027.stdout:Installing: 2023-11-29T08:52:22.206 INFO:teuthology.orchestra.run.smithi027.stdout: ceph x86_64 2:18.0.0-7483.g412bfade.el9 ceph 6.5 k 2023-11-29T08:52:22.206 INFO:teuthology.orchestra.run.smithi027.stdout:Installing dependencies: 2023-11-29T08:52:22.207 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mds x86_64 2:18.0.0-7483.g412bfade.el9 ceph 2.0 M 2023-11-29T08:52:22.207 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr x86_64 2:18.0.0-7483.g412bfade.el9 ceph 1.5 M 2023-11-29T08:52:22.207 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-modules-core noarch 2:18.0.0-7483.g412bfade.el9 ceph-noarch 243 k 2023-11-29T08:52:22.207 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mon x86_64 2:18.0.0-7483.g412bfade.el9 ceph 8.9 M 2023-11-29T08:52:22.207 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-osd x86_64 2:18.0.0-7483.g412bfade.el9 ceph 117 M 2023-11-29T08:52:22.207 INFO:teuthology.orchestra.run.smithi027.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-11-29T08:52:22.207 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-11-29T08:52:22.207 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-11-29T08:52:22.207 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-11-29T08:52:22.207 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-11-29T08:52:22.207 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-11-29T08:52:22.207 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-11-29T08:52:22.208 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-11-29T08:52:22.208 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-11-29T08:52:22.208 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-11-29T08:52:22.208 INFO:teuthology.orchestra.run.smithi027.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-11-29T08:52:22.208 INFO:teuthology.orchestra.run.smithi027.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-11-29T08:52:22.208 INFO:teuthology.orchestra.run.smithi027.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-11-29T08:52:22.208 INFO:teuthology.orchestra.run.smithi027.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-11-29T08:52:22.208 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-11-29T08:52:22.208 INFO:teuthology.orchestra.run.smithi027.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-11-29T08:52:22.208 INFO:teuthology.orchestra.run.smithi027.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-11-29T08:52:22.208 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-11-29T08:52:22.208 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-11-29T08:52:22.208 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-11-29T08:52:22.208 INFO:teuthology.orchestra.run.smithi027.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-11-29T08:52:22.209 INFO:teuthology.orchestra.run.smithi027.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-11-29T08:52:22.209 INFO:teuthology.orchestra.run.smithi027.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-11-29T08:52:22.209 INFO:teuthology.orchestra.run.smithi027.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-11-29T08:52:22.209 INFO:teuthology.orchestra.run.smithi027.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-11-29T08:52:22.209 INFO:teuthology.orchestra.run.smithi027.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-11-29T08:52:22.209 INFO:teuthology.orchestra.run.smithi027.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-11-29T08:52:22.209 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:52:22.209 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction Summary 2023-11-29T08:52:22.209 INFO:teuthology.orchestra.run.smithi027.stdout:========================================================================================= 2023-11-29T08:52:22.209 INFO:teuthology.orchestra.run.smithi027.stdout:Install 33 Packages 2023-11-29T08:52:22.209 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:52:22.210 INFO:teuthology.orchestra.run.smithi027.stdout:Total download size: 134 M 2023-11-29T08:52:22.210 INFO:teuthology.orchestra.run.smithi027.stdout:Installed size: 1.4 G 2023-11-29T08:52:22.210 INFO:teuthology.orchestra.run.smithi027.stdout:Downloading Packages: 2023-11-29T08:52:22.912 INFO:teuthology.orchestra.run.smithi027.stdout:(1/33): ceph-18.0.0-7483.g412bfade.el9.x86_64.r 19 kB/s | 6.5 kB 00:00 2023-11-29T08:52:24.396 INFO:teuthology.orchestra.run.smithi027.stdout:(2/33): ceph-mgr-18.0.0-7483.g412bfade.el9.x86_ 812 kB/s | 1.5 MB 00:01 2023-11-29T08:52:25.379 INFO:teuthology.orchestra.run.smithi027.stdout:(3/33): ceph-mds-18.0.0-7483.g412bfade.el9.x86_ 726 kB/s | 2.0 MB 00:02 2023-11-29T08:52:25.780 INFO:teuthology.orchestra.run.smithi027.stdout:(4/33): ceph-mgr-modules-core-18.0.0-7483.g412b 607 kB/s | 243 kB 00:00 2023-11-29T08:52:26.013 INFO:teuthology.orchestra.run.smithi027.stdout:(5/33): python3-mako-1.1.4-6.el9.noarch.rpm 619 kB/s | 144 kB 00:00 2023-11-29T08:52:26.080 INFO:teuthology.orchestra.run.smithi027.stdout:(6/33): python3-markupsafe-1.1.1-12.el9.x86_64. 475 kB/s | 32 kB 00:00 2023-11-29T08:52:26.180 INFO:teuthology.orchestra.run.smithi027.stdout:(7/33): python3-pytz-2021.1-5.el9.noarch.rpm 474 kB/s | 47 kB 00:00 2023-11-29T08:52:26.290 INFO:teuthology.orchestra.run.smithi027.stdout:(8/33): ceph-mon-18.0.0-7483.g412bfade.el9.x86_ 2.6 MB/s | 8.9 MB 00:03 2023-11-29T08:52:26.307 INFO:teuthology.orchestra.run.smithi027.stdout:(9/33): python3-toml-0.10.2-6.el9.noarch.rpm 306 kB/s | 39 kB 00:00 2023-11-29T08:52:26.432 INFO:teuthology.orchestra.run.smithi027.stdout:(10/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.7 MB/s | 241 kB 00:00 2023-11-29T08:52:26.566 INFO:teuthology.orchestra.run.smithi027.stdout:(11/33): python3-cryptography-36.0.1-4.el9.x86_ 4.4 MB/s | 1.1 MB 00:00 2023-11-29T08:52:26.591 INFO:teuthology.orchestra.run.smithi027.stdout:(12/33): python3-ply-3.11-14.el9.noarch.rpm 650 kB/s | 103 kB 00:00 2023-11-29T08:52:26.633 INFO:teuthology.orchestra.run.smithi027.stdout:(13/33): python3-pycparser-2.20-6.el9.noarch.rp 1.8 MB/s | 124 kB 00:00 2023-11-29T08:52:26.658 INFO:teuthology.orchestra.run.smithi027.stdout:(14/33): python3-requests-2.25.1-7.el9.noarch.r 1.6 MB/s | 113 kB 00:00 2023-11-29T08:52:26.684 INFO:teuthology.orchestra.run.smithi027.stdout:(15/33): python3-urllib3-1.26.5-4.el9.noarch.rp 3.7 MB/s | 187 kB 00:00 2023-11-29T08:52:26.842 INFO:teuthology.orchestra.run.smithi027.stdout:(16/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 237 kB/s | 43 kB 00:00 2023-11-29T08:52:26.901 INFO:teuthology.orchestra.run.smithi027.stdout:(17/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 792 kB/s | 172 kB 00:00 2023-11-29T08:52:26.959 INFO:teuthology.orchestra.run.smithi027.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 183 kB/s | 11 kB 00:00 2023-11-29T08:52:27.018 INFO:teuthology.orchestra.run.smithi027.stdout:(19/33): python3-jaraco-classes-3.2.1-5.el9.noa 304 kB/s | 18 kB 00:00 2023-11-29T08:52:27.043 INFO:teuthology.orchestra.run.smithi027.stdout:(20/33): python3-cherrypy-18.6.1-2.el9.noarch.r 1.7 MB/s | 358 kB 00:00 2023-11-29T08:52:27.077 INFO:teuthology.orchestra.run.smithi027.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 395 kB/s | 23 kB 00:00 2023-11-29T08:52:27.102 INFO:teuthology.orchestra.run.smithi027.stdout:(22/33): python3-jaraco-functools-3.5.0-2.el9.n 331 kB/s | 19 kB 00:00 2023-11-29T08:52:27.136 INFO:teuthology.orchestra.run.smithi027.stdout:(23/33): python3-jaraco-text-3.2.0-6.el9.noarch 336 kB/s | 20 kB 00:00 2023-11-29T08:52:27.286 INFO:teuthology.orchestra.run.smithi027.stdout:(24/33): python3-logutils-0.3.5-21.el9.noarch.r 252 kB/s | 46 kB 00:00 2023-11-29T08:52:27.453 INFO:teuthology.orchestra.run.smithi027.stdout:(25/33): python3-pecan-1.4.2-3.el9.noarch.rpm 1.6 MB/s | 272 kB 00:00 2023-11-29T08:52:27.528 INFO:teuthology.orchestra.run.smithi027.stdout:(26/33): python3-portend-3.1.0-2.el9.noarch.rpm 219 kB/s | 16 kB 00:00 2023-11-29T08:52:27.645 INFO:teuthology.orchestra.run.smithi027.stdout:(27/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 771 kB/s | 90 kB 00:00 2023-11-29T08:52:27.671 INFO:teuthology.orchestra.run.smithi027.stdout:(28/33): python3-more-itertools-8.12.0-2.el9.no 147 kB/s | 79 kB 00:00 2023-11-29T08:52:27.712 INFO:teuthology.orchestra.run.smithi027.stdout:(29/33): python3-tempora-5.0.0-2.el9.noarch.rpm 535 kB/s | 36 kB 00:00 2023-11-29T08:52:27.754 INFO:teuthology.orchestra.run.smithi027.stdout:(30/33): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2023-11-29T08:52:27.821 INFO:teuthology.orchestra.run.smithi027.stdout:(31/33): python3-zc-lockfile-2.0-10.el9.noarch. 300 kB/s | 20 kB 00:00 2023-11-29T08:52:27.997 INFO:teuthology.orchestra.run.smithi027.stdout:(32/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 1.5 MB/s | 427 kB 00:00 2023-11-29T08:53:59.945 INFO:teuthology.orchestra.run.smithi139.stdout:(33/33): ceph-osd-18.0.0-7483.g412bfade.el9.x86 1.1 MB/s | 117 MB 01:50 2023-11-29T08:53:59.948 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2023-11-29T08:53:59.948 INFO:teuthology.orchestra.run.smithi139.stdout:Total 1.2 MB/s | 134 MB 01:52 2023-11-29T08:53:59.948 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2023-11-29T08:53:59.984 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2023-11-29T08:53:59.984 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2023-11-29T08:54:00.947 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2023-11-29T08:54:00.947 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2023-11-29T08:54:02.780 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2023-11-29T08:54:02.846 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2023-11-29T08:54:02.870 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2023-11-29T08:54:02.903 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2023-11-29T08:54:02.994 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2023-11-29T08:54:03.073 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2023-11-29T08:54:03.114 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2023-11-29T08:54:03.185 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2023-11-29T08:54:03.239 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 8/33 2023-11-29T08:54:03.277 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 9/33 2023-11-29T08:54:03.326 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-ply-3.11-14.el9.noarch 10/33 2023-11-29T08:54:03.391 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 11/33 2023-11-29T08:54:03.583 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 12/33 2023-11-29T08:54:03.631 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 13/33 2023-11-29T08:54:03.670 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 14/33 2023-11-29T08:54:03.721 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 15/33 2023-11-29T08:54:03.751 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 16/33 2023-11-29T08:54:03.829 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 17/33 2023-11-29T08:54:03.861 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 18/33 2023-11-29T08:54:03.895 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 19/33 2023-11-29T08:54:03.935 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 20/33 2023-11-29T08:54:03.970 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/33 2023-11-29T08:54:04.004 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 22/33 2023-11-29T08:54:04.094 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 23/33 2023-11-29T08:54:04.127 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 24/33 2023-11-29T08:54:04.199 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/33 2023-11-29T08:54:04.336 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/33 2023-11-29T08:54:04.461 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 27/33 2023-11-29T08:54:04.618 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-7483.g412bfade.el9. 28/33 2023-11-29T08:54:04.648 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-2:18.0.0-7483.g412bfade.el9.x86_64 29/33 2023-11-29T08:54:04.672 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-2:18.0.0-7483.g412bfade.el9.x86_64 29/33 2023-11-29T08:54:04.672 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-29T08:54:04.672 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-11-29T08:54:04.673 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-29T08:54:04.673 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-29T08:54:04.673 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:54:22.930 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-osd-2:18.0.0-7483.g412bfade.el9.x86_64 30/33 2023-11-29T08:54:22.956 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-osd-2:18.0.0-7483.g412bfade.el9.x86_64 30/33 2023-11-29T08:54:22.956 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-29T08:54:22.956 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-11-29T08:54:22.956 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-29T08:54:22.956 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-29T08:54:22.956 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:54:23.839 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mon-2:18.0.0-7483.g412bfade.el9.x86_64 31/33 2023-11-29T08:54:23.861 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mon-2:18.0.0-7483.g412bfade.el9.x86_64 31/33 2023-11-29T08:54:23.861 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-29T08:54:23.862 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-11-29T08:54:23.862 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-29T08:54:23.862 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-29T08:54:23.862 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:54:24.064 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mds-2:18.0.0-7483.g412bfade.el9.x86_64 32/33 2023-11-29T08:54:24.086 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mds-2:18.0.0-7483.g412bfade.el9.x86_64 32/33 2023-11-29T08:54:24.087 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-29T08:54:24.087 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-11-29T08:54:24.087 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-29T08:54:24.087 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-29T08:54:24.087 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:54:24.153 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-2:18.0.0-7483.g412bfade.el9.x86_64 33/33 2023-11-29T08:54:28.526 INFO:teuthology.orchestra.run.smithi027.stdout:(33/33): ceph-osd-18.0.0-7483.g412bfade.el9.x86 967 kB/s | 117 MB 02:04 2023-11-29T08:54:28.529 INFO:teuthology.orchestra.run.smithi027.stdout:-------------------------------------------------------------------------------- 2023-11-29T08:54:28.529 INFO:teuthology.orchestra.run.smithi027.stdout:Total 1.1 MB/s | 134 MB 02:06 2023-11-29T08:54:28.530 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction check 2023-11-29T08:54:28.569 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction check succeeded. 2023-11-29T08:54:28.570 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction test 2023-11-29T08:54:29.583 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction test succeeded. 2023-11-29T08:54:29.583 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction 2023-11-29T08:54:31.501 INFO:teuthology.orchestra.run.smithi027.stdout: Preparing : 1/1 2023-11-29T08:54:31.561 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2023-11-29T08:54:31.594 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2023-11-29T08:54:31.627 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2023-11-29T08:54:31.722 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2023-11-29T08:54:31.799 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2023-11-29T08:54:31.847 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2023-11-29T08:54:31.929 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2023-11-29T08:54:31.982 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 8/33 2023-11-29T08:54:32.019 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 9/33 2023-11-29T08:54:32.069 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-ply-3.11-14.el9.noarch 10/33 2023-11-29T08:54:32.130 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 11/33 2023-11-29T08:54:32.328 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 12/33 2023-11-29T08:54:32.390 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 13/33 2023-11-29T08:54:32.429 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 14/33 2023-11-29T08:54:32.463 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 15/33 2023-11-29T08:54:32.493 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 16/33 2023-11-29T08:54:32.572 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 17/33 2023-11-29T08:54:32.611 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 18/33 2023-11-29T08:54:32.653 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 19/33 2023-11-29T08:54:32.694 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 20/33 2023-11-29T08:54:32.729 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/33 2023-11-29T08:54:32.763 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 22/33 2023-11-29T08:54:32.856 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 23/33 2023-11-29T08:54:32.903 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 24/33 2023-11-29T08:54:32.977 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/33 2023-11-29T08:54:33.125 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/33 2023-11-29T08:54:33.251 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 27/33 2023-11-29T08:54:33.418 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-7483.g412bfade.el9. 28/33 2023-11-29T08:54:33.441 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-mgr-2:18.0.0-7483.g412bfade.el9.x86_64 29/33 2023-11-29T08:54:33.466 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-mgr-2:18.0.0-7483.g412bfade.el9.x86_64 29/33 2023-11-29T08:54:33.466 INFO:teuthology.orchestra.run.smithi027.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-29T08:54:33.466 INFO:teuthology.orchestra.run.smithi027.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-11-29T08:54:33.466 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-29T08:54:33.466 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-29T08:54:33.466 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:54:34.055 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-2:18.0.0-7483.g412bfade.el9.x86_64 33/33 2023-11-29T08:54:34.055 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-2:18.0.0-7483.g412bfade.el9.x86_64 1/33 2023-11-29T08:54:34.055 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mds-2:18.0.0-7483.g412bfade.el9.x86_64 2/33 2023-11-29T08:54:34.056 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-2:18.0.0-7483.g412bfade.el9.x86_64 3/33 2023-11-29T08:54:34.056 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mon-2:18.0.0-7483.g412bfade.el9.x86_64 4/33 2023-11-29T08:54:34.056 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-osd-2:18.0.0-7483.g412bfade.el9.x86_64 5/33 2023-11-29T08:54:34.056 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-7483.g412bfade.el9. 6/33 2023-11-29T08:54:34.056 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 7/33 2023-11-29T08:54:34.056 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 8/33 2023-11-29T08:54:34.056 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 9/33 2023-11-29T08:54:34.056 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 10/33 2023-11-29T08:54:34.056 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 11/33 2023-11-29T08:54:34.056 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 12/33 2023-11-29T08:54:34.056 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-ply-3.11-14.el9.noarch 13/33 2023-11-29T08:54:34.056 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 14/33 2023-11-29T08:54:34.056 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 15/33 2023-11-29T08:54:34.056 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 16/33 2023-11-29T08:54:34.056 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2023-11-29T08:54:34.057 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2023-11-29T08:54:34.057 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2023-11-29T08:54:34.057 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2023-11-29T08:54:34.057 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2023-11-29T08:54:34.057 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2023-11-29T08:54:34.057 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2023-11-29T08:54:34.057 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2023-11-29T08:54:34.057 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2023-11-29T08:54:34.057 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2023-11-29T08:54:34.057 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2023-11-29T08:54:34.057 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2023-11-29T08:54:34.058 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2023-11-29T08:54:34.058 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2023-11-29T08:54:34.058 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2023-11-29T08:54:34.058 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2023-11-29T08:54:34.970 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2023-11-29T08:54:34.970 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:54:34.970 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2023-11-29T08:54:34.970 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-2:18.0.0-7483.g412bfade.el9.x86_64 2023-11-29T08:54:34.970 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mds-2:18.0.0-7483.g412bfade.el9.x86_64 2023-11-29T08:54:34.970 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-2:18.0.0-7483.g412bfade.el9.x86_64 2023-11-29T08:54:34.970 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-modules-core-2:18.0.0-7483.g412bfade.el9.noarch 2023-11-29T08:54:34.971 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mon-2:18.0.0-7483.g412bfade.el9.x86_64 2023-11-29T08:54:34.971 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-osd-2:18.0.0-7483.g412bfade.el9.x86_64 2023-11-29T08:54:34.971 INFO:teuthology.orchestra.run.smithi139.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-11-29T08:54:34.971 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-11-29T08:54:34.971 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-11-29T08:54:34.971 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-11-29T08:54:34.971 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-11-29T08:54:34.971 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-11-29T08:54:34.971 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-11-29T08:54:34.971 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-11-29T08:54:34.971 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-11-29T08:54:34.971 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-11-29T08:54:34.971 INFO:teuthology.orchestra.run.smithi139.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-11-29T08:54:34.972 INFO:teuthology.orchestra.run.smithi139.stdout: python3-mako-1.1.4-6.el9.noarch 2023-11-29T08:54:34.972 INFO:teuthology.orchestra.run.smithi139.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-11-29T08:54:34.972 INFO:teuthology.orchestra.run.smithi139.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-11-29T08:54:34.972 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-11-29T08:54:34.972 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ply-3.11-14.el9.noarch 2023-11-29T08:54:34.972 INFO:teuthology.orchestra.run.smithi139.stdout: python3-portend-3.1.0-2.el9.noarch 2023-11-29T08:54:34.972 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-11-29T08:54:34.972 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pycparser-2.20-6.el9.noarch 2023-11-29T08:54:34.972 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pytz-2021.1-5.el9.noarch 2023-11-29T08:54:34.972 INFO:teuthology.orchestra.run.smithi139.stdout: python3-requests-2.25.1-7.el9.noarch 2023-11-29T08:54:34.972 INFO:teuthology.orchestra.run.smithi139.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-11-29T08:54:34.972 INFO:teuthology.orchestra.run.smithi139.stdout: python3-toml-0.10.2-6.el9.noarch 2023-11-29T08:54:34.973 INFO:teuthology.orchestra.run.smithi139.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-11-29T08:54:34.973 INFO:teuthology.orchestra.run.smithi139.stdout: python3-webob-1.8.7-6.el9.noarch 2023-11-29T08:54:34.973 INFO:teuthology.orchestra.run.smithi139.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-11-29T08:54:34.973 INFO:teuthology.orchestra.run.smithi139.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-11-29T08:54:34.973 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:54:34.973 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2023-11-29T08:54:35.213 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install ceph-base 2023-11-29T08:54:35.824 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:05:49 ago on Wed 29 Nov 2023 08:48:46 AM UTC. 2023-11-29T08:54:35.923 INFO:teuthology.orchestra.run.smithi139.stdout:Package ceph-base-2:18.0.0-7483.g412bfade.el9.x86_64 is already installed. 2023-11-29T08:54:35.975 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2023-11-29T08:54:35.976 INFO:teuthology.orchestra.run.smithi139.stdout:Nothing to do. 2023-11-29T08:54:35.976 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2023-11-29T08:54:36.053 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install cephadm 2023-11-29T08:54:36.646 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:05:50 ago on Wed 29 Nov 2023 08:48:46 AM UTC. 2023-11-29T08:54:36.790 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2023-11-29T08:54:36.791 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2023-11-29T08:54:36.791 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repository Size 2023-11-29T08:54:36.791 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2023-11-29T08:54:36.791 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2023-11-29T08:54:36.791 INFO:teuthology.orchestra.run.smithi139.stdout: cephadm noarch 2:18.0.0-7483.g412bfade.el9 ceph-noarch 774 k 2023-11-29T08:54:36.791 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:54:36.792 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2023-11-29T08:54:36.792 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2023-11-29T08:54:36.792 INFO:teuthology.orchestra.run.smithi139.stdout:Install 1 Package 2023-11-29T08:54:36.792 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:54:36.792 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 774 k 2023-11-29T08:54:36.792 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 788 k 2023-11-29T08:54:36.792 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2023-11-29T08:54:37.279 INFO:teuthology.orchestra.run.smithi139.stdout:cephadm-18.0.0-7483.g412bfade.el9.noarch.rpm 1.6 MB/s | 774 kB 00:00 2023-11-29T08:54:37.280 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2023-11-29T08:54:37.280 INFO:teuthology.orchestra.run.smithi139.stdout:Total 1.5 MB/s | 774 kB 00:00 2023-11-29T08:54:37.280 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2023-11-29T08:54:37.285 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2023-11-29T08:54:37.285 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2023-11-29T08:54:37.291 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2023-11-29T08:54:37.292 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2023-11-29T08:54:37.366 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2023-11-29T08:54:37.779 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: cephadm-2:18.0.0-7483.g412bfade.el9.noarch 1/1 2023-11-29T08:54:37.859 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : cephadm-2:18.0.0-7483.g412bfade.el9.noarch 1/1 2023-11-29T08:54:38.232 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: cephadm-2:18.0.0-7483.g412bfade.el9.noarch 1/1 2023-11-29T08:54:38.546 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : cephadm-2:18.0.0-7483.g412bfade.el9.noarch 1/1 2023-11-29T08:54:38.546 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:54:38.546 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2023-11-29T08:54:38.546 INFO:teuthology.orchestra.run.smithi139.stdout: cephadm-2:18.0.0-7483.g412bfade.el9.noarch 2023-11-29T08:54:38.546 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:54:38.547 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2023-11-29T08:54:38.753 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install ceph-immutable-object-cache 2023-11-29T08:54:39.336 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:05:53 ago on Wed 29 Nov 2023 08:48:46 AM UTC. 2023-11-29T08:54:39.485 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2023-11-29T08:54:39.485 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2023-11-29T08:54:39.485 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repo Size 2023-11-29T08:54:39.485 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2023-11-29T08:54:39.486 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2023-11-29T08:54:39.486 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-7483.g412bfade.el9 ceph 143 k 2023-11-29T08:54:39.486 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:54:39.486 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2023-11-29T08:54:39.486 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2023-11-29T08:54:39.486 INFO:teuthology.orchestra.run.smithi139.stdout:Install 1 Package 2023-11-29T08:54:39.486 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:54:39.487 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 143 k 2023-11-29T08:54:39.487 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 437 k 2023-11-29T08:54:39.487 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2023-11-29T08:54:39.826 INFO:teuthology.orchestra.run.smithi139.stdout:ceph-immutable-object-cache-18.0.0-7483.g412bfa 422 kB/s | 143 kB 00:00 2023-11-29T08:54:39.827 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2023-11-29T08:54:39.827 INFO:teuthology.orchestra.run.smithi139.stdout:Total 420 kB/s | 143 kB 00:00 2023-11-29T08:54:39.827 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2023-11-29T08:54:39.835 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2023-11-29T08:54:39.835 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2023-11-29T08:54:39.886 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2023-11-29T08:54:39.887 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2023-11-29T08:54:40.029 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2023-11-29T08:54:40.094 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-7483.g412bfade. 1/1 2023-11-29T08:54:40.118 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-7483.g412bfade. 1/1 2023-11-29T08:54:40.118 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-29T08:54:40.118 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-11-29T08:54:40.118 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:54:41.078 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-7483.g412bfade. 1/1 2023-11-29T08:54:41.078 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:54:41.078 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2023-11-29T08:54:41.079 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-immutable-object-cache-2:18.0.0-7483.g412bfade.el9.x86_64 2023-11-29T08:54:41.079 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:54:41.079 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2023-11-29T08:54:41.344 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install ceph-mgr 2023-11-29T08:54:41.932 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:05:55 ago on Wed 29 Nov 2023 08:48:46 AM UTC. 2023-11-29T08:54:42.030 INFO:teuthology.orchestra.run.smithi139.stdout:Package ceph-mgr-2:18.0.0-7483.g412bfade.el9.x86_64 is already installed. 2023-11-29T08:54:42.079 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2023-11-29T08:54:42.080 INFO:teuthology.orchestra.run.smithi139.stdout:Nothing to do. 2023-11-29T08:54:42.081 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2023-11-29T08:54:42.153 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install ceph-mgr-dashboard 2023-11-29T08:54:42.731 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:05:56 ago on Wed 29 Nov 2023 08:48:46 AM UTC. 2023-11-29T08:54:42.876 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2023-11-29T08:54:42.876 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2023-11-29T08:54:42.877 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repository Size 2023-11-29T08:54:42.877 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2023-11-29T08:54:42.877 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2023-11-29T08:54:42.877 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-dashboard noarch 2:18.0.0-7483.g412bfade.el9 ceph-noarch 1.8 M 2023-11-29T08:54:42.877 INFO:teuthology.orchestra.run.smithi139.stdout:Installing dependencies: 2023-11-29T08:54:42.877 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-grafana-dashboards noarch 2:18.0.0-7483.g412bfade.el9 ceph-noarch 28 k 2023-11-29T08:54:42.877 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-prometheus-alerts noarch 2:18.0.0-7483.g412bfade.el9 ceph-noarch 15 k 2023-11-29T08:54:42.877 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-11-29T08:54:42.877 INFO:teuthology.orchestra.run.smithi139.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-11-29T08:54:42.877 INFO:teuthology.orchestra.run.smithi139.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-11-29T08:54:42.877 INFO:teuthology.orchestra.run.smithi139.stdout:Installing weak dependencies: 2023-11-29T08:54:42.877 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-11-29T08:54:42.877 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:54:42.878 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2023-11-29T08:54:42.878 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2023-11-29T08:54:42.878 INFO:teuthology.orchestra.run.smithi139.stdout:Install 7 Packages 2023-11-29T08:54:42.878 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:54:42.878 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 2.1 M 2023-11-29T08:54:42.878 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 8.7 M 2023-11-29T08:54:42.878 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2023-11-29T08:54:43.179 INFO:teuthology.orchestra.run.smithi139.stdout:(1/7): ceph-prometheus-alerts-18.0.0-7483.g412b 62 kB/s | 15 kB 00:00 2023-11-29T08:54:43.204 INFO:teuthology.orchestra.run.smithi139.stdout:(2/7): ceph-grafana-dashboards-18.0.0-7483.g412 104 kB/s | 28 kB 00:00 2023-11-29T08:54:43.346 INFO:teuthology.orchestra.run.smithi139.stdout:(3/7): ceph-mgr-dashboard-18.0.0-7483.g412bfade 4.3 MB/s | 1.8 MB 00:00 2023-11-29T08:54:43.455 INFO:teuthology.orchestra.run.smithi139.stdout:(4/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 33 kB/s | 9.0 kB 00:00 2023-11-29T08:54:43.497 INFO:teuthology.orchestra.run.smithi139.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 140 kB/s | 41 kB 00:00 2023-11-29T08:54:43.606 INFO:teuthology.orchestra.run.smithi139.stdout:(6/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 120 kB/s | 31 kB 00:00 2023-11-29T08:54:43.697 INFO:teuthology.orchestra.run.smithi139.stdout:(7/7): python3-routes-2.5.1-5.el9.noarch.rpm 778 kB/s | 188 kB 00:00 2023-11-29T08:54:43.702 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2023-11-29T08:54:43.702 INFO:teuthology.orchestra.run.smithi139.stdout:Total 2.5 MB/s | 2.1 MB 00:00 2023-11-29T08:54:43.702 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2023-11-29T08:54:43.710 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2023-11-29T08:54:43.710 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2023-11-29T08:54:43.775 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2023-11-29T08:54:43.775 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2023-11-29T08:54:44.066 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2023-11-29T08:54:44.132 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2023-11-29T08:54:44.166 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2023-11-29T08:54:44.212 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2023-11-29T08:54:44.244 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2023-11-29T08:54:44.274 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-7483.g412bfade.el9.n 5/7 2023-11-29T08:54:44.510 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-7483.g412bfade.el9. 6/7 2023-11-29T08:54:44.543 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-7483.g412bfade.el9.noarc 7/7 2023-11-29T08:54:45.111 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-7483.g412bfade.el9.noarc 7/7 2023-11-29T08:54:45.111 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-7483.g412bfade.el9. 1/7 2023-11-29T08:54:45.111 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-7483.g412bfade.el9.noarc 2/7 2023-11-29T08:54:45.112 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-7483.g412bfade.el9.n 3/7 2023-11-29T08:54:45.112 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2023-11-29T08:54:45.112 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2023-11-29T08:54:45.112 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2023-11-29T08:54:45.429 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2023-11-29T08:54:45.430 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:54:45.430 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2023-11-29T08:54:45.430 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-grafana-dashboards-2:18.0.0-7483.g412bfade.el9.noarch 2023-11-29T08:54:45.430 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-dashboard-2:18.0.0-7483.g412bfade.el9.noarch 2023-11-29T08:54:45.430 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-prometheus-alerts-2:18.0.0-7483.g412bfade.el9.noarch 2023-11-29T08:54:45.430 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-11-29T08:54:45.430 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-11-29T08:54:45.430 INFO:teuthology.orchestra.run.smithi139.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-11-29T08:54:45.430 INFO:teuthology.orchestra.run.smithi139.stdout: python3-routes-2.5.1-5.el9.noarch 2023-11-29T08:54:45.430 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:54:45.430 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2023-11-29T08:54:45.656 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install ceph-mgr-diskprediction-local 2023-11-29T08:54:46.235 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:06:00 ago on Wed 29 Nov 2023 08:48:46 AM UTC. 2023-11-29T08:54:46.381 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2023-11-29T08:54:46.382 INFO:teuthology.orchestra.run.smithi139.stdout:============================================================================================ 2023-11-29T08:54:46.382 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repository Size 2023-11-29T08:54:46.382 INFO:teuthology.orchestra.run.smithi139.stdout:============================================================================================ 2023-11-29T08:54:46.383 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2023-11-29T08:54:46.383 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-7483.g412bfade.el9 ceph-noarch 7.4 M 2023-11-29T08:54:46.383 INFO:teuthology.orchestra.run.smithi139.stdout:Installing dependencies: 2023-11-29T08:54:46.383 INFO:teuthology.orchestra.run.smithi139.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-11-29T08:54:46.383 INFO:teuthology.orchestra.run.smithi139.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-11-29T08:54:46.383 INFO:teuthology.orchestra.run.smithi139.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-11-29T08:54:46.383 INFO:teuthology.orchestra.run.smithi139.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-11-29T08:54:46.383 INFO:teuthology.orchestra.run.smithi139.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-11-29T08:54:46.383 INFO:teuthology.orchestra.run.smithi139.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-11-29T08:54:46.383 INFO:teuthology.orchestra.run.smithi139.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-11-29T08:54:46.383 INFO:teuthology.orchestra.run.smithi139.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-11-29T08:54:46.383 INFO:teuthology.orchestra.run.smithi139.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-11-29T08:54:46.383 INFO:teuthology.orchestra.run.smithi139.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-11-29T08:54:46.384 INFO:teuthology.orchestra.run.smithi139.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-11-29T08:54:46.384 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:54:46.384 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2023-11-29T08:54:46.384 INFO:teuthology.orchestra.run.smithi139.stdout:============================================================================================ 2023-11-29T08:54:46.384 INFO:teuthology.orchestra.run.smithi139.stdout:Install 12 Packages 2023-11-29T08:54:46.384 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:54:46.384 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 37 M 2023-11-29T08:54:46.385 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 209 M 2023-11-29T08:54:46.385 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2023-11-29T08:54:46.796 INFO:teuthology.orchestra.run.smithi139.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 232 kB/s | 32 kB 00:00 2023-11-29T08:54:46.821 INFO:teuthology.orchestra.run.smithi139.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 730 kB/s | 17 kB 00:00 2023-11-29T08:54:46.846 INFO:teuthology.orchestra.run.smithi139.stdout:(3/12): openblas-0.3.21-2.el9.x86_64.rpm 1.4 MB/s | 34 kB 00:00 2023-11-29T08:54:46.904 INFO:teuthology.orchestra.run.smithi139.stdout:(4/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 12 MB/s | 3.0 MB 00:00 2023-11-29T08:54:47.088 INFO:teuthology.orchestra.run.smithi139.stdout:(5/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 20 MB/s | 4.7 MB 00:00 2023-11-29T08:54:47.172 INFO:teuthology.orchestra.run.smithi139.stdout:(6/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 18 MB/s | 4.8 MB 00:00 2023-11-29T08:54:47.197 INFO:teuthology.orchestra.run.smithi139.stdout:(7/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.0 MB/s | 217 kB 00:00 2023-11-29T08:54:47.381 INFO:teuthology.orchestra.run.smithi139.stdout:(8/12): libgfortran-11.4.1-2.3.el9.x86_64.rpm 4.3 MB/s | 803 kB 00:00 2023-11-29T08:54:47.556 INFO:teuthology.orchestra.run.smithi139.stdout:(9/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 41 MB/s | 16 MB 00:00 2023-11-29T08:54:47.581 INFO:teuthology.orchestra.run.smithi139.stdout:(10/12): libquadmath-11.4.1-2.3.el9.x86_64.rpm 978 kB/s | 195 kB 00:00 2023-11-29T08:54:47.717 INFO:teuthology.orchestra.run.smithi139.stdout:(11/12): ceph-mgr-diskprediction-local-18.0.0-7 7.0 MB/s | 7.4 MB 00:01 2023-11-29T08:54:47.865 INFO:teuthology.orchestra.run.smithi139.stdout:(12/12): python3-devel-3.9.17-2.el9.x86_64.rpm 796 kB/s | 245 kB 00:00 2023-11-29T08:54:47.868 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2023-11-29T08:54:47.868 INFO:teuthology.orchestra.run.smithi139.stdout:Total 25 MB/s | 37 MB 00:01 2023-11-29T08:54:47.881 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2023-11-29T08:54:47.905 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2023-11-29T08:54:47.905 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2023-11-29T08:54:48.326 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2023-11-29T08:54:48.326 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2023-11-29T08:54:49.033 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2023-11-29T08:54:49.111 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 1/12 2023-11-29T08:54:49.144 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 2/12 2023-11-29T08:54:49.242 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2023-11-29T08:54:49.281 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2023-11-29T08:54:49.460 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2023-11-29T08:54:49.488 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2023-11-29T08:54:49.580 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2023-11-29T08:54:50.234 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2023-11-29T08:54:50.351 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2023-11-29T08:54:51.617 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2023-11-29T08:54:52.660 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2023-11-29T08:54:52.686 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-7483.g412bf 12/12 2023-11-29T08:54:52.798 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-osd-2:18.0.0-7483.g412bfade.el9.x86_64 30/33 2023-11-29T08:54:52.825 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-osd-2:18.0.0-7483.g412bfade.el9.x86_64 30/33 2023-11-29T08:54:52.825 INFO:teuthology.orchestra.run.smithi027.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-29T08:54:52.825 INFO:teuthology.orchestra.run.smithi027.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-11-29T08:54:52.826 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-29T08:54:52.826 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-29T08:54:52.826 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:54:53.765 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-mon-2:18.0.0-7483.g412bfade.el9.x86_64 31/33 2023-11-29T08:54:53.789 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-mon-2:18.0.0-7483.g412bfade.el9.x86_64 31/33 2023-11-29T08:54:53.789 INFO:teuthology.orchestra.run.smithi027.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-29T08:54:53.789 INFO:teuthology.orchestra.run.smithi027.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-11-29T08:54:53.789 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-29T08:54:53.789 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-29T08:54:53.789 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:54:53.999 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-mds-2:18.0.0-7483.g412bfade.el9.x86_64 32/33 2023-11-29T08:54:54.023 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-mds-2:18.0.0-7483.g412bfade.el9.x86_64 32/33 2023-11-29T08:54:54.023 INFO:teuthology.orchestra.run.smithi027.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-29T08:54:54.023 INFO:teuthology.orchestra.run.smithi027.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-11-29T08:54:54.023 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-29T08:54:54.023 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-29T08:54:54.023 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:54:54.090 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-2:18.0.0-7483.g412bfade.el9.x86_64 33/33 2023-11-29T08:54:55.180 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-7483.g412bf 12/12 2023-11-29T08:54:55.180 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-7483.g412bf 1/12 2023-11-29T08:54:55.180 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2023-11-29T08:54:55.180 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2023-11-29T08:54:55.181 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2023-11-29T08:54:55.181 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2023-11-29T08:54:55.181 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2023-11-29T08:54:55.181 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 7/12 2023-11-29T08:54:55.181 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 8/12 2023-11-29T08:54:55.181 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 9/12 2023-11-29T08:54:55.181 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 10/12 2023-11-29T08:54:55.181 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 11/12 2023-11-29T08:54:55.665 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 12/12 2023-11-29T08:54:55.665 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:54:55.665 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2023-11-29T08:54:55.665 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-diskprediction-local-2:18.0.0-7483.g412bfade.el9.noarch 2023-11-29T08:54:55.665 INFO:teuthology.orchestra.run.smithi139.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-11-29T08:54:55.666 INFO:teuthology.orchestra.run.smithi139.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-11-29T08:54:55.666 INFO:teuthology.orchestra.run.smithi139.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-11-29T08:54:55.666 INFO:teuthology.orchestra.run.smithi139.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-11-29T08:54:55.666 INFO:teuthology.orchestra.run.smithi139.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-11-29T08:54:55.666 INFO:teuthology.orchestra.run.smithi139.stdout: openblas-0.3.21-2.el9.x86_64 2023-11-29T08:54:55.666 INFO:teuthology.orchestra.run.smithi139.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-11-29T08:54:55.666 INFO:teuthology.orchestra.run.smithi139.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-11-29T08:54:55.666 INFO:teuthology.orchestra.run.smithi139.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-11-29T08:54:55.666 INFO:teuthology.orchestra.run.smithi139.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-11-29T08:54:55.666 INFO:teuthology.orchestra.run.smithi139.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-11-29T08:54:55.666 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:54:55.667 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2023-11-29T08:54:56.013 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install ceph-mgr-rook 2023-11-29T08:54:56.601 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:06:10 ago on Wed 29 Nov 2023 08:48:46 AM UTC. 2023-11-29T08:54:56.748 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2023-11-29T08:54:56.749 INFO:teuthology.orchestra.run.smithi139.stdout:======================================================================================== 2023-11-29T08:54:56.749 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repository Size 2023-11-29T08:54:56.749 INFO:teuthology.orchestra.run.smithi139.stdout:======================================================================================== 2023-11-29T08:54:56.749 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2023-11-29T08:54:56.749 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-rook noarch 2:18.0.0-7483.g412bfade.el9 ceph-noarch 50 k 2023-11-29T08:54:56.750 INFO:teuthology.orchestra.run.smithi139.stdout:Installing dependencies: 2023-11-29T08:54:56.750 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-11-29T08:54:56.750 INFO:teuthology.orchestra.run.smithi139.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-11-29T08:54:56.750 INFO:teuthology.orchestra.run.smithi139.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-11-29T08:54:56.750 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-11-29T08:54:56.750 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-11-29T08:54:56.750 INFO:teuthology.orchestra.run.smithi139.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-11-29T08:54:56.750 INFO:teuthology.orchestra.run.smithi139.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-11-29T08:54:56.750 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-11-29T08:54:56.750 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-11-29T08:54:56.750 INFO:teuthology.orchestra.run.smithi139.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-11-29T08:54:56.750 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-11-29T08:54:56.751 INFO:teuthology.orchestra.run.smithi139.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-11-29T08:54:56.751 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:54:56.751 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2023-11-29T08:54:56.751 INFO:teuthology.orchestra.run.smithi139.stdout:======================================================================================== 2023-11-29T08:54:56.751 INFO:teuthology.orchestra.run.smithi139.stdout:Install 13 Packages 2023-11-29T08:54:56.751 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:54:56.751 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 2.0 M 2023-11-29T08:54:56.751 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 26 M 2023-11-29T08:54:56.752 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2023-11-29T08:54:56.918 INFO:teuthology.orchestra.run.smithi139.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 210 kB/s | 24 kB 00:00 2023-11-29T08:54:56.943 INFO:teuthology.orchestra.run.smithi139.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 128 kB/s | 18 kB 00:00 2023-11-29T08:54:56.994 INFO:teuthology.orchestra.run.smithi139.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.3 MB/s | 174 kB 00:00 2023-11-29T08:54:57.019 INFO:teuthology.orchestra.run.smithi139.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 132 kB 00:00 2023-11-29T08:54:57.044 INFO:teuthology.orchestra.run.smithi139.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 4.1 MB/s | 211 kB 00:00 2023-11-29T08:54:57.069 INFO:teuthology.orchestra.run.smithi139.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 854 kB/s | 43 kB 00:00 2023-11-29T08:54:57.095 INFO:teuthology.orchestra.run.smithi139.stdout:(7/13): ceph-mgr-rook-18.0.0-7483.g412bfade.el9 171 kB/s | 50 kB 00:00 2023-11-29T08:54:57.153 INFO:teuthology.orchestra.run.smithi139.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 180 kB/s | 15 kB 00:00 2023-11-29T08:54:57.170 INFO:teuthology.orchestra.run.smithi139.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 256 kB/s | 32 kB 00:00 2023-11-29T08:54:57.246 INFO:teuthology.orchestra.run.smithi139.stdout:(10/13): python3-google-auth-2.23.4-1.el9.noarc 1.3 MB/s | 197 kB 00:00 2023-11-29T08:54:57.262 INFO:teuthology.orchestra.run.smithi139.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 642 kB/s | 59 kB 00:00 2023-11-29T08:54:57.304 INFO:teuthology.orchestra.run.smithi139.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.5 MB/s | 90 kB 00:00 2023-11-29T08:54:57.346 INFO:teuthology.orchestra.run.smithi139.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 5.3 MB/s | 1.0 MB 00:00 2023-11-29T08:54:57.348 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2023-11-29T08:54:57.348 INFO:teuthology.orchestra.run.smithi139.stdout:Total 3.4 MB/s | 2.0 MB 00:00 2023-11-29T08:54:57.349 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2023-11-29T08:54:57.361 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2023-11-29T08:54:57.361 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2023-11-29T08:54:57.457 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2023-11-29T08:54:57.457 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2023-11-29T08:54:57.968 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2023-11-29T08:54:58.135 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2023-11-29T08:54:58.196 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2023-11-29T08:54:58.261 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2023-11-29T08:54:58.298 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2023-11-29T08:54:58.339 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2023-11-29T08:54:58.431 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2023-11-29T08:54:58.541 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 7/13 2023-11-29T08:54:58.591 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2023-11-29T08:54:59.307 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2023-11-29T08:54:59.356 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2023-11-29T08:54:59.390 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2023-11-29T08:54:59.429 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2023-11-29T08:54:59.452 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-rook-2:18.0.0-7483.g412bfade.el9.noarch 13/13 2023-11-29T08:55:00.210 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-7483.g412bfade.el9.noarch 13/13 2023-11-29T08:55:00.219 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-rook-2:18.0.0-7483.g412bfade.el9.noarch 1/13 2023-11-29T08:55:00.220 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2023-11-29T08:55:00.220 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2023-11-29T08:55:00.220 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2023-11-29T08:55:00.220 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2023-11-29T08:55:00.220 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2023-11-29T08:55:00.220 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2023-11-29T08:55:00.220 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2023-11-29T08:55:00.220 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2023-11-29T08:55:00.220 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 10/13 2023-11-29T08:55:00.220 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2023-11-29T08:55:00.220 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2023-11-29T08:55:00.577 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2023-11-29T08:55:00.578 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:55:00.578 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2023-11-29T08:55:00.578 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-rook-2:18.0.0-7483.g412bfade.el9.noarch 2023-11-29T08:55:00.578 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-11-29T08:55:00.578 INFO:teuthology.orchestra.run.smithi139.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-11-29T08:55:00.578 INFO:teuthology.orchestra.run.smithi139.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-11-29T08:55:00.578 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-11-29T08:55:00.578 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-11-29T08:55:00.578 INFO:teuthology.orchestra.run.smithi139.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-11-29T08:55:00.578 INFO:teuthology.orchestra.run.smithi139.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-11-29T08:55:00.578 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-11-29T08:55:00.578 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-11-29T08:55:00.579 INFO:teuthology.orchestra.run.smithi139.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-11-29T08:55:00.579 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rsa-4.9-2.el9.noarch 2023-11-29T08:55:00.579 INFO:teuthology.orchestra.run.smithi139.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-11-29T08:55:00.579 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:55:00.579 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2023-11-29T08:55:00.849 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install ceph-mgr-cephadm 2023-11-29T08:55:01.427 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:06:15 ago on Wed 29 Nov 2023 08:48:46 AM UTC. 2023-11-29T08:55:01.571 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2023-11-29T08:55:01.572 INFO:teuthology.orchestra.run.smithi139.stdout:======================================================================================== 2023-11-29T08:55:01.572 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repository Size 2023-11-29T08:55:01.572 INFO:teuthology.orchestra.run.smithi139.stdout:======================================================================================== 2023-11-29T08:55:01.572 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2023-11-29T08:55:01.572 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-cephadm noarch 2:18.0.0-7483.g412bfade.el9 ceph-noarch 133 k 2023-11-29T08:55:01.572 INFO:teuthology.orchestra.run.smithi139.stdout:Installing dependencies: 2023-11-29T08:55:01.572 INFO:teuthology.orchestra.run.smithi139.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-11-29T08:55:01.572 INFO:teuthology.orchestra.run.smithi139.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-11-29T08:55:01.572 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-11-29T08:55:01.572 INFO:teuthology.orchestra.run.smithi139.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-11-29T08:55:01.572 INFO:teuthology.orchestra.run.smithi139.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-11-29T08:55:01.572 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:55:01.572 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2023-11-29T08:55:01.573 INFO:teuthology.orchestra.run.smithi139.stdout:======================================================================================== 2023-11-29T08:55:01.573 INFO:teuthology.orchestra.run.smithi139.stdout:Install 6 Packages 2023-11-29T08:55:01.573 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:55:01.573 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 6.8 M 2023-11-29T08:55:01.573 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 33 M 2023-11-29T08:55:01.573 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2023-11-29T08:55:01.916 INFO:teuthology.orchestra.run.smithi139.stdout:(1/6): python3-jinja2-2.11.3-4.el9.noarch.rpm 1.4 MB/s | 228 kB 00:00 2023-11-29T08:55:02.000 INFO:teuthology.orchestra.run.smithi139.stdout:(2/6): ceph-mgr-cephadm-18.0.0-7483.g412bfade.e 538 kB/s | 133 kB 00:00 2023-11-29T08:55:02.109 INFO:teuthology.orchestra.run.smithi139.stdout:(3/6): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 5.8 MB 00:00 2023-11-29T08:55:02.650 INFO:teuthology.orchestra.run.smithi139.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 92 kB/s | 58 kB 00:00 2023-11-29T08:55:02.759 INFO:teuthology.orchestra.run.smithi139.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 81 kB/s | 51 kB 00:00 2023-11-29T08:55:02.817 INFO:teuthology.orchestra.run.smithi139.stdout:(6/6): python3-asyncssh-2.13.2-3.el9.noarch.rpm 609 kB/s | 548 kB 00:00 2023-11-29T08:55:02.822 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2023-11-29T08:55:02.822 INFO:teuthology.orchestra.run.smithi139.stdout:Total 5.4 MB/s | 6.8 MB 00:01 2023-11-29T08:55:02.822 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2023-11-29T08:55:02.832 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2023-11-29T08:55:02.832 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2023-11-29T08:55:02.923 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2023-11-29T08:55:02.923 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2023-11-29T08:55:03.252 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2023-11-29T08:55:03.427 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2023-11-29T08:55:03.478 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 2/6 2023-11-29T08:55:03.837 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-2:18.0.0-7483.g412bfade.el9.x86_64 33/33 2023-11-29T08:55:03.837 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-2:18.0.0-7483.g412bfade.el9.x86_64 1/33 2023-11-29T08:55:03.837 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-mds-2:18.0.0-7483.g412bfade.el9.x86_64 2/33 2023-11-29T08:55:03.837 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-mgr-2:18.0.0-7483.g412bfade.el9.x86_64 3/33 2023-11-29T08:55:03.837 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-mon-2:18.0.0-7483.g412bfade.el9.x86_64 4/33 2023-11-29T08:55:03.837 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-osd-2:18.0.0-7483.g412bfade.el9.x86_64 5/33 2023-11-29T08:55:03.837 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-7483.g412bfade.el9. 6/33 2023-11-29T08:55:03.837 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 7/33 2023-11-29T08:55:03.838 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 8/33 2023-11-29T08:55:03.838 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 9/33 2023-11-29T08:55:03.838 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 10/33 2023-11-29T08:55:03.838 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 11/33 2023-11-29T08:55:03.838 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 12/33 2023-11-29T08:55:03.838 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-ply-3.11-14.el9.noarch 13/33 2023-11-29T08:55:03.838 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 14/33 2023-11-29T08:55:03.838 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 15/33 2023-11-29T08:55:03.838 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 16/33 2023-11-29T08:55:03.838 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2023-11-29T08:55:03.838 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2023-11-29T08:55:03.838 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2023-11-29T08:55:03.838 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2023-11-29T08:55:03.838 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2023-11-29T08:55:03.839 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2023-11-29T08:55:03.839 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2023-11-29T08:55:03.839 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2023-11-29T08:55:03.839 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2023-11-29T08:55:03.839 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2023-11-29T08:55:03.839 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2023-11-29T08:55:03.839 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2023-11-29T08:55:03.839 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2023-11-29T08:55:03.839 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2023-11-29T08:55:03.839 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2023-11-29T08:55:03.839 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2023-11-29T08:55:04.006 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2023-11-29T08:55:04.088 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2023-11-29T08:55:04.148 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 5/6 2023-11-29T08:55:04.172 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-7483.g412bfade.el9.noarch 6/6 2023-11-29T08:55:04.999 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-7483.g412bfade.el9.noarch 6/6 2023-11-29T08:55:04.999 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-7483.g412bfade.el9.noarch 1/6 2023-11-29T08:55:04.999 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2023-11-29T08:55:04.999 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 3/6 2023-11-29T08:55:04.999 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 4/6 2023-11-29T08:55:04.999 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2023-11-29T08:55:05.034 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2023-11-29T08:55:05.034 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:55:05.034 INFO:teuthology.orchestra.run.smithi027.stdout:Installed: 2023-11-29T08:55:05.034 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-2:18.0.0-7483.g412bfade.el9.x86_64 2023-11-29T08:55:05.034 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mds-2:18.0.0-7483.g412bfade.el9.x86_64 2023-11-29T08:55:05.034 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-2:18.0.0-7483.g412bfade.el9.x86_64 2023-11-29T08:55:05.034 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-modules-core-2:18.0.0-7483.g412bfade.el9.noarch 2023-11-29T08:55:05.034 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mon-2:18.0.0-7483.g412bfade.el9.x86_64 2023-11-29T08:55:05.034 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-osd-2:18.0.0-7483.g412bfade.el9.x86_64 2023-11-29T08:55:05.034 INFO:teuthology.orchestra.run.smithi027.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-11-29T08:55:05.034 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-11-29T08:55:05.034 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-11-29T08:55:05.035 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-11-29T08:55:05.035 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-11-29T08:55:05.035 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-11-29T08:55:05.035 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-11-29T08:55:05.035 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-11-29T08:55:05.035 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-11-29T08:55:05.035 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-11-29T08:55:05.035 INFO:teuthology.orchestra.run.smithi027.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-11-29T08:55:05.035 INFO:teuthology.orchestra.run.smithi027.stdout: python3-mako-1.1.4-6.el9.noarch 2023-11-29T08:55:05.035 INFO:teuthology.orchestra.run.smithi027.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-11-29T08:55:05.035 INFO:teuthology.orchestra.run.smithi027.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-11-29T08:55:05.035 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-11-29T08:55:05.035 INFO:teuthology.orchestra.run.smithi027.stdout: python3-ply-3.11-14.el9.noarch 2023-11-29T08:55:05.035 INFO:teuthology.orchestra.run.smithi027.stdout: python3-portend-3.1.0-2.el9.noarch 2023-11-29T08:55:05.035 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-11-29T08:55:05.036 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pycparser-2.20-6.el9.noarch 2023-11-29T08:55:05.036 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pytz-2021.1-5.el9.noarch 2023-11-29T08:55:05.036 INFO:teuthology.orchestra.run.smithi027.stdout: python3-requests-2.25.1-7.el9.noarch 2023-11-29T08:55:05.036 INFO:teuthology.orchestra.run.smithi027.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-11-29T08:55:05.036 INFO:teuthology.orchestra.run.smithi027.stdout: python3-toml-0.10.2-6.el9.noarch 2023-11-29T08:55:05.036 INFO:teuthology.orchestra.run.smithi027.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-11-29T08:55:05.036 INFO:teuthology.orchestra.run.smithi027.stdout: python3-webob-1.8.7-6.el9.noarch 2023-11-29T08:55:05.036 INFO:teuthology.orchestra.run.smithi027.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-11-29T08:55:05.036 INFO:teuthology.orchestra.run.smithi027.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-11-29T08:55:05.036 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:55:05.036 INFO:teuthology.orchestra.run.smithi027.stdout:Complete! 2023-11-29T08:55:05.310 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum -y install ceph-base 2023-11-29T08:55:05.335 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2023-11-29T08:55:05.335 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:55:05.335 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2023-11-29T08:55:05.335 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-cephadm-2:18.0.0-7483.g412bfade.el9.noarch 2023-11-29T08:55:05.335 INFO:teuthology.orchestra.run.smithi139.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-11-29T08:55:05.335 INFO:teuthology.orchestra.run.smithi139.stdout: python3-babel-2.9.1-2.el9.noarch 2023-11-29T08:55:05.335 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-11-29T08:55:05.335 INFO:teuthology.orchestra.run.smithi139.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-11-29T08:55:05.335 INFO:teuthology.orchestra.run.smithi139.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-11-29T08:55:05.336 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:55:05.336 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2023-11-29T08:55:05.592 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install ceph-fuse 2023-11-29T08:55:05.932 INFO:teuthology.orchestra.run.smithi027.stdout:Last metadata expiration check: 0:06:18 ago on Wed 29 Nov 2023 08:48:47 AM UTC. 2023-11-29T08:55:06.031 INFO:teuthology.orchestra.run.smithi027.stdout:Package ceph-base-2:18.0.0-7483.g412bfade.el9.x86_64 is already installed. 2023-11-29T08:55:06.084 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. 2023-11-29T08:55:06.085 INFO:teuthology.orchestra.run.smithi027.stdout:Nothing to do. 2023-11-29T08:55:06.085 INFO:teuthology.orchestra.run.smithi027.stdout:Complete! 2023-11-29T08:55:06.146 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum -y install cephadm 2023-11-29T08:55:06.185 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:06:20 ago on Wed 29 Nov 2023 08:48:46 AM UTC. 2023-11-29T08:55:06.339 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2023-11-29T08:55:06.340 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2023-11-29T08:55:06.340 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repository Size 2023-11-29T08:55:06.340 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2023-11-29T08:55:06.340 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2023-11-29T08:55:06.340 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-fuse x86_64 2:18.0.0-7483.g412bfade.el9 ceph 833 k 2023-11-29T08:55:06.340 INFO:teuthology.orchestra.run.smithi139.stdout:Installing dependencies: 2023-11-29T08:55:06.340 INFO:teuthology.orchestra.run.smithi139.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-11-29T08:55:06.341 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:55:06.341 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2023-11-29T08:55:06.341 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2023-11-29T08:55:06.341 INFO:teuthology.orchestra.run.smithi139.stdout:Install 2 Packages 2023-11-29T08:55:06.341 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:55:06.341 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 911 k 2023-11-29T08:55:06.341 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 3.0 M 2023-11-29T08:55:06.342 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2023-11-29T08:55:06.478 INFO:teuthology.orchestra.run.smithi139.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 579 kB/s | 79 kB 00:00 2023-11-29T08:55:06.694 INFO:teuthology.orchestra.run.smithi139.stdout:(2/2): ceph-fuse-18.0.0-7483.g412bfade.el9.x86_ 2.3 MB/s | 833 kB 00:00 2023-11-29T08:55:06.696 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2023-11-29T08:55:06.696 INFO:teuthology.orchestra.run.smithi139.stdout:Total 2.5 MB/s | 911 kB 00:00 2023-11-29T08:55:06.696 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2023-11-29T08:55:06.717 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2023-11-29T08:55:06.718 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2023-11-29T08:55:06.759 INFO:teuthology.orchestra.run.smithi027.stdout:Last metadata expiration check: 0:06:19 ago on Wed 29 Nov 2023 08:48:47 AM UTC. 2023-11-29T08:55:06.799 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2023-11-29T08:55:06.800 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2023-11-29T08:55:06.911 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. 2023-11-29T08:55:06.912 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2023-11-29T08:55:06.912 INFO:teuthology.orchestra.run.smithi027.stdout: Package Arch Version Repository Size 2023-11-29T08:55:06.912 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2023-11-29T08:55:06.912 INFO:teuthology.orchestra.run.smithi027.stdout:Installing: 2023-11-29T08:55:06.912 INFO:teuthology.orchestra.run.smithi027.stdout: cephadm noarch 2:18.0.0-7483.g412bfade.el9 ceph-noarch 774 k 2023-11-29T08:55:06.912 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:55:06.912 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction Summary 2023-11-29T08:55:06.912 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2023-11-29T08:55:06.912 INFO:teuthology.orchestra.run.smithi027.stdout:Install 1 Package 2023-11-29T08:55:06.912 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:55:06.913 INFO:teuthology.orchestra.run.smithi027.stdout:Total download size: 774 k 2023-11-29T08:55:06.913 INFO:teuthology.orchestra.run.smithi027.stdout:Installed size: 788 k 2023-11-29T08:55:06.913 INFO:teuthology.orchestra.run.smithi027.stdout:Downloading Packages: 2023-11-29T08:55:07.001 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2023-11-29T08:55:07.158 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2023-11-29T08:55:07.206 INFO:teuthology.orchestra.run.smithi027.stdout:cephadm-18.0.0-7483.g412bfade.el9.noarch.rpm 2.6 MB/s | 774 kB 00:00 2023-11-29T08:55:07.207 INFO:teuthology.orchestra.run.smithi027.stdout:-------------------------------------------------------------------------------- 2023-11-29T08:55:07.207 INFO:teuthology.orchestra.run.smithi027.stdout:Total 2.6 MB/s | 774 kB 00:00 2023-11-29T08:55:07.207 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction check 2023-11-29T08:55:07.213 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction check succeeded. 2023-11-29T08:55:07.213 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction test 2023-11-29T08:55:07.219 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction test succeeded. 2023-11-29T08:55:07.219 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction 2023-11-29T08:55:07.228 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-fuse-2:18.0.0-7483.g412bfade.el9.x86_64 2/2 2023-11-29T08:55:07.293 INFO:teuthology.orchestra.run.smithi027.stdout: Preparing : 1/1 2023-11-29T08:55:07.791 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: cephadm-2:18.0.0-7483.g412bfade.el9.noarch 1/1 2023-11-29T08:55:07.880 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : cephadm-2:18.0.0-7483.g412bfade.el9.noarch 1/1 2023-11-29T08:55:07.921 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-fuse-2:18.0.0-7483.g412bfade.el9.x86_64 2/2 2023-11-29T08:55:07.921 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-fuse-2:18.0.0-7483.g412bfade.el9.x86_64 1/2 2023-11-29T08:55:08.251 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: cephadm-2:18.0.0-7483.g412bfade.el9.noarch 1/1 2023-11-29T08:55:08.274 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2023-11-29T08:55:08.274 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:55:08.275 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2023-11-29T08:55:08.275 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-fuse-2:18.0.0-7483.g412bfade.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2023-11-29T08:55:08.275 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:55:08.275 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2023-11-29T08:55:08.553 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install ceph-volume 2023-11-29T08:55:08.556 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : cephadm-2:18.0.0-7483.g412bfade.el9.noarch 1/1 2023-11-29T08:55:08.556 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:55:08.556 INFO:teuthology.orchestra.run.smithi027.stdout:Installed: 2023-11-29T08:55:08.556 INFO:teuthology.orchestra.run.smithi027.stdout: cephadm-2:18.0.0-7483.g412bfade.el9.noarch 2023-11-29T08:55:08.556 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:55:08.556 INFO:teuthology.orchestra.run.smithi027.stdout:Complete! 2023-11-29T08:55:08.799 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum -y install ceph-immutable-object-cache 2023-11-29T08:55:09.153 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:06:23 ago on Wed 29 Nov 2023 08:48:46 AM UTC. 2023-11-29T08:55:09.298 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2023-11-29T08:55:09.299 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2023-11-29T08:55:09.299 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repository Size 2023-11-29T08:55:09.299 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2023-11-29T08:55:09.299 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2023-11-29T08:55:09.299 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-volume noarch 2:18.0.0-7483.g412bfade.el9 ceph-noarch 262 k 2023-11-29T08:55:09.299 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:55:09.299 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2023-11-29T08:55:09.300 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2023-11-29T08:55:09.300 INFO:teuthology.orchestra.run.smithi139.stdout:Install 1 Package 2023-11-29T08:55:09.300 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:55:09.300 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 262 k 2023-11-29T08:55:09.300 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 1.2 M 2023-11-29T08:55:09.300 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2023-11-29T08:55:09.404 INFO:teuthology.orchestra.run.smithi027.stdout:Last metadata expiration check: 0:06:22 ago on Wed 29 Nov 2023 08:48:47 AM UTC. 2023-11-29T08:55:09.532 INFO:teuthology.orchestra.run.smithi139.stdout:ceph-volume-18.0.0-7483.g412bfade.el9.noarch.rp 1.1 MB/s | 262 kB 00:00 2023-11-29T08:55:09.532 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2023-11-29T08:55:09.533 INFO:teuthology.orchestra.run.smithi139.stdout:Total 1.1 MB/s | 262 kB 00:00 2023-11-29T08:55:09.533 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2023-11-29T08:55:09.541 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2023-11-29T08:55:09.541 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2023-11-29T08:55:09.555 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. 2023-11-29T08:55:09.556 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2023-11-29T08:55:09.556 INFO:teuthology.orchestra.run.smithi027.stdout: Package Arch Version Repo Size 2023-11-29T08:55:09.556 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2023-11-29T08:55:09.556 INFO:teuthology.orchestra.run.smithi027.stdout:Installing: 2023-11-29T08:55:09.556 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-7483.g412bfade.el9 ceph 143 k 2023-11-29T08:55:09.556 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:55:09.556 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction Summary 2023-11-29T08:55:09.556 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2023-11-29T08:55:09.556 INFO:teuthology.orchestra.run.smithi027.stdout:Install 1 Package 2023-11-29T08:55:09.556 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:55:09.557 INFO:teuthology.orchestra.run.smithi027.stdout:Total download size: 143 k 2023-11-29T08:55:09.557 INFO:teuthology.orchestra.run.smithi027.stdout:Installed size: 437 k 2023-11-29T08:55:09.557 INFO:teuthology.orchestra.run.smithi027.stdout:Downloading Packages: 2023-11-29T08:55:09.572 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2023-11-29T08:55:09.572 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2023-11-29T08:55:09.787 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2023-11-29T08:55:09.788 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-immutable-object-cache-18.0.0-7483.g412bfa 621 kB/s | 143 kB 00:00 2023-11-29T08:55:09.788 INFO:teuthology.orchestra.run.smithi027.stdout:-------------------------------------------------------------------------------- 2023-11-29T08:55:09.788 INFO:teuthology.orchestra.run.smithi027.stdout:Total 617 kB/s | 143 kB 00:00 2023-11-29T08:55:09.789 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction check 2023-11-29T08:55:09.797 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction check succeeded. 2023-11-29T08:55:09.797 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction test 2023-11-29T08:55:09.850 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-volume-2:18.0.0-7483.g412bfade.el9.noarch 1/1 2023-11-29T08:55:09.852 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction test succeeded. 2023-11-29T08:55:09.852 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction 2023-11-29T08:55:09.866 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-volume-2:18.0.0-7483.g412bfade.el9.noarch 1/1 2023-11-29T08:55:09.866 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-29T08:55:09.866 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-11-29T08:55:09.866 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:55:09.994 INFO:teuthology.orchestra.run.smithi027.stdout: Preparing : 1/1 2023-11-29T08:55:10.064 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-7483.g412bfade. 1/1 2023-11-29T08:55:10.090 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-7483.g412bfade. 1/1 2023-11-29T08:55:10.090 INFO:teuthology.orchestra.run.smithi027.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-29T08:55:10.090 INFO:teuthology.orchestra.run.smithi027.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-11-29T08:55:10.090 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:55:10.882 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-volume-2:18.0.0-7483.g412bfade.el9.noarch 1/1 2023-11-29T08:55:10.883 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:55:10.883 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2023-11-29T08:55:10.883 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-volume-2:18.0.0-7483.g412bfade.el9.noarch 2023-11-29T08:55:10.883 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:55:10.883 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2023-11-29T08:55:11.056 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-7483.g412bfade. 1/1 2023-11-29T08:55:11.056 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:55:11.056 INFO:teuthology.orchestra.run.smithi027.stdout:Installed: 2023-11-29T08:55:11.056 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-immutable-object-cache-2:18.0.0-7483.g412bfade.el9.x86_64 2023-11-29T08:55:11.056 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:55:11.056 INFO:teuthology.orchestra.run.smithi027.stdout:Complete! 2023-11-29T08:55:11.187 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install librados-devel 2023-11-29T08:55:11.270 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum -y install ceph-mgr 2023-11-29T08:55:11.782 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:06:25 ago on Wed 29 Nov 2023 08:48:46 AM UTC. 2023-11-29T08:55:11.878 INFO:teuthology.orchestra.run.smithi027.stdout:Last metadata expiration check: 0:06:24 ago on Wed 29 Nov 2023 08:48:47 AM UTC. 2023-11-29T08:55:11.928 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2023-11-29T08:55:11.929 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2023-11-29T08:55:11.929 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repo Size 2023-11-29T08:55:11.929 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2023-11-29T08:55:11.929 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2023-11-29T08:55:11.929 INFO:teuthology.orchestra.run.smithi139.stdout: librados-devel x86_64 2:18.0.0-7483.g412bfade.el9 ceph 127 k 2023-11-29T08:55:11.929 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:55:11.929 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2023-11-29T08:55:11.929 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2023-11-29T08:55:11.929 INFO:teuthology.orchestra.run.smithi139.stdout:Install 1 Package 2023-11-29T08:55:11.929 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:55:11.930 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 127 k 2023-11-29T08:55:11.930 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 456 k 2023-11-29T08:55:11.930 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2023-11-29T08:55:11.976 INFO:teuthology.orchestra.run.smithi027.stdout:Package ceph-mgr-2:18.0.0-7483.g412bfade.el9.x86_64 is already installed. 2023-11-29T08:55:12.028 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. 2023-11-29T08:55:12.029 INFO:teuthology.orchestra.run.smithi027.stdout:Nothing to do. 2023-11-29T08:55:12.029 INFO:teuthology.orchestra.run.smithi027.stdout:Complete! 2023-11-29T08:55:12.088 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum -y install ceph-mgr-dashboard 2023-11-29T08:55:12.427 INFO:teuthology.orchestra.run.smithi139.stdout:librados-devel-18.0.0-7483.g412bfade.el9.x86_64 255 kB/s | 127 kB 00:00 2023-11-29T08:55:12.428 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2023-11-29T08:55:12.428 INFO:teuthology.orchestra.run.smithi139.stdout:Total 254 kB/s | 127 kB 00:00 2023-11-29T08:55:12.428 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2023-11-29T08:55:12.434 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2023-11-29T08:55:12.434 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2023-11-29T08:55:12.489 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2023-11-29T08:55:12.490 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2023-11-29T08:55:12.629 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2023-11-29T08:55:12.695 INFO:teuthology.orchestra.run.smithi027.stdout:Last metadata expiration check: 0:06:25 ago on Wed 29 Nov 2023 08:48:47 AM UTC. 2023-11-29T08:55:12.733 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : librados-devel-2:18.0.0-7483.g412bfade.el9.x86_64 1/1 2023-11-29T08:55:12.847 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. 2023-11-29T08:55:12.848 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2023-11-29T08:55:12.848 INFO:teuthology.orchestra.run.smithi027.stdout: Package Arch Version Repository Size 2023-11-29T08:55:12.849 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2023-11-29T08:55:12.849 INFO:teuthology.orchestra.run.smithi027.stdout:Installing: 2023-11-29T08:55:12.849 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-dashboard noarch 2:18.0.0-7483.g412bfade.el9 ceph-noarch 1.8 M 2023-11-29T08:55:12.849 INFO:teuthology.orchestra.run.smithi027.stdout:Installing dependencies: 2023-11-29T08:55:12.849 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-grafana-dashboards noarch 2:18.0.0-7483.g412bfade.el9 ceph-noarch 28 k 2023-11-29T08:55:12.849 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-prometheus-alerts noarch 2:18.0.0-7483.g412bfade.el9 ceph-noarch 15 k 2023-11-29T08:55:12.849 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-11-29T08:55:12.849 INFO:teuthology.orchestra.run.smithi027.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-11-29T08:55:12.849 INFO:teuthology.orchestra.run.smithi027.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-11-29T08:55:12.849 INFO:teuthology.orchestra.run.smithi027.stdout:Installing weak dependencies: 2023-11-29T08:55:12.849 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-11-29T08:55:12.849 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:55:12.849 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction Summary 2023-11-29T08:55:12.850 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2023-11-29T08:55:12.850 INFO:teuthology.orchestra.run.smithi027.stdout:Install 7 Packages 2023-11-29T08:55:12.850 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:55:12.850 INFO:teuthology.orchestra.run.smithi027.stdout:Total download size: 2.1 M 2023-11-29T08:55:12.850 INFO:teuthology.orchestra.run.smithi027.stdout:Installed size: 8.7 M 2023-11-29T08:55:12.850 INFO:teuthology.orchestra.run.smithi027.stdout:Downloading Packages: 2023-11-29T08:55:13.168 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librados-devel-2:18.0.0-7483.g412bfade.el9.x86_64 1/1 2023-11-29T08:55:13.400 INFO:teuthology.orchestra.run.smithi027.stdout:(1/7): ceph-grafana-dashboards-18.0.0-7483.g412 148 kB/s | 28 kB 00:00 2023-11-29T08:55:13.425 INFO:teuthology.orchestra.run.smithi027.stdout:(2/7): ceph-prometheus-alerts-18.0.0-7483.g412b 70 kB/s | 15 kB 00:00 2023-11-29T08:55:13.494 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librados-devel-2:18.0.0-7483.g412bfade.el9.x86_64 1/1 2023-11-29T08:55:13.494 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:55:13.495 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2023-11-29T08:55:13.495 INFO:teuthology.orchestra.run.smithi139.stdout: librados-devel-2:18.0.0-7483.g412bfade.el9.x86_64 2023-11-29T08:55:13.495 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:55:13.495 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2023-11-29T08:55:13.542 INFO:teuthology.orchestra.run.smithi027.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 64 kB/s | 9.0 kB 00:00 2023-11-29T08:55:13.601 INFO:teuthology.orchestra.run.smithi027.stdout:(4/7): python3-jwt-2.4.0-1.el9.noarch.rpm 233 kB/s | 41 kB 00:00 2023-11-29T08:55:13.626 INFO:teuthology.orchestra.run.smithi027.stdout:(5/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 368 kB/s | 31 kB 00:00 2023-11-29T08:55:13.685 INFO:teuthology.orchestra.run.smithi027.stdout:(6/7): python3-routes-2.5.1-5.el9.noarch.rpm 2.2 MB/s | 188 kB 00:00 2023-11-29T08:55:13.755 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install libcephfs2 2023-11-29T08:55:14.350 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:06:28 ago on Wed 29 Nov 2023 08:48:46 AM UTC. 2023-11-29T08:55:14.445 INFO:teuthology.orchestra.run.smithi139.stdout:Package libcephfs2-2:18.0.0-7483.g412bfade.el9.x86_64 is already installed. 2023-11-29T08:55:14.495 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2023-11-29T08:55:14.496 INFO:teuthology.orchestra.run.smithi139.stdout:Nothing to do. 2023-11-29T08:55:14.497 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2023-11-29T08:55:14.568 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install libcephfs-devel 2023-11-29T08:55:14.635 INFO:teuthology.orchestra.run.smithi027.stdout:(7/7): ceph-mgr-dashboard-18.0.0-7483.g412bfade 1.2 MB/s | 1.8 MB 00:01 2023-11-29T08:55:14.639 INFO:teuthology.orchestra.run.smithi027.stdout:-------------------------------------------------------------------------------- 2023-11-29T08:55:14.639 INFO:teuthology.orchestra.run.smithi027.stdout:Total 1.2 MB/s | 2.1 MB 00:01 2023-11-29T08:55:14.639 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction check 2023-11-29T08:55:14.649 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction check succeeded. 2023-11-29T08:55:14.649 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction test 2023-11-29T08:55:14.728 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction test succeeded. 2023-11-29T08:55:14.729 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction 2023-11-29T08:55:15.035 INFO:teuthology.orchestra.run.smithi027.stdout: Preparing : 1/1 2023-11-29T08:55:15.103 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2023-11-29T08:55:15.137 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2023-11-29T08:55:15.148 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:06:29 ago on Wed 29 Nov 2023 08:48:46 AM UTC. 2023-11-29T08:55:15.176 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2023-11-29T08:55:15.207 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2023-11-29T08:55:15.229 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-7483.g412bfade.el9.n 5/7 2023-11-29T08:55:15.293 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2023-11-29T08:55:15.294 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2023-11-29T08:55:15.294 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repo Size 2023-11-29T08:55:15.294 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2023-11-29T08:55:15.294 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2023-11-29T08:55:15.294 INFO:teuthology.orchestra.run.smithi139.stdout: libcephfs-devel x86_64 2:18.0.0-7483.g412bfade.el9 ceph 31 k 2023-11-29T08:55:15.294 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:55:15.294 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2023-11-29T08:55:15.294 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2023-11-29T08:55:15.294 INFO:teuthology.orchestra.run.smithi139.stdout:Install 1 Package 2023-11-29T08:55:15.294 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:55:15.295 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 31 k 2023-11-29T08:55:15.295 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 139 k 2023-11-29T08:55:15.295 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2023-11-29T08:55:15.455 INFO:teuthology.orchestra.run.smithi139.stdout:libcephfs-devel-18.0.0-7483.g412bfade.el9.x86_6 194 kB/s | 31 kB 00:00 2023-11-29T08:55:15.455 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2023-11-29T08:55:15.456 INFO:teuthology.orchestra.run.smithi139.stdout:Total 193 kB/s | 31 kB 00:00 2023-11-29T08:55:15.456 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2023-11-29T08:55:15.459 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2023-11-29T08:55:15.459 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2023-11-29T08:55:15.465 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-7483.g412bfade.el9. 6/7 2023-11-29T08:55:15.489 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2023-11-29T08:55:15.490 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2023-11-29T08:55:15.497 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-7483.g412bfade.el9.noarc 7/7 2023-11-29T08:55:15.570 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2023-11-29T08:55:15.687 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libcephfs-devel-2:18.0.0-7483.g412bfade.el9.x86_64 1/1 2023-11-29T08:55:16.056 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-7483.g412bfade.el9.noarc 7/7 2023-11-29T08:55:16.056 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-7483.g412bfade.el9. 1/7 2023-11-29T08:55:16.056 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-7483.g412bfade.el9.noarc 2/7 2023-11-29T08:55:16.056 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-7483.g412bfade.el9.n 3/7 2023-11-29T08:55:16.056 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2023-11-29T08:55:16.056 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2023-11-29T08:55:16.056 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2023-11-29T08:55:16.108 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: libcephfs-devel-2:18.0.0-7483.g412bfade.el9.x86_64 1/1 2023-11-29T08:55:16.383 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libcephfs-devel-2:18.0.0-7483.g412bfade.el9.x86_64 1/1 2023-11-29T08:55:16.383 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:55:16.383 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2023-11-29T08:55:16.383 INFO:teuthology.orchestra.run.smithi139.stdout: libcephfs-devel-2:18.0.0-7483.g412bfade.el9.x86_64 2023-11-29T08:55:16.383 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:55:16.383 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2023-11-29T08:55:16.398 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2023-11-29T08:55:16.399 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:55:16.399 INFO:teuthology.orchestra.run.smithi027.stdout:Installed: 2023-11-29T08:55:16.399 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-grafana-dashboards-2:18.0.0-7483.g412bfade.el9.noarch 2023-11-29T08:55:16.399 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-dashboard-2:18.0.0-7483.g412bfade.el9.noarch 2023-11-29T08:55:16.399 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-prometheus-alerts-2:18.0.0-7483.g412bfade.el9.noarch 2023-11-29T08:55:16.399 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-11-29T08:55:16.399 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-11-29T08:55:16.399 INFO:teuthology.orchestra.run.smithi027.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-11-29T08:55:16.399 INFO:teuthology.orchestra.run.smithi027.stdout: python3-routes-2.5.1-5.el9.noarch 2023-11-29T08:55:16.399 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:55:16.399 INFO:teuthology.orchestra.run.smithi027.stdout:Complete! 2023-11-29T08:55:16.563 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install librados2 2023-11-29T08:55:16.624 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum -y install ceph-mgr-diskprediction-local 2023-11-29T08:55:17.151 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:06:31 ago on Wed 29 Nov 2023 08:48:46 AM UTC. 2023-11-29T08:55:17.230 INFO:teuthology.orchestra.run.smithi027.stdout:Last metadata expiration check: 0:06:30 ago on Wed 29 Nov 2023 08:48:47 AM UTC. 2023-11-29T08:55:17.247 INFO:teuthology.orchestra.run.smithi139.stdout:Package librados2-2:18.0.0-7483.g412bfade.el9.x86_64 is already installed. 2023-11-29T08:55:17.301 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2023-11-29T08:55:17.302 INFO:teuthology.orchestra.run.smithi139.stdout:Nothing to do. 2023-11-29T08:55:17.302 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2023-11-29T08:55:17.377 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install librbd1 2023-11-29T08:55:17.383 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. 2023-11-29T08:55:17.385 INFO:teuthology.orchestra.run.smithi027.stdout:============================================================================================ 2023-11-29T08:55:17.385 INFO:teuthology.orchestra.run.smithi027.stdout: Package Arch Version Repository Size 2023-11-29T08:55:17.385 INFO:teuthology.orchestra.run.smithi027.stdout:============================================================================================ 2023-11-29T08:55:17.385 INFO:teuthology.orchestra.run.smithi027.stdout:Installing: 2023-11-29T08:55:17.385 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-7483.g412bfade.el9 ceph-noarch 7.4 M 2023-11-29T08:55:17.385 INFO:teuthology.orchestra.run.smithi027.stdout:Installing dependencies: 2023-11-29T08:55:17.385 INFO:teuthology.orchestra.run.smithi027.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-11-29T08:55:17.386 INFO:teuthology.orchestra.run.smithi027.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-11-29T08:55:17.386 INFO:teuthology.orchestra.run.smithi027.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-11-29T08:55:17.386 INFO:teuthology.orchestra.run.smithi027.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-11-29T08:55:17.386 INFO:teuthology.orchestra.run.smithi027.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-11-29T08:55:17.386 INFO:teuthology.orchestra.run.smithi027.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-11-29T08:55:17.386 INFO:teuthology.orchestra.run.smithi027.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-11-29T08:55:17.386 INFO:teuthology.orchestra.run.smithi027.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-11-29T08:55:17.386 INFO:teuthology.orchestra.run.smithi027.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-11-29T08:55:17.386 INFO:teuthology.orchestra.run.smithi027.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-11-29T08:55:17.386 INFO:teuthology.orchestra.run.smithi027.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-11-29T08:55:17.386 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:55:17.386 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction Summary 2023-11-29T08:55:17.386 INFO:teuthology.orchestra.run.smithi027.stdout:============================================================================================ 2023-11-29T08:55:17.386 INFO:teuthology.orchestra.run.smithi027.stdout:Install 12 Packages 2023-11-29T08:55:17.387 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:55:17.387 INFO:teuthology.orchestra.run.smithi027.stdout:Total download size: 37 M 2023-11-29T08:55:17.387 INFO:teuthology.orchestra.run.smithi027.stdout:Installed size: 209 M 2023-11-29T08:55:17.387 INFO:teuthology.orchestra.run.smithi027.stdout:Downloading Packages: 2023-11-29T08:55:17.850 INFO:teuthology.orchestra.run.smithi027.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 162 kB/s | 32 kB 00:00 2023-11-29T08:55:17.908 INFO:teuthology.orchestra.run.smithi027.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 295 kB/s | 17 kB 00:00 2023-11-29T08:55:17.962 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:06:31 ago on Wed 29 Nov 2023 08:48:46 AM UTC. 2023-11-29T08:55:17.967 INFO:teuthology.orchestra.run.smithi027.stdout:(3/12): openblas-0.3.21-2.el9.x86_64.rpm 587 kB/s | 34 kB 00:00 2023-11-29T08:55:18.058 INFO:teuthology.orchestra.run.smithi139.stdout:Package librbd1-2:18.0.0-7483.g412bfade.el9.x86_64 is already installed. 2023-11-29T08:55:18.101 INFO:teuthology.orchestra.run.smithi027.stdout:(4/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 6.7 MB/s | 3.0 MB 00:00 2023-11-29T08:55:18.108 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2023-11-29T08:55:18.109 INFO:teuthology.orchestra.run.smithi139.stdout:Nothing to do. 2023-11-29T08:55:18.109 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2023-11-29T08:55:18.184 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install python3-rados 2023-11-29T08:55:18.326 INFO:teuthology.orchestra.run.smithi027.stdout:(5/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 13 MB/s | 4.7 MB 00:00 2023-11-29T08:55:18.418 INFO:teuthology.orchestra.run.smithi027.stdout:(6/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 15 MB/s | 4.8 MB 00:00 2023-11-29T08:55:18.443 INFO:teuthology.orchestra.run.smithi027.stdout:(7/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 1.9 MB/s | 217 kB 00:00 2023-11-29T08:55:18.685 INFO:teuthology.orchestra.run.smithi027.stdout:(8/12): libgfortran-11.4.1-2.3.el9.x86_64.rpm 3.3 MB/s | 803 kB 00:00 2023-11-29T08:55:18.768 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:06:32 ago on Wed 29 Nov 2023 08:48:46 AM UTC. 2023-11-29T08:55:18.863 INFO:teuthology.orchestra.run.smithi139.stdout:Package python3-rados-2:18.0.0-7483.g412bfade.el9.x86_64 is already installed. 2023-11-29T08:55:18.885 INFO:teuthology.orchestra.run.smithi027.stdout:(9/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 34 MB/s | 16 MB 00:00 2023-11-29T08:55:18.911 INFO:teuthology.orchestra.run.smithi027.stdout:(10/12): libquadmath-11.4.1-2.3.el9.x86_64.rpm 876 kB/s | 195 kB 00:00 2023-11-29T08:55:18.913 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2023-11-29T08:55:18.914 INFO:teuthology.orchestra.run.smithi139.stdout:Nothing to do. 2023-11-29T08:55:18.914 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2023-11-29T08:55:18.984 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install python3-rgw 2023-11-29T08:55:18.994 INFO:teuthology.orchestra.run.smithi027.stdout:(11/12): ceph-mgr-diskprediction-local-18.0.0-7 5.5 MB/s | 7.4 MB 00:01 2023-11-29T08:55:19.103 INFO:teuthology.orchestra.run.smithi027.stdout:(12/12): python3-devel-3.9.17-2.el9.x86_64.rpm 1.1 MB/s | 245 kB 00:00 2023-11-29T08:55:19.106 INFO:teuthology.orchestra.run.smithi027.stdout:-------------------------------------------------------------------------------- 2023-11-29T08:55:19.106 INFO:teuthology.orchestra.run.smithi027.stdout:Total 22 MB/s | 37 MB 00:01 2023-11-29T08:55:19.119 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction check 2023-11-29T08:55:19.144 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction check succeeded. 2023-11-29T08:55:19.145 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction test 2023-11-29T08:55:19.561 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:06:33 ago on Wed 29 Nov 2023 08:48:46 AM UTC. 2023-11-29T08:55:19.598 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction test succeeded. 2023-11-29T08:55:19.599 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction 2023-11-29T08:55:19.656 INFO:teuthology.orchestra.run.smithi139.stdout:Package python3-rgw-2:18.0.0-7483.g412bfade.el9.x86_64 is already installed. 2023-11-29T08:55:19.706 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2023-11-29T08:55:19.707 INFO:teuthology.orchestra.run.smithi139.stdout:Nothing to do. 2023-11-29T08:55:19.707 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2023-11-29T08:55:19.784 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install python3-cephfs 2023-11-29T08:55:20.324 INFO:teuthology.orchestra.run.smithi027.stdout: Preparing : 1/1 2023-11-29T08:55:20.364 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:06:34 ago on Wed 29 Nov 2023 08:48:46 AM UTC. 2023-11-29T08:55:20.401 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 1/12 2023-11-29T08:55:20.440 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 2/12 2023-11-29T08:55:20.459 INFO:teuthology.orchestra.run.smithi139.stdout:Package python3-cephfs-2:18.0.0-7483.g412bfade.el9.x86_64 is already installed. 2023-11-29T08:55:20.510 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2023-11-29T08:55:20.511 INFO:teuthology.orchestra.run.smithi139.stdout:Nothing to do. 2023-11-29T08:55:20.511 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2023-11-29T08:55:20.538 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2023-11-29T08:55:20.577 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2023-11-29T08:55:20.581 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install python3-rbd 2023-11-29T08:55:20.763 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2023-11-29T08:55:20.793 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2023-11-29T08:55:20.881 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2023-11-29T08:55:21.162 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:06:35 ago on Wed 29 Nov 2023 08:48:46 AM UTC. 2023-11-29T08:55:21.256 INFO:teuthology.orchestra.run.smithi139.stdout:Package python3-rbd-2:18.0.0-7483.g412bfade.el9.x86_64 is already installed. 2023-11-29T08:55:21.306 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2023-11-29T08:55:21.307 INFO:teuthology.orchestra.run.smithi139.stdout:Nothing to do. 2023-11-29T08:55:21.307 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2023-11-29T08:55:21.382 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install rbd-fuse 2023-11-29T08:55:21.572 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2023-11-29T08:55:21.692 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2023-11-29T08:55:21.958 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:06:35 ago on Wed 29 Nov 2023 08:48:46 AM UTC. 2023-11-29T08:55:22.102 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2023-11-29T08:55:22.103 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2023-11-29T08:55:22.103 INFO:teuthology.orchestra.run.smithi139.stdout: Package Architecture Version Repository Size 2023-11-29T08:55:22.103 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2023-11-29T08:55:22.103 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2023-11-29T08:55:22.103 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-fuse x86_64 2:18.0.0-7483.g412bfade.el9 ceph 86 k 2023-11-29T08:55:22.103 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:55:22.103 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2023-11-29T08:55:22.103 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2023-11-29T08:55:22.103 INFO:teuthology.orchestra.run.smithi139.stdout:Install 1 Package 2023-11-29T08:55:22.103 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:55:22.104 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 86 k 2023-11-29T08:55:22.104 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 256 k 2023-11-29T08:55:22.104 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2023-11-29T08:55:22.482 INFO:teuthology.orchestra.run.smithi139.stdout:rbd-fuse-18.0.0-7483.g412bfade.el9.x86_64.rpm 226 kB/s | 86 kB 00:00 2023-11-29T08:55:22.483 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2023-11-29T08:55:22.483 INFO:teuthology.orchestra.run.smithi139.stdout:Total 226 kB/s | 86 kB 00:00 2023-11-29T08:55:22.484 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2023-11-29T08:55:22.490 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2023-11-29T08:55:22.490 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2023-11-29T08:55:22.545 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2023-11-29T08:55:22.545 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2023-11-29T08:55:22.688 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2023-11-29T08:55:22.788 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : rbd-fuse-2:18.0.0-7483.g412bfade.el9.x86_64 1/1 2023-11-29T08:55:23.016 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2023-11-29T08:55:23.189 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: rbd-fuse-2:18.0.0-7483.g412bfade.el9.x86_64 1/1 2023-11-29T08:55:23.514 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : rbd-fuse-2:18.0.0-7483.g412bfade.el9.x86_64 1/1 2023-11-29T08:55:23.514 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:55:23.514 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2023-11-29T08:55:23.515 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-fuse-2:18.0.0-7483.g412bfade.el9.x86_64 2023-11-29T08:55:23.515 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:55:23.515 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2023-11-29T08:55:23.742 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install rbd-mirror 2023-11-29T08:55:24.100 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2023-11-29T08:55:24.134 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-7483.g412bf 12/12 2023-11-29T08:55:24.334 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:06:38 ago on Wed 29 Nov 2023 08:48:46 AM UTC. 2023-11-29T08:55:24.479 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2023-11-29T08:55:24.480 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2023-11-29T08:55:24.480 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repo Size 2023-11-29T08:55:24.480 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2023-11-29T08:55:24.480 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2023-11-29T08:55:24.480 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-mirror x86_64 2:18.0.0-7483.g412bfade.el9 ceph 3.0 M 2023-11-29T08:55:24.480 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:55:24.480 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2023-11-29T08:55:24.480 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2023-11-29T08:55:24.480 INFO:teuthology.orchestra.run.smithi139.stdout:Install 1 Package 2023-11-29T08:55:24.480 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:55:24.480 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 3.0 M 2023-11-29T08:55:24.480 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 13 M 2023-11-29T08:55:24.480 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2023-11-29T08:55:25.076 INFO:teuthology.orchestra.run.smithi139.stdout:rbd-mirror-18.0.0-7483.g412bfade.el9.x86_64.rpm 5.0 MB/s | 3.0 MB 00:00 2023-11-29T08:55:25.078 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2023-11-29T08:55:25.078 INFO:teuthology.orchestra.run.smithi139.stdout:Total 5.0 MB/s | 3.0 MB 00:00 2023-11-29T08:55:25.078 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2023-11-29T08:55:25.086 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2023-11-29T08:55:25.087 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2023-11-29T08:55:25.158 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2023-11-29T08:55:25.159 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2023-11-29T08:55:25.588 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2023-11-29T08:55:25.660 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : rbd-mirror-2:18.0.0-7483.g412bfade.el9.x86_64 1/1 2023-11-29T08:55:25.685 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: rbd-mirror-2:18.0.0-7483.g412bfade.el9.x86_64 1/1 2023-11-29T08:55:25.685 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-29T08:55:25.685 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-11-29T08:55:25.685 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-29T08:55:25.685 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-29T08:55:25.685 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:55:26.621 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-7483.g412bf 12/12 2023-11-29T08:55:26.621 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-7483.g412bf 1/12 2023-11-29T08:55:26.621 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2023-11-29T08:55:26.622 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2023-11-29T08:55:26.622 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2023-11-29T08:55:26.622 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2023-11-29T08:55:26.622 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2023-11-29T08:55:26.622 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 7/12 2023-11-29T08:55:26.622 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 8/12 2023-11-29T08:55:26.622 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 9/12 2023-11-29T08:55:26.622 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 10/12 2023-11-29T08:55:26.622 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 11/12 2023-11-29T08:55:26.823 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : rbd-mirror-2:18.0.0-7483.g412bfade.el9.x86_64 1/1 2023-11-29T08:55:26.824 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:55:26.824 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2023-11-29T08:55:26.824 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-mirror-2:18.0.0-7483.g412bfade.el9.x86_64 2023-11-29T08:55:26.824 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:55:26.824 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2023-11-29T08:55:27.086 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install rbd-nbd 2023-11-29T08:55:27.165 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 12/12 2023-11-29T08:55:27.166 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:55:27.166 INFO:teuthology.orchestra.run.smithi027.stdout:Installed: 2023-11-29T08:55:27.166 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-diskprediction-local-2:18.0.0-7483.g412bfade.el9.noarch 2023-11-29T08:55:27.166 INFO:teuthology.orchestra.run.smithi027.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-11-29T08:55:27.166 INFO:teuthology.orchestra.run.smithi027.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-11-29T08:55:27.166 INFO:teuthology.orchestra.run.smithi027.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-11-29T08:55:27.166 INFO:teuthology.orchestra.run.smithi027.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-11-29T08:55:27.166 INFO:teuthology.orchestra.run.smithi027.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-11-29T08:55:27.166 INFO:teuthology.orchestra.run.smithi027.stdout: openblas-0.3.21-2.el9.x86_64 2023-11-29T08:55:27.166 INFO:teuthology.orchestra.run.smithi027.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-11-29T08:55:27.166 INFO:teuthology.orchestra.run.smithi027.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-11-29T08:55:27.166 INFO:teuthology.orchestra.run.smithi027.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-11-29T08:55:27.166 INFO:teuthology.orchestra.run.smithi027.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-11-29T08:55:27.167 INFO:teuthology.orchestra.run.smithi027.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-11-29T08:55:27.167 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:55:27.167 INFO:teuthology.orchestra.run.smithi027.stdout:Complete! 2023-11-29T08:55:27.491 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum -y install ceph-mgr-rook 2023-11-29T08:55:27.678 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:06:41 ago on Wed 29 Nov 2023 08:48:46 AM UTC. 2023-11-29T08:55:27.824 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2023-11-29T08:55:27.825 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2023-11-29T08:55:27.825 INFO:teuthology.orchestra.run.smithi139.stdout: Package Architecture Version Repository Size 2023-11-29T08:55:27.825 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2023-11-29T08:55:27.825 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2023-11-29T08:55:27.825 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-nbd x86_64 2:18.0.0-7483.g412bfade.el9 ceph 169 k 2023-11-29T08:55:27.825 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:55:27.825 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2023-11-29T08:55:27.825 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2023-11-29T08:55:27.825 INFO:teuthology.orchestra.run.smithi139.stdout:Install 1 Package 2023-11-29T08:55:27.825 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:55:27.826 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 169 k 2023-11-29T08:55:27.826 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 536 k 2023-11-29T08:55:27.826 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2023-11-29T08:55:28.037 INFO:teuthology.orchestra.run.smithi139.stdout:rbd-nbd-18.0.0-7483.g412bfade.el9.x86_64.rpm 801 kB/s | 169 kB 00:00 2023-11-29T08:55:28.038 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2023-11-29T08:55:28.038 INFO:teuthology.orchestra.run.smithi139.stdout:Total 794 kB/s | 169 kB 00:00 2023-11-29T08:55:28.038 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2023-11-29T08:55:28.045 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2023-11-29T08:55:28.046 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2023-11-29T08:55:28.099 INFO:teuthology.orchestra.run.smithi027.stdout:Last metadata expiration check: 0:06:41 ago on Wed 29 Nov 2023 08:48:47 AM UTC. 2023-11-29T08:55:28.100 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2023-11-29T08:55:28.101 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2023-11-29T08:55:28.248 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2023-11-29T08:55:28.252 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. 2023-11-29T08:55:28.254 INFO:teuthology.orchestra.run.smithi027.stdout:======================================================================================== 2023-11-29T08:55:28.254 INFO:teuthology.orchestra.run.smithi027.stdout: Package Arch Version Repository Size 2023-11-29T08:55:28.254 INFO:teuthology.orchestra.run.smithi027.stdout:======================================================================================== 2023-11-29T08:55:28.254 INFO:teuthology.orchestra.run.smithi027.stdout:Installing: 2023-11-29T08:55:28.254 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-rook noarch 2:18.0.0-7483.g412bfade.el9 ceph-noarch 50 k 2023-11-29T08:55:28.254 INFO:teuthology.orchestra.run.smithi027.stdout:Installing dependencies: 2023-11-29T08:55:28.254 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-11-29T08:55:28.254 INFO:teuthology.orchestra.run.smithi027.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-11-29T08:55:28.254 INFO:teuthology.orchestra.run.smithi027.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-11-29T08:55:28.254 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-11-29T08:55:28.254 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-11-29T08:55:28.255 INFO:teuthology.orchestra.run.smithi027.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-11-29T08:55:28.255 INFO:teuthology.orchestra.run.smithi027.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-11-29T08:55:28.255 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-11-29T08:55:28.255 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-11-29T08:55:28.255 INFO:teuthology.orchestra.run.smithi027.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-11-29T08:55:28.255 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-11-29T08:55:28.255 INFO:teuthology.orchestra.run.smithi027.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-11-29T08:55:28.255 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:55:28.255 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction Summary 2023-11-29T08:55:28.255 INFO:teuthology.orchestra.run.smithi027.stdout:======================================================================================== 2023-11-29T08:55:28.255 INFO:teuthology.orchestra.run.smithi027.stdout:Install 13 Packages 2023-11-29T08:55:28.255 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:55:28.256 INFO:teuthology.orchestra.run.smithi027.stdout:Total download size: 2.0 M 2023-11-29T08:55:28.256 INFO:teuthology.orchestra.run.smithi027.stdout:Installed size: 26 M 2023-11-29T08:55:28.256 INFO:teuthology.orchestra.run.smithi027.stdout:Downloading Packages: 2023-11-29T08:55:28.353 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : rbd-nbd-2:18.0.0-7483.g412bfade.el9.x86_64 1/1 2023-11-29T08:55:28.492 INFO:teuthology.orchestra.run.smithi027.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 134 kB/s | 24 kB 00:00 2023-11-29T08:55:28.533 INFO:teuthology.orchestra.run.smithi027.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 81 kB/s | 18 kB 00:00 2023-11-29T08:55:28.559 INFO:teuthology.orchestra.run.smithi027.stdout:(3/13): ceph-mgr-rook-18.0.0-7483.g412bfade.el9 201 kB/s | 50 kB 00:00 2023-11-29T08:55:28.626 INFO:teuthology.orchestra.run.smithi027.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.3 MB/s | 174 kB 00:00 2023-11-29T08:55:28.651 INFO:teuthology.orchestra.run.smithi027.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.1 MB/s | 132 kB 00:00 2023-11-29T08:55:28.676 INFO:teuthology.orchestra.run.smithi027.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.8 MB/s | 211 kB 00:00 2023-11-29T08:55:28.701 INFO:teuthology.orchestra.run.smithi027.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 567 kB/s | 43 kB 00:00 2023-11-29T08:55:28.818 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: rbd-nbd-2:18.0.0-7483.g412bfade.el9.x86_64 1/1 2023-11-29T08:55:28.986 INFO:teuthology.orchestra.run.smithi027.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 48 kB/s | 15 kB 00:00 2023-11-29T08:55:29.027 INFO:teuthology.orchestra.run.smithi027.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 86 kB/s | 32 kB 00:00 2023-11-29T08:55:29.179 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : rbd-nbd-2:18.0.0-7483.g412bfade.el9.x86_64 1/1 2023-11-29T08:55:29.179 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:55:29.179 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2023-11-29T08:55:29.179 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-nbd-2:18.0.0-7483.g412bfade.el9.x86_64 2023-11-29T08:55:29.179 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:55:29.179 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2023-11-29T08:55:29.302 INFO:teuthology.orchestra.run.smithi027.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 215 kB/s | 59 kB 00:00 2023-11-29T08:55:29.328 INFO:teuthology.orchestra.run.smithi027.stdout:(11/13): python3-google-auth-2.23.4-1.el9.noarc 315 kB/s | 197 kB 00:00 2023-11-29T08:55:29.413 DEBUG:teuthology.parallel:result is None 2023-11-29T08:55:29.536 INFO:teuthology.orchestra.run.smithi027.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 384 kB/s | 90 kB 00:00 2023-11-29T08:55:29.695 INFO:teuthology.orchestra.run.smithi027.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 1.4 MB/s | 1.0 MB 00:00 2023-11-29T08:55:29.697 INFO:teuthology.orchestra.run.smithi027.stdout:-------------------------------------------------------------------------------- 2023-11-29T08:55:29.697 INFO:teuthology.orchestra.run.smithi027.stdout:Total 1.4 MB/s | 2.0 MB 00:01 2023-11-29T08:55:29.698 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction check 2023-11-29T08:55:29.714 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction check succeeded. 2023-11-29T08:55:29.714 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction test 2023-11-29T08:55:29.828 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction test succeeded. 2023-11-29T08:55:29.828 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction 2023-11-29T08:55:30.361 INFO:teuthology.orchestra.run.smithi027.stdout: Preparing : 1/1 2023-11-29T08:55:30.532 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2023-11-29T08:55:30.580 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2023-11-29T08:55:30.645 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2023-11-29T08:55:30.680 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2023-11-29T08:55:30.722 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2023-11-29T08:55:30.817 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2023-11-29T08:55:30.921 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 7/13 2023-11-29T08:55:30.973 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2023-11-29T08:55:31.735 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2023-11-29T08:55:31.780 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2023-11-29T08:55:31.814 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2023-11-29T08:55:31.862 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2023-11-29T08:55:31.892 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-mgr-rook-2:18.0.0-7483.g412bfade.el9.noarch 13/13 2023-11-29T08:55:32.657 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-7483.g412bfade.el9.noarch 13/13 2023-11-29T08:55:32.657 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-mgr-rook-2:18.0.0-7483.g412bfade.el9.noarch 1/13 2023-11-29T08:55:32.657 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2023-11-29T08:55:32.657 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2023-11-29T08:55:32.657 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2023-11-29T08:55:32.657 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2023-11-29T08:55:32.657 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2023-11-29T08:55:32.658 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2023-11-29T08:55:32.658 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2023-11-29T08:55:32.658 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2023-11-29T08:55:32.658 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 10/13 2023-11-29T08:55:32.658 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2023-11-29T08:55:32.658 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2023-11-29T08:55:33.036 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2023-11-29T08:55:33.036 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:55:33.036 INFO:teuthology.orchestra.run.smithi027.stdout:Installed: 2023-11-29T08:55:33.037 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-rook-2:18.0.0-7483.g412bfade.el9.noarch 2023-11-29T08:55:33.037 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-11-29T08:55:33.037 INFO:teuthology.orchestra.run.smithi027.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-11-29T08:55:33.037 INFO:teuthology.orchestra.run.smithi027.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-11-29T08:55:33.037 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-11-29T08:55:33.037 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-11-29T08:55:33.037 INFO:teuthology.orchestra.run.smithi027.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-11-29T08:55:33.037 INFO:teuthology.orchestra.run.smithi027.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-11-29T08:55:33.037 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-11-29T08:55:33.037 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-11-29T08:55:33.037 INFO:teuthology.orchestra.run.smithi027.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-11-29T08:55:33.037 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rsa-4.9-2.el9.noarch 2023-11-29T08:55:33.037 INFO:teuthology.orchestra.run.smithi027.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-11-29T08:55:33.038 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:55:33.038 INFO:teuthology.orchestra.run.smithi027.stdout:Complete! 2023-11-29T08:55:33.294 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum -y install ceph-mgr-cephadm 2023-11-29T08:55:33.899 INFO:teuthology.orchestra.run.smithi027.stdout:Last metadata expiration check: 0:06:46 ago on Wed 29 Nov 2023 08:48:47 AM UTC. 2023-11-29T08:55:34.053 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. 2023-11-29T08:55:34.054 INFO:teuthology.orchestra.run.smithi027.stdout:======================================================================================== 2023-11-29T08:55:34.054 INFO:teuthology.orchestra.run.smithi027.stdout: Package Arch Version Repository Size 2023-11-29T08:55:34.054 INFO:teuthology.orchestra.run.smithi027.stdout:======================================================================================== 2023-11-29T08:55:34.054 INFO:teuthology.orchestra.run.smithi027.stdout:Installing: 2023-11-29T08:55:34.054 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-cephadm noarch 2:18.0.0-7483.g412bfade.el9 ceph-noarch 133 k 2023-11-29T08:55:34.054 INFO:teuthology.orchestra.run.smithi027.stdout:Installing dependencies: 2023-11-29T08:55:34.054 INFO:teuthology.orchestra.run.smithi027.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-11-29T08:55:34.054 INFO:teuthology.orchestra.run.smithi027.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-11-29T08:55:34.055 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-11-29T08:55:34.055 INFO:teuthology.orchestra.run.smithi027.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-11-29T08:55:34.055 INFO:teuthology.orchestra.run.smithi027.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-11-29T08:55:34.055 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:55:34.055 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction Summary 2023-11-29T08:55:34.055 INFO:teuthology.orchestra.run.smithi027.stdout:======================================================================================== 2023-11-29T08:55:34.055 INFO:teuthology.orchestra.run.smithi027.stdout:Install 6 Packages 2023-11-29T08:55:34.055 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:55:34.055 INFO:teuthology.orchestra.run.smithi027.stdout:Total download size: 6.8 M 2023-11-29T08:55:34.056 INFO:teuthology.orchestra.run.smithi027.stdout:Installed size: 33 M 2023-11-29T08:55:34.056 INFO:teuthology.orchestra.run.smithi027.stdout:Downloading Packages: 2023-11-29T08:55:34.723 INFO:teuthology.orchestra.run.smithi027.stdout:(1/6): ceph-mgr-cephadm-18.0.0-7483.g412bfade.e 579 kB/s | 133 kB 00:00 2023-11-29T08:55:34.848 INFO:teuthology.orchestra.run.smithi027.stdout:(2/6): python3-jinja2-2.11.3-4.el9.noarch.rpm 645 kB/s | 228 kB 00:00 2023-11-29T08:55:35.190 INFO:teuthology.orchestra.run.smithi027.stdout:(3/6): python3-babel-2.9.1-2.el9.noarch.rpm 8.3 MB/s | 5.8 MB 00:00 2023-11-29T08:55:35.215 INFO:teuthology.orchestra.run.smithi027.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 158 kB/s | 58 kB 00:00 2023-11-29T08:55:35.240 INFO:teuthology.orchestra.run.smithi027.stdout:(5/6): python3-asyncssh-2.13.2-3.el9.noarch.rpm 1.0 MB/s | 548 kB 00:00 2023-11-29T08:55:35.491 INFO:teuthology.orchestra.run.smithi027.stdout:(6/6): python3-typing-extensions-4.4.0-2.el9.no 170 kB/s | 51 kB 00:00 2023-11-29T08:55:35.495 INFO:teuthology.orchestra.run.smithi027.stdout:-------------------------------------------------------------------------------- 2023-11-29T08:55:35.495 INFO:teuthology.orchestra.run.smithi027.stdout:Total 4.7 MB/s | 6.8 MB 00:01 2023-11-29T08:55:35.495 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction check 2023-11-29T08:55:35.505 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction check succeeded. 2023-11-29T08:55:35.505 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction test 2023-11-29T08:55:35.601 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction test succeeded. 2023-11-29T08:55:35.601 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction 2023-11-29T08:55:35.914 INFO:teuthology.orchestra.run.smithi027.stdout: Preparing : 1/1 2023-11-29T08:55:36.102 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2023-11-29T08:55:36.161 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 2/6 2023-11-29T08:55:36.745 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2023-11-29T08:55:36.833 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2023-11-29T08:55:36.909 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 5/6 2023-11-29T08:55:36.938 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-7483.g412bfade.el9.noarch 6/6 2023-11-29T08:55:37.723 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-7483.g412bfade.el9.noarch 6/6 2023-11-29T08:55:37.724 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-7483.g412bfade.el9.noarch 1/6 2023-11-29T08:55:37.724 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2023-11-29T08:55:37.724 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 3/6 2023-11-29T08:55:37.724 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 4/6 2023-11-29T08:55:37.724 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2023-11-29T08:55:38.054 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2023-11-29T08:55:38.054 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:55:38.055 INFO:teuthology.orchestra.run.smithi027.stdout:Installed: 2023-11-29T08:55:38.055 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-cephadm-2:18.0.0-7483.g412bfade.el9.noarch 2023-11-29T08:55:38.055 INFO:teuthology.orchestra.run.smithi027.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-11-29T08:55:38.055 INFO:teuthology.orchestra.run.smithi027.stdout: python3-babel-2.9.1-2.el9.noarch 2023-11-29T08:55:38.055 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-11-29T08:55:38.055 INFO:teuthology.orchestra.run.smithi027.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-11-29T08:55:38.055 INFO:teuthology.orchestra.run.smithi027.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-11-29T08:55:38.055 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:55:38.055 INFO:teuthology.orchestra.run.smithi027.stdout:Complete! 2023-11-29T08:55:38.298 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum -y install ceph-fuse 2023-11-29T08:55:38.920 INFO:teuthology.orchestra.run.smithi027.stdout:Last metadata expiration check: 0:06:51 ago on Wed 29 Nov 2023 08:48:47 AM UTC. 2023-11-29T08:55:39.071 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. 2023-11-29T08:55:39.072 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2023-11-29T08:55:39.072 INFO:teuthology.orchestra.run.smithi027.stdout: Package Arch Version Repository Size 2023-11-29T08:55:39.072 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2023-11-29T08:55:39.072 INFO:teuthology.orchestra.run.smithi027.stdout:Installing: 2023-11-29T08:55:39.072 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-fuse x86_64 2:18.0.0-7483.g412bfade.el9 ceph 833 k 2023-11-29T08:55:39.072 INFO:teuthology.orchestra.run.smithi027.stdout:Installing dependencies: 2023-11-29T08:55:39.072 INFO:teuthology.orchestra.run.smithi027.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-11-29T08:55:39.072 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:55:39.072 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction Summary 2023-11-29T08:55:39.072 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2023-11-29T08:55:39.072 INFO:teuthology.orchestra.run.smithi027.stdout:Install 2 Packages 2023-11-29T08:55:39.072 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:55:39.073 INFO:teuthology.orchestra.run.smithi027.stdout:Total download size: 911 k 2023-11-29T08:55:39.073 INFO:teuthology.orchestra.run.smithi027.stdout:Installed size: 3.0 M 2023-11-29T08:55:39.073 INFO:teuthology.orchestra.run.smithi027.stdout:Downloading Packages: 2023-11-29T08:55:39.302 INFO:teuthology.orchestra.run.smithi027.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 344 kB/s | 79 kB 00:00 2023-11-29T08:55:41.519 INFO:teuthology.orchestra.run.smithi027.stdout:(2/2): ceph-fuse-18.0.0-7483.g412bfade.el9.x86_ 341 kB/s | 833 kB 00:02 2023-11-29T08:55:41.520 INFO:teuthology.orchestra.run.smithi027.stdout:-------------------------------------------------------------------------------- 2023-11-29T08:55:41.521 INFO:teuthology.orchestra.run.smithi027.stdout:Total 372 kB/s | 911 kB 00:02 2023-11-29T08:55:41.521 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction check 2023-11-29T08:55:41.546 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction check succeeded. 2023-11-29T08:55:41.546 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction test 2023-11-29T08:55:41.635 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction test succeeded. 2023-11-29T08:55:41.635 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction 2023-11-29T08:55:41.956 INFO:teuthology.orchestra.run.smithi027.stdout: Preparing : 1/1 2023-11-29T08:55:42.107 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2023-11-29T08:55:42.178 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-fuse-2:18.0.0-7483.g412bfade.el9.x86_64 2/2 2023-11-29T08:55:42.844 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-fuse-2:18.0.0-7483.g412bfade.el9.x86_64 2/2 2023-11-29T08:55:42.844 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-fuse-2:18.0.0-7483.g412bfade.el9.x86_64 1/2 2023-11-29T08:55:43.177 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2023-11-29T08:55:43.178 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:55:43.178 INFO:teuthology.orchestra.run.smithi027.stdout:Installed: 2023-11-29T08:55:43.178 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-fuse-2:18.0.0-7483.g412bfade.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2023-11-29T08:55:43.178 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:55:43.178 INFO:teuthology.orchestra.run.smithi027.stdout:Complete! 2023-11-29T08:55:43.427 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum -y install ceph-volume 2023-11-29T08:55:44.043 INFO:teuthology.orchestra.run.smithi027.stdout:Last metadata expiration check: 0:06:57 ago on Wed 29 Nov 2023 08:48:47 AM UTC. 2023-11-29T08:55:44.194 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. 2023-11-29T08:55:44.195 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2023-11-29T08:55:44.195 INFO:teuthology.orchestra.run.smithi027.stdout: Package Arch Version Repository Size 2023-11-29T08:55:44.195 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2023-11-29T08:55:44.195 INFO:teuthology.orchestra.run.smithi027.stdout:Installing: 2023-11-29T08:55:44.196 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-volume noarch 2:18.0.0-7483.g412bfade.el9 ceph-noarch 262 k 2023-11-29T08:55:44.196 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:55:44.196 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction Summary 2023-11-29T08:55:44.196 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2023-11-29T08:55:44.196 INFO:teuthology.orchestra.run.smithi027.stdout:Install 1 Package 2023-11-29T08:55:44.196 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:55:44.196 INFO:teuthology.orchestra.run.smithi027.stdout:Total download size: 262 k 2023-11-29T08:55:44.196 INFO:teuthology.orchestra.run.smithi027.stdout:Installed size: 1.2 M 2023-11-29T08:55:44.196 INFO:teuthology.orchestra.run.smithi027.stdout:Downloading Packages: 2023-11-29T08:55:44.507 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-volume-18.0.0-7483.g412bfade.el9.noarch.rp 845 kB/s | 262 kB 00:00 2023-11-29T08:55:44.507 INFO:teuthology.orchestra.run.smithi027.stdout:-------------------------------------------------------------------------------- 2023-11-29T08:55:44.508 INFO:teuthology.orchestra.run.smithi027.stdout:Total 841 kB/s | 262 kB 00:00 2023-11-29T08:55:44.508 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction check 2023-11-29T08:55:44.516 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction check succeeded. 2023-11-29T08:55:44.516 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction test 2023-11-29T08:55:44.550 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction test succeeded. 2023-11-29T08:55:44.550 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction 2023-11-29T08:55:44.774 INFO:teuthology.orchestra.run.smithi027.stdout: Preparing : 1/1 2023-11-29T08:55:44.850 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-volume-2:18.0.0-7483.g412bfade.el9.noarch 1/1 2023-11-29T08:55:44.867 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-volume-2:18.0.0-7483.g412bfade.el9.noarch 1/1 2023-11-29T08:55:44.867 INFO:teuthology.orchestra.run.smithi027.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-29T08:55:44.867 INFO:teuthology.orchestra.run.smithi027.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-11-29T08:55:44.867 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:55:45.876 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-volume-2:18.0.0-7483.g412bfade.el9.noarch 1/1 2023-11-29T08:55:45.876 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:55:45.877 INFO:teuthology.orchestra.run.smithi027.stdout:Installed: 2023-11-29T08:55:45.877 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-volume-2:18.0.0-7483.g412bfade.el9.noarch 2023-11-29T08:55:45.877 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:55:45.877 INFO:teuthology.orchestra.run.smithi027.stdout:Complete! 2023-11-29T08:55:46.181 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum -y install librados-devel 2023-11-29T08:55:46.799 INFO:teuthology.orchestra.run.smithi027.stdout:Last metadata expiration check: 0:06:59 ago on Wed 29 Nov 2023 08:48:47 AM UTC. 2023-11-29T08:55:46.951 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. 2023-11-29T08:55:46.952 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2023-11-29T08:55:46.952 INFO:teuthology.orchestra.run.smithi027.stdout: Package Arch Version Repo Size 2023-11-29T08:55:46.953 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2023-11-29T08:55:46.953 INFO:teuthology.orchestra.run.smithi027.stdout:Installing: 2023-11-29T08:55:46.953 INFO:teuthology.orchestra.run.smithi027.stdout: librados-devel x86_64 2:18.0.0-7483.g412bfade.el9 ceph 127 k 2023-11-29T08:55:46.953 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:55:46.953 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction Summary 2023-11-29T08:55:46.953 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2023-11-29T08:55:46.953 INFO:teuthology.orchestra.run.smithi027.stdout:Install 1 Package 2023-11-29T08:55:46.953 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:55:46.953 INFO:teuthology.orchestra.run.smithi027.stdout:Total download size: 127 k 2023-11-29T08:55:46.953 INFO:teuthology.orchestra.run.smithi027.stdout:Installed size: 456 k 2023-11-29T08:55:46.954 INFO:teuthology.orchestra.run.smithi027.stdout:Downloading Packages: 2023-11-29T08:55:47.378 INFO:teuthology.orchestra.run.smithi027.stdout:librados-devel-18.0.0-7483.g412bfade.el9.x86_64 298 kB/s | 127 kB 00:00 2023-11-29T08:55:47.379 INFO:teuthology.orchestra.run.smithi027.stdout:-------------------------------------------------------------------------------- 2023-11-29T08:55:47.379 INFO:teuthology.orchestra.run.smithi027.stdout:Total 297 kB/s | 127 kB 00:00 2023-11-29T08:55:47.379 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction check 2023-11-29T08:55:47.385 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction check succeeded. 2023-11-29T08:55:47.385 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction test 2023-11-29T08:55:47.443 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction test succeeded. 2023-11-29T08:55:47.444 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction 2023-11-29T08:55:47.598 INFO:teuthology.orchestra.run.smithi027.stdout: Preparing : 1/1 2023-11-29T08:55:47.712 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : librados-devel-2:18.0.0-7483.g412bfade.el9.x86_64 1/1 2023-11-29T08:55:48.212 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: librados-devel-2:18.0.0-7483.g412bfade.el9.x86_64 1/1 2023-11-29T08:55:48.545 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : librados-devel-2:18.0.0-7483.g412bfade.el9.x86_64 1/1 2023-11-29T08:55:48.545 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:55:48.545 INFO:teuthology.orchestra.run.smithi027.stdout:Installed: 2023-11-29T08:55:48.545 INFO:teuthology.orchestra.run.smithi027.stdout: librados-devel-2:18.0.0-7483.g412bfade.el9.x86_64 2023-11-29T08:55:48.545 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:55:48.545 INFO:teuthology.orchestra.run.smithi027.stdout:Complete! 2023-11-29T08:55:48.774 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum -y install libcephfs2 2023-11-29T08:55:49.386 INFO:teuthology.orchestra.run.smithi027.stdout:Last metadata expiration check: 0:07:02 ago on Wed 29 Nov 2023 08:48:47 AM UTC. 2023-11-29T08:55:49.482 INFO:teuthology.orchestra.run.smithi027.stdout:Package libcephfs2-2:18.0.0-7483.g412bfade.el9.x86_64 is already installed. 2023-11-29T08:55:49.536 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. 2023-11-29T08:55:49.537 INFO:teuthology.orchestra.run.smithi027.stdout:Nothing to do. 2023-11-29T08:55:49.537 INFO:teuthology.orchestra.run.smithi027.stdout:Complete! 2023-11-29T08:55:49.610 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum -y install libcephfs-devel 2023-11-29T08:55:50.218 INFO:teuthology.orchestra.run.smithi027.stdout:Last metadata expiration check: 0:07:03 ago on Wed 29 Nov 2023 08:48:47 AM UTC. 2023-11-29T08:55:50.370 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. 2023-11-29T08:55:50.370 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2023-11-29T08:55:50.371 INFO:teuthology.orchestra.run.smithi027.stdout: Package Arch Version Repo Size 2023-11-29T08:55:50.371 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2023-11-29T08:55:50.371 INFO:teuthology.orchestra.run.smithi027.stdout:Installing: 2023-11-29T08:55:50.371 INFO:teuthology.orchestra.run.smithi027.stdout: libcephfs-devel x86_64 2:18.0.0-7483.g412bfade.el9 ceph 31 k 2023-11-29T08:55:50.371 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:55:50.371 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction Summary 2023-11-29T08:55:50.371 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2023-11-29T08:55:50.371 INFO:teuthology.orchestra.run.smithi027.stdout:Install 1 Package 2023-11-29T08:55:50.371 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:55:50.371 INFO:teuthology.orchestra.run.smithi027.stdout:Total download size: 31 k 2023-11-29T08:55:50.371 INFO:teuthology.orchestra.run.smithi027.stdout:Installed size: 139 k 2023-11-29T08:55:50.371 INFO:teuthology.orchestra.run.smithi027.stdout:Downloading Packages: 2023-11-29T08:55:50.766 INFO:teuthology.orchestra.run.smithi027.stdout:libcephfs-devel-18.0.0-7483.g412bfade.el9.x86_6 79 kB/s | 31 kB 00:00 2023-11-29T08:55:50.766 INFO:teuthology.orchestra.run.smithi027.stdout:-------------------------------------------------------------------------------- 2023-11-29T08:55:50.766 INFO:teuthology.orchestra.run.smithi027.stdout:Total 79 kB/s | 31 kB 00:00 2023-11-29T08:55:50.767 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction check 2023-11-29T08:55:50.770 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction check succeeded. 2023-11-29T08:55:50.771 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction test 2023-11-29T08:55:50.803 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction test succeeded. 2023-11-29T08:55:50.804 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction 2023-11-29T08:55:50.900 INFO:teuthology.orchestra.run.smithi027.stdout: Preparing : 1/1 2023-11-29T08:55:51.015 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libcephfs-devel-2:18.0.0-7483.g412bfade.el9.x86_64 1/1 2023-11-29T08:55:51.417 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: libcephfs-devel-2:18.0.0-7483.g412bfade.el9.x86_64 1/1 2023-11-29T08:55:51.707 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libcephfs-devel-2:18.0.0-7483.g412bfade.el9.x86_64 1/1 2023-11-29T08:55:51.707 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:55:51.707 INFO:teuthology.orchestra.run.smithi027.stdout:Installed: 2023-11-29T08:55:51.708 INFO:teuthology.orchestra.run.smithi027.stdout: libcephfs-devel-2:18.0.0-7483.g412bfade.el9.x86_64 2023-11-29T08:55:51.708 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:55:51.708 INFO:teuthology.orchestra.run.smithi027.stdout:Complete! 2023-11-29T08:55:51.863 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum -y install librados2 2023-11-29T08:55:52.474 INFO:teuthology.orchestra.run.smithi027.stdout:Last metadata expiration check: 0:07:05 ago on Wed 29 Nov 2023 08:48:47 AM UTC. 2023-11-29T08:55:52.572 INFO:teuthology.orchestra.run.smithi027.stdout:Package librados2-2:18.0.0-7483.g412bfade.el9.x86_64 is already installed. 2023-11-29T08:55:52.625 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. 2023-11-29T08:55:52.626 INFO:teuthology.orchestra.run.smithi027.stdout:Nothing to do. 2023-11-29T08:55:52.626 INFO:teuthology.orchestra.run.smithi027.stdout:Complete! 2023-11-29T08:55:52.706 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum -y install librbd1 2023-11-29T08:55:53.317 INFO:teuthology.orchestra.run.smithi027.stdout:Last metadata expiration check: 0:07:06 ago on Wed 29 Nov 2023 08:48:47 AM UTC. 2023-11-29T08:55:53.416 INFO:teuthology.orchestra.run.smithi027.stdout:Package librbd1-2:18.0.0-7483.g412bfade.el9.x86_64 is already installed. 2023-11-29T08:55:53.470 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. 2023-11-29T08:55:53.471 INFO:teuthology.orchestra.run.smithi027.stdout:Nothing to do. 2023-11-29T08:55:53.471 INFO:teuthology.orchestra.run.smithi027.stdout:Complete! 2023-11-29T08:55:53.540 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum -y install python3-rados 2023-11-29T08:55:54.143 INFO:teuthology.orchestra.run.smithi027.stdout:Last metadata expiration check: 0:07:07 ago on Wed 29 Nov 2023 08:48:47 AM UTC. 2023-11-29T08:55:54.240 INFO:teuthology.orchestra.run.smithi027.stdout:Package python3-rados-2:18.0.0-7483.g412bfade.el9.x86_64 is already installed. 2023-11-29T08:55:54.294 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. 2023-11-29T08:55:54.296 INFO:teuthology.orchestra.run.smithi027.stdout:Nothing to do. 2023-11-29T08:55:54.296 INFO:teuthology.orchestra.run.smithi027.stdout:Complete! 2023-11-29T08:55:54.363 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum -y install python3-rgw 2023-11-29T08:55:54.971 INFO:teuthology.orchestra.run.smithi027.stdout:Last metadata expiration check: 0:07:07 ago on Wed 29 Nov 2023 08:48:47 AM UTC. 2023-11-29T08:55:55.068 INFO:teuthology.orchestra.run.smithi027.stdout:Package python3-rgw-2:18.0.0-7483.g412bfade.el9.x86_64 is already installed. 2023-11-29T08:55:55.121 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. 2023-11-29T08:55:55.122 INFO:teuthology.orchestra.run.smithi027.stdout:Nothing to do. 2023-11-29T08:55:55.122 INFO:teuthology.orchestra.run.smithi027.stdout:Complete! 2023-11-29T08:55:55.192 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum -y install python3-cephfs 2023-11-29T08:55:55.798 INFO:teuthology.orchestra.run.smithi027.stdout:Last metadata expiration check: 0:07:08 ago on Wed 29 Nov 2023 08:48:47 AM UTC. 2023-11-29T08:55:55.896 INFO:teuthology.orchestra.run.smithi027.stdout:Package python3-cephfs-2:18.0.0-7483.g412bfade.el9.x86_64 is already installed. 2023-11-29T08:55:55.949 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. 2023-11-29T08:55:55.950 INFO:teuthology.orchestra.run.smithi027.stdout:Nothing to do. 2023-11-29T08:55:55.950 INFO:teuthology.orchestra.run.smithi027.stdout:Complete! 2023-11-29T08:55:56.030 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum -y install python3-rbd 2023-11-29T08:55:56.638 INFO:teuthology.orchestra.run.smithi027.stdout:Last metadata expiration check: 0:07:09 ago on Wed 29 Nov 2023 08:48:47 AM UTC. 2023-11-29T08:55:56.736 INFO:teuthology.orchestra.run.smithi027.stdout:Package python3-rbd-2:18.0.0-7483.g412bfade.el9.x86_64 is already installed. 2023-11-29T08:55:56.789 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. 2023-11-29T08:55:56.790 INFO:teuthology.orchestra.run.smithi027.stdout:Nothing to do. 2023-11-29T08:55:56.790 INFO:teuthology.orchestra.run.smithi027.stdout:Complete! 2023-11-29T08:55:56.855 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum -y install rbd-fuse 2023-11-29T08:55:57.474 INFO:teuthology.orchestra.run.smithi027.stdout:Last metadata expiration check: 0:07:10 ago on Wed 29 Nov 2023 08:48:47 AM UTC. 2023-11-29T08:55:57.625 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. 2023-11-29T08:55:57.626 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2023-11-29T08:55:57.626 INFO:teuthology.orchestra.run.smithi027.stdout: Package Architecture Version Repository Size 2023-11-29T08:55:57.626 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2023-11-29T08:55:57.626 INFO:teuthology.orchestra.run.smithi027.stdout:Installing: 2023-11-29T08:55:57.626 INFO:teuthology.orchestra.run.smithi027.stdout: rbd-fuse x86_64 2:18.0.0-7483.g412bfade.el9 ceph 86 k 2023-11-29T08:55:57.626 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:55:57.626 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction Summary 2023-11-29T08:55:57.626 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2023-11-29T08:55:57.627 INFO:teuthology.orchestra.run.smithi027.stdout:Install 1 Package 2023-11-29T08:55:57.627 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:55:57.627 INFO:teuthology.orchestra.run.smithi027.stdout:Total download size: 86 k 2023-11-29T08:55:57.627 INFO:teuthology.orchestra.run.smithi027.stdout:Installed size: 256 k 2023-11-29T08:55:57.627 INFO:teuthology.orchestra.run.smithi027.stdout:Downloading Packages: 2023-11-29T08:55:57.835 INFO:teuthology.orchestra.run.smithi027.stdout:rbd-fuse-18.0.0-7483.g412bfade.el9.x86_64.rpm 413 kB/s | 86 kB 00:00 2023-11-29T08:55:57.836 INFO:teuthology.orchestra.run.smithi027.stdout:-------------------------------------------------------------------------------- 2023-11-29T08:55:57.836 INFO:teuthology.orchestra.run.smithi027.stdout:Total 410 kB/s | 86 kB 00:00 2023-11-29T08:55:57.836 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction check 2023-11-29T08:55:57.843 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction check succeeded. 2023-11-29T08:55:57.843 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction test 2023-11-29T08:55:57.901 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction test succeeded. 2023-11-29T08:55:57.901 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction 2023-11-29T08:55:58.039 INFO:teuthology.orchestra.run.smithi027.stdout: Preparing : 1/1 2023-11-29T08:55:58.144 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : rbd-fuse-2:18.0.0-7483.g412bfade.el9.x86_64 1/1 2023-11-29T08:55:58.505 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: rbd-fuse-2:18.0.0-7483.g412bfade.el9.x86_64 1/1 2023-11-29T08:55:58.834 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : rbd-fuse-2:18.0.0-7483.g412bfade.el9.x86_64 1/1 2023-11-29T08:55:58.834 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:55:58.834 INFO:teuthology.orchestra.run.smithi027.stdout:Installed: 2023-11-29T08:55:58.834 INFO:teuthology.orchestra.run.smithi027.stdout: rbd-fuse-2:18.0.0-7483.g412bfade.el9.x86_64 2023-11-29T08:55:58.834 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:55:58.834 INFO:teuthology.orchestra.run.smithi027.stdout:Complete! 2023-11-29T08:55:59.055 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum -y install rbd-mirror 2023-11-29T08:55:59.666 INFO:teuthology.orchestra.run.smithi027.stdout:Last metadata expiration check: 0:07:12 ago on Wed 29 Nov 2023 08:48:47 AM UTC. 2023-11-29T08:55:59.816 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. 2023-11-29T08:55:59.816 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2023-11-29T08:55:59.816 INFO:teuthology.orchestra.run.smithi027.stdout: Package Arch Version Repo Size 2023-11-29T08:55:59.816 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2023-11-29T08:55:59.817 INFO:teuthology.orchestra.run.smithi027.stdout:Installing: 2023-11-29T08:55:59.817 INFO:teuthology.orchestra.run.smithi027.stdout: rbd-mirror x86_64 2:18.0.0-7483.g412bfade.el9 ceph 3.0 M 2023-11-29T08:55:59.817 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:55:59.817 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction Summary 2023-11-29T08:55:59.817 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2023-11-29T08:55:59.817 INFO:teuthology.orchestra.run.smithi027.stdout:Install 1 Package 2023-11-29T08:55:59.817 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:55:59.817 INFO:teuthology.orchestra.run.smithi027.stdout:Total download size: 3.0 M 2023-11-29T08:55:59.817 INFO:teuthology.orchestra.run.smithi027.stdout:Installed size: 13 M 2023-11-29T08:55:59.818 INFO:teuthology.orchestra.run.smithi027.stdout:Downloading Packages: 2023-11-29T08:56:00.904 INFO:teuthology.orchestra.run.smithi027.stdout:rbd-mirror-18.0.0-7483.g412bfade.el9.x86_64.rpm 2.7 MB/s | 3.0 MB 00:01 2023-11-29T08:56:00.905 INFO:teuthology.orchestra.run.smithi027.stdout:-------------------------------------------------------------------------------- 2023-11-29T08:56:00.906 INFO:teuthology.orchestra.run.smithi027.stdout:Total 2.7 MB/s | 3.0 MB 00:01 2023-11-29T08:56:00.906 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction check 2023-11-29T08:56:00.917 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction check succeeded. 2023-11-29T08:56:00.918 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction test 2023-11-29T08:56:00.997 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction test succeeded. 2023-11-29T08:56:00.998 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction 2023-11-29T08:56:01.451 INFO:teuthology.orchestra.run.smithi027.stdout: Preparing : 1/1 2023-11-29T08:56:01.505 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : rbd-mirror-2:18.0.0-7483.g412bfade.el9.x86_64 1/1 2023-11-29T08:56:01.530 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: rbd-mirror-2:18.0.0-7483.g412bfade.el9.x86_64 1/1 2023-11-29T08:56:01.530 INFO:teuthology.orchestra.run.smithi027.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-29T08:56:01.530 INFO:teuthology.orchestra.run.smithi027.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-11-29T08:56:01.530 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-29T08:56:01.530 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-29T08:56:01.531 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:56:02.706 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : rbd-mirror-2:18.0.0-7483.g412bfade.el9.x86_64 1/1 2023-11-29T08:56:02.706 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:56:02.706 INFO:teuthology.orchestra.run.smithi027.stdout:Installed: 2023-11-29T08:56:02.706 INFO:teuthology.orchestra.run.smithi027.stdout: rbd-mirror-2:18.0.0-7483.g412bfade.el9.x86_64 2023-11-29T08:56:02.706 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:56:02.706 INFO:teuthology.orchestra.run.smithi027.stdout:Complete! 2023-11-29T08:56:02.926 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum -y install rbd-nbd 2023-11-29T08:56:03.539 INFO:teuthology.orchestra.run.smithi027.stdout:Last metadata expiration check: 0:07:16 ago on Wed 29 Nov 2023 08:48:47 AM UTC. 2023-11-29T08:56:03.691 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. 2023-11-29T08:56:03.691 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2023-11-29T08:56:03.692 INFO:teuthology.orchestra.run.smithi027.stdout: Package Architecture Version Repository Size 2023-11-29T08:56:03.692 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2023-11-29T08:56:03.692 INFO:teuthology.orchestra.run.smithi027.stdout:Installing: 2023-11-29T08:56:03.692 INFO:teuthology.orchestra.run.smithi027.stdout: rbd-nbd x86_64 2:18.0.0-7483.g412bfade.el9 ceph 169 k 2023-11-29T08:56:03.692 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:56:03.692 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction Summary 2023-11-29T08:56:03.692 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2023-11-29T08:56:03.692 INFO:teuthology.orchestra.run.smithi027.stdout:Install 1 Package 2023-11-29T08:56:03.692 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:56:03.693 INFO:teuthology.orchestra.run.smithi027.stdout:Total download size: 169 k 2023-11-29T08:56:03.693 INFO:teuthology.orchestra.run.smithi027.stdout:Installed size: 536 k 2023-11-29T08:56:03.693 INFO:teuthology.orchestra.run.smithi027.stdout:Downloading Packages: 2023-11-29T08:56:04.141 INFO:teuthology.orchestra.run.smithi027.stdout:rbd-nbd-18.0.0-7483.g412bfade.el9.x86_64.rpm 377 kB/s | 169 kB 00:00 2023-11-29T08:56:04.141 INFO:teuthology.orchestra.run.smithi027.stdout:-------------------------------------------------------------------------------- 2023-11-29T08:56:04.142 INFO:teuthology.orchestra.run.smithi027.stdout:Total 376 kB/s | 169 kB 00:00 2023-11-29T08:56:04.142 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction check 2023-11-29T08:56:04.150 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction check succeeded. 2023-11-29T08:56:04.150 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction test 2023-11-29T08:56:04.209 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction test succeeded. 2023-11-29T08:56:04.210 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction 2023-11-29T08:56:04.365 INFO:teuthology.orchestra.run.smithi027.stdout: Preparing : 1/1 2023-11-29T08:56:04.460 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : rbd-nbd-2:18.0.0-7483.g412bfade.el9.x86_64 1/1 2023-11-29T08:56:04.898 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: rbd-nbd-2:18.0.0-7483.g412bfade.el9.x86_64 1/1 2023-11-29T08:56:05.224 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : rbd-nbd-2:18.0.0-7483.g412bfade.el9.x86_64 1/1 2023-11-29T08:56:05.224 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:56:05.224 INFO:teuthology.orchestra.run.smithi027.stdout:Installed: 2023-11-29T08:56:05.224 INFO:teuthology.orchestra.run.smithi027.stdout: rbd-nbd-2:18.0.0-7483.g412bfade.el9.x86_64 2023-11-29T08:56:05.224 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:56:05.224 INFO:teuthology.orchestra.run.smithi027.stdout:Complete! 2023-11-29T08:56:05.479 DEBUG:teuthology.parallel:result is None 2023-11-29T08:56:05.480 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=412bfade5c44735b71d7c14eb55649269cd32a35 2023-11-29T08:56:05.754 DEBUG:teuthology.orchestra.run.smithi027:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-29T08:56:05.775 INFO:teuthology.orchestra.run.smithi027.stdout:18.0.0-7483.g412bfade.el9 2023-11-29T08:56:05.776 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7483.g412bfade.el9 2023-11-29T08:56:05.776 INFO:teuthology.task.install:The correct ceph version 18.0.0-7483.g412bfade is installed. 2023-11-29T08:56:05.776 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=412bfade5c44735b71d7c14eb55649269cd32a35 2023-11-29T08:56:05.920 DEBUG:teuthology.orchestra.run.smithi139:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-29T08:56:05.945 INFO:teuthology.orchestra.run.smithi139.stdout:18.0.0-7483.g412bfade.el9 2023-11-29T08:56:05.945 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7483.g412bfade.el9 2023-11-29T08:56:05.945 INFO:teuthology.task.install:The correct ceph version 18.0.0-7483.g412bfade is installed. 2023-11-29T08:56:05.945 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-11-29T08:56:05.946 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-11-29T08:56:05.946 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-29T08:56:05.978 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2023-11-29T08:56:05.978 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-29T08:56:06.018 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-11-29T08:56:06.019 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-11-29T08:56:06.019 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/usr/bin/daemon-helper 2023-11-29T08:56:06.050 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-29T08:56:06.121 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2023-11-29T08:56:06.121 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/usr/bin/daemon-helper 2023-11-29T08:56:06.151 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-29T08:56:06.219 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-11-29T08:56:06.219 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-11-29T08:56:06.219 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-29T08:56:06.250 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-29T08:56:06.319 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2023-11-29T08:56:06.319 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-29T08:56:06.347 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-29T08:56:06.415 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-11-29T08:56:06.415 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-11-29T08:56:06.415 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/usr/bin/stdin-killer 2023-11-29T08:56:06.446 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-29T08:56:06.516 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2023-11-29T08:56:06.516 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/usr/bin/stdin-killer 2023-11-29T08:56:06.543 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-29T08:56:06.610 INFO:teuthology.run_tasks:Running task ceph... 2023-11-29T08:56:06.672 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-11-29T08:56:06.672 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 777 /var/log/ceph 2023-11-29T08:56:06.675 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 777 /var/log/ceph 2023-11-29T08:56:06.703 INFO:tasks.ceph:Disabling ceph logrotate... 2023-11-29T08:56:06.703 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-29T08:56:06.746 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-29T08:56:06.774 INFO:tasks.ceph:Creating extra log directories... 2023-11-29T08:56:06.775 DEBUG:teuthology.orchestra.run.smithi027:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-29T08:56:06.817 DEBUG:teuthology.orchestra.run.smithi139:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-29T08:56:06.853 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-11-29T08:56:06.853 INFO:tasks.ceph:config {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'crimson seastar smp': 3, 'debug ms': 1, 'debug osd': 20, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd shutdown pgref assert': True}, 'client': {'debug ms': 1}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-11-29T08:56:06.853 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/matan-2023-11-29_08:30:41-crimson-rados-wip-matanb-crimson-snaptrimevent-lifetime-v2-distro-crimson-smithi/7470475', 'branch': 'wip-matanb-crimson-snaptrimevent-lifetime-v2', 'description': 'crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rados_api_tests}', 'email': None, 'first_in_suite': False, 'job_id': '7470475', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'matan-2023-11-29_08:30:41-crimson-rados-wip-matanb-crimson-snaptrimevent-lifetime-v2-distro-crimson-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-matanb-crimson-snaptrimevent-lifetime-v2'}, 'ceph': {'conf': {'client': {'debug ms': 1}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'osd': {'crimson seastar smp': 3, 'debug ms': 1, 'debug osd': 20, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd shutdown pgref assert': True}}, 'flavor': 'crimson', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'sha1': '412bfade5c44735b71d7c14eb55649269cd32a35'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'crimson', 'sha1': '412bfade5c44735b71d7c14eb55649269cd32a35'}}, 'workunit': {'branch': 'main', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': '3d760f113bd9f3a2e513474d34227633cd06f1ea'}}, 'owner': 'scheduled_matan@teuthology', 'priority': 60, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'], ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 4297, 'sha1': '412bfade5c44735b71d7c14eb55649269cd32a35', 'sleep_before_teardown': 0, 'suite': 'crimson-rados', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph_3d760f113bd9f3a2e513474d34227633cd06f1ea/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph.git', 'suite_sha1': '3d760f113bd9f3a2e513474d34227633cd06f1ea', 'targets': {'smithi027.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLQR7FSsM2WG3bXLSyzCfiqjoRZynboasDBaX+6yp30CSoYVR34oL7LJIIvOpNSVnLht3UOfgZV/B9cLBjK3TCQ=', 'smithi139.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFcL3nDrki+eYUfUljt+Tv4/NglX6E0ioeMMbcbLmTVq5cwRywPFKOvY7pMHRugFQhr24ZNA8MTH7lpIphM1hh0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'crimson seastar smp': 3, 'debug ms': 1, 'debug osd': 20, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd shutdown pgref assert': True}, 'client': {'debug ms': 1}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}}, 'flavor': 'crimson', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'sha1': '412bfade5c44735b71d7c14eb55649269cd32a35', 'cluster': 'ceph'}}, {'workunit': {'clients': {'client.0': ['rados/test.sh', 'rados/test_pool_quota.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '735a43c3d8e74286f980f1d14817fb093cd8147e', 'timestamp': '2023-11-29_08:30:41', 'tube': 'smithi', 'user': 'matan', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.232157'} 2023-11-29T08:56:06.854 DEBUG:teuthology.orchestra.run.smithi027:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-29T08:56:06.888 DEBUG:teuthology.orchestra.run.smithi139:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-29T08:56:06.902 DEBUG:teuthology.orchestra.run.smithi027:> sudo install -d -m0777 -- /var/run/ceph 2023-11-29T08:56:06.942 DEBUG:teuthology.orchestra.run.smithi139:> sudo install -d -m0777 -- /var/run/ceph 2023-11-29T08:56:06.971 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-11-29T08:56:06.971 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/scratch_devs of=/dev/stdout 2023-11-29T08:56:07.026 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-29T08:56:07.026 DEBUG:teuthology.orchestra.run.smithi027:> stat /dev/vg_nvme/lv_1 2023-11-29T08:56:07.081 INFO:teuthology.orchestra.run.smithi027.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-29T08:56:07.082 INFO:teuthology.orchestra.run.smithi027.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-29T08:56:07.082 INFO:teuthology.orchestra.run.smithi027.stdout:Device: 5h/5d Inode: 665 Links: 1 2023-11-29T08:56:07.082 INFO:teuthology.orchestra.run.smithi027.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-29T08:56:07.082 INFO:teuthology.orchestra.run.smithi027.stdout:Context: system_u:object_r:device_t:s0 2023-11-29T08:56:07.082 INFO:teuthology.orchestra.run.smithi027.stdout:Access: 2023-11-29 08:56:01.767856819 +0000 2023-11-29T08:56:07.082 INFO:teuthology.orchestra.run.smithi027.stdout:Modify: 2023-11-29 08:47:54.930163334 +0000 2023-11-29T08:56:07.082 INFO:teuthology.orchestra.run.smithi027.stdout:Change: 2023-11-29 08:47:54.930163334 +0000 2023-11-29T08:56:07.082 INFO:teuthology.orchestra.run.smithi027.stdout: Birth: 2023-11-29 08:47:54.930163334 +0000 2023-11-29T08:56:07.082 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-29T08:56:07.151 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records in 2023-11-29T08:56:07.151 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records out 2023-11-29T08:56:07.151 INFO:teuthology.orchestra.run.smithi027.stderr:512 bytes copied, 0.000204573 s, 2.5 MB/s 2023-11-29T08:56:07.153 DEBUG:teuthology.orchestra.run.smithi027:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-29T08:56:07.209 DEBUG:teuthology.orchestra.run.smithi027:> stat /dev/vg_nvme/lv_2 2023-11-29T08:56:07.266 INFO:teuthology.orchestra.run.smithi027.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-29T08:56:07.266 INFO:teuthology.orchestra.run.smithi027.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-29T08:56:07.266 INFO:teuthology.orchestra.run.smithi027.stdout:Device: 5h/5d Inode: 683 Links: 1 2023-11-29T08:56:07.266 INFO:teuthology.orchestra.run.smithi027.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-29T08:56:07.266 INFO:teuthology.orchestra.run.smithi027.stdout:Context: system_u:object_r:device_t:s0 2023-11-29T08:56:07.266 INFO:teuthology.orchestra.run.smithi027.stdout:Access: 2023-11-29 08:56:01.768856792 +0000 2023-11-29T08:56:07.266 INFO:teuthology.orchestra.run.smithi027.stdout:Modify: 2023-11-29 08:47:55.424150382 +0000 2023-11-29T08:56:07.266 INFO:teuthology.orchestra.run.smithi027.stdout:Change: 2023-11-29 08:47:55.424150382 +0000 2023-11-29T08:56:07.266 INFO:teuthology.orchestra.run.smithi027.stdout: Birth: 2023-11-29 08:47:55.424150382 +0000 2023-11-29T08:56:07.267 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-29T08:56:07.337 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records in 2023-11-29T08:56:07.337 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records out 2023-11-29T08:56:07.337 INFO:teuthology.orchestra.run.smithi027.stderr:512 bytes copied, 0.000245022 s, 2.1 MB/s 2023-11-29T08:56:07.338 DEBUG:teuthology.orchestra.run.smithi027:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-29T08:56:07.395 DEBUG:teuthology.orchestra.run.smithi027:> stat /dev/vg_nvme/lv_3 2023-11-29T08:56:07.450 INFO:teuthology.orchestra.run.smithi027.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-29T08:56:07.451 INFO:teuthology.orchestra.run.smithi027.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-29T08:56:07.451 INFO:teuthology.orchestra.run.smithi027.stdout:Device: 5h/5d Inode: 702 Links: 1 2023-11-29T08:56:07.451 INFO:teuthology.orchestra.run.smithi027.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-29T08:56:07.451 INFO:teuthology.orchestra.run.smithi027.stdout:Context: system_u:object_r:device_t:s0 2023-11-29T08:56:07.451 INFO:teuthology.orchestra.run.smithi027.stdout:Access: 2023-11-29 08:56:01.768856792 +0000 2023-11-29T08:56:07.451 INFO:teuthology.orchestra.run.smithi027.stdout:Modify: 2023-11-29 08:47:56.008135069 +0000 2023-11-29T08:56:07.451 INFO:teuthology.orchestra.run.smithi027.stdout:Change: 2023-11-29 08:47:56.008135069 +0000 2023-11-29T08:56:07.451 INFO:teuthology.orchestra.run.smithi027.stdout: Birth: 2023-11-29 08:47:56.008135069 +0000 2023-11-29T08:56:07.451 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-29T08:56:07.521 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records in 2023-11-29T08:56:07.521 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records out 2023-11-29T08:56:07.521 INFO:teuthology.orchestra.run.smithi027.stderr:512 bytes copied, 0.000202524 s, 2.5 MB/s 2023-11-29T08:56:07.522 DEBUG:teuthology.orchestra.run.smithi027:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-29T08:56:07.578 DEBUG:teuthology.orchestra.run.smithi027:> stat /dev/vg_nvme/lv_4 2023-11-29T08:56:07.633 INFO:teuthology.orchestra.run.smithi027.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-29T08:56:07.634 INFO:teuthology.orchestra.run.smithi027.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-29T08:56:07.634 INFO:teuthology.orchestra.run.smithi027.stdout:Device: 5h/5d Inode: 721 Links: 1 2023-11-29T08:56:07.634 INFO:teuthology.orchestra.run.smithi027.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-29T08:56:07.634 INFO:teuthology.orchestra.run.smithi027.stdout:Context: system_u:object_r:device_t:s0 2023-11-29T08:56:07.634 INFO:teuthology.orchestra.run.smithi027.stdout:Access: 2023-11-29 08:56:01.769856765 +0000 2023-11-29T08:56:07.634 INFO:teuthology.orchestra.run.smithi027.stdout:Modify: 2023-11-29 08:47:56.493122353 +0000 2023-11-29T08:56:07.634 INFO:teuthology.orchestra.run.smithi027.stdout:Change: 2023-11-29 08:47:56.493122353 +0000 2023-11-29T08:56:07.634 INFO:teuthology.orchestra.run.smithi027.stdout: Birth: 2023-11-29 08:47:56.493122353 +0000 2023-11-29T08:56:07.634 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-29T08:56:07.703 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records in 2023-11-29T08:56:07.703 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records out 2023-11-29T08:56:07.703 INFO:teuthology.orchestra.run.smithi027.stderr:512 bytes copied, 0.000175279 s, 2.9 MB/s 2023-11-29T08:56:07.704 DEBUG:teuthology.orchestra.run.smithi027:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-29T08:56:07.760 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2023-11-29T08:56:07.760 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2023-11-29T08:56:07.760 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/scratch_devs of=/dev/stdout 2023-11-29T08:56:07.776 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-29T08:56:07.776 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_1 2023-11-29T08:56:07.831 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-29T08:56:07.831 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-29T08:56:07.832 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 5h/5d Inode: 662 Links: 1 2023-11-29T08:56:07.832 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-29T08:56:07.832 INFO:teuthology.orchestra.run.smithi139.stdout:Context: system_u:object_r:device_t:s0 2023-11-29T08:56:07.832 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2023-11-29 08:55:25.942295555 +0000 2023-11-29T08:56:07.832 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2023-11-29 08:47:49.243983401 +0000 2023-11-29T08:56:07.832 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2023-11-29 08:47:49.243983401 +0000 2023-11-29T08:56:07.832 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: 2023-11-29 08:47:49.243983401 +0000 2023-11-29T08:56:07.832 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-29T08:56:07.897 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2023-11-29T08:56:07.897 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2023-11-29T08:56:07.897 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000207075 s, 2.5 MB/s 2023-11-29T08:56:07.898 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-29T08:56:07.954 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_2 2023-11-29T08:56:08.008 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-29T08:56:08.008 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-29T08:56:08.008 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 5h/5d Inode: 681 Links: 1 2023-11-29T08:56:08.008 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-29T08:56:08.008 INFO:teuthology.orchestra.run.smithi139.stdout:Context: system_u:object_r:device_t:s0 2023-11-29T08:56:08.008 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2023-11-29 08:55:25.942295555 +0000 2023-11-29T08:56:08.008 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2023-11-29 08:47:49.735972828 +0000 2023-11-29T08:56:08.008 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2023-11-29 08:47:49.735972828 +0000 2023-11-29T08:56:08.008 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: 2023-11-29 08:47:49.735972828 +0000 2023-11-29T08:56:08.009 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-29T08:56:08.073 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2023-11-29T08:56:08.073 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2023-11-29T08:56:08.073 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000216979 s, 2.4 MB/s 2023-11-29T08:56:08.075 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-29T08:56:08.130 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_3 2023-11-29T08:56:08.184 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-29T08:56:08.184 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-29T08:56:08.184 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 5h/5d Inode: 700 Links: 1 2023-11-29T08:56:08.184 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-29T08:56:08.184 INFO:teuthology.orchestra.run.smithi139.stdout:Context: system_u:object_r:device_t:s0 2023-11-29T08:56:08.184 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2023-11-29 08:55:25.942295555 +0000 2023-11-29T08:56:08.184 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2023-11-29 08:47:50.236962062 +0000 2023-11-29T08:56:08.184 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2023-11-29 08:47:50.236962062 +0000 2023-11-29T08:56:08.184 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: 2023-11-29 08:47:50.236962062 +0000 2023-11-29T08:56:08.185 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-29T08:56:08.249 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2023-11-29T08:56:08.249 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2023-11-29T08:56:08.249 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000190587 s, 2.7 MB/s 2023-11-29T08:56:08.250 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-29T08:56:08.305 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_4 2023-11-29T08:56:08.359 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-29T08:56:08.359 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-29T08:56:08.359 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 5h/5d Inode: 721 Links: 1 2023-11-29T08:56:08.359 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-29T08:56:08.359 INFO:teuthology.orchestra.run.smithi139.stdout:Context: system_u:object_r:device_t:s0 2023-11-29T08:56:08.360 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2023-11-29 08:55:25.943295533 +0000 2023-11-29T08:56:08.360 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2023-11-29 08:47:50.706952029 +0000 2023-11-29T08:56:08.360 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2023-11-29 08:47:50.706952029 +0000 2023-11-29T08:56:08.360 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: 2023-11-29 08:47:50.706952029 +0000 2023-11-29T08:56:08.360 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-29T08:56:08.425 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2023-11-29T08:56:08.425 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2023-11-29T08:56:08.425 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000194648 s, 2.6 MB/s 2023-11-29T08:56:08.426 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-29T08:56:08.481 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2023-11-29T08:56:08.482 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi027.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi139.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2023-11-29T08:56:08.482 INFO:tasks.ceph:Generating config... 2023-11-29T08:56:08.483 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2023-11-29T08:56:08.483 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2023-11-29T08:56:08.483 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2023-11-29T08:56:08.483 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2023-11-29T08:56:08.483 INFO:tasks.ceph:[mon] paxos service trim min = 10 2023-11-29T08:56:08.483 INFO:tasks.ceph:[mon] debug mon = 20 2023-11-29T08:56:08.483 INFO:tasks.ceph:[mon] debug ms = 1 2023-11-29T08:56:08.483 INFO:tasks.ceph:[mon] debug paxos = 20 2023-11-29T08:56:08.483 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2023-11-29T08:56:08.483 INFO:tasks.ceph:[mon] osd pool default crimson = True 2023-11-29T08:56:08.483 INFO:tasks.ceph:[osd] debug monc = 20 2023-11-29T08:56:08.483 INFO:tasks.ceph:[osd] crimson seastar smp = 3 2023-11-29T08:56:08.483 INFO:tasks.ceph:[osd] debug ms = 1 2023-11-29T08:56:08.484 INFO:tasks.ceph:[osd] debug osd = 20 2023-11-29T08:56:08.484 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2023-11-29T08:56:08.484 INFO:tasks.ceph:[osd] osd class default list = * 2023-11-29T08:56:08.484 INFO:tasks.ceph:[osd] osd class load list = * 2023-11-29T08:56:08.484 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2023-11-29T08:56:08.484 INFO:tasks.ceph:[client] debug ms = 1 2023-11-29T08:56:08.484 INFO:tasks.ceph:[global] enable experimental unrecoverable data corrupting features = crimson 2023-11-29T08:56:08.484 INFO:tasks.ceph:[global] ms client mode = crc 2023-11-29T08:56:08.484 INFO:tasks.ceph:[global] ms cluster mode = crc 2023-11-29T08:56:08.484 INFO:tasks.ceph:[global] ms mon client mode = crc 2023-11-29T08:56:08.484 INFO:tasks.ceph:[global] ms mon cluster mode = crc 2023-11-29T08:56:08.484 INFO:tasks.ceph:[global] ms mon service mode = crc 2023-11-29T08:56:08.484 INFO:tasks.ceph:[global] ms service mode = crc 2023-11-29T08:56:08.484 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-11-29T08:56:08.484 INFO:tasks.ceph:[mgr] debug ms = 1 2023-11-29T08:56:08.484 INFO:tasks.ceph:Setting up mon.a... 2023-11-29T08:56:08.485 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-11-29T08:56:08.539 INFO:teuthology.orchestra.run.smithi027.stdout:creating /etc/ceph/ceph.keyring 2023-11-29T08:56:08.542 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-11-29T08:56:08.596 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-29T08:56:08.626 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.27')] 2023-11-29T08:56:08.626 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.27', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'crimson seastar smp': 3, 'debug ms': 1, 'debug osd': 20, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1}, 'mon.a': {}} 2023-11-29T08:56:08.627 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-11-29T08:56:08.627 DEBUG:teuthology.orchestra.run.smithi027:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-11-29T08:56:08.681 DEBUG:teuthology.orchestra.run.smithi027:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.27 --print /home/ubuntu/cephtest/ceph.monmap 2023-11-29T08:56:08.766 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:08.765+0000 7fe8e3dd9e80 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:56:08.767 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:08.765+0000 7fe8e3dd9e80 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:56:08.767 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:08.765+0000 7fe8e3dd9e80 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:56:08.767 INFO:teuthology.orchestra.run.smithi027.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-11-29T08:56:08.767 INFO:teuthology.orchestra.run.smithi027.stdout:monmaptool: generated fsid ae0bf9e4-fe2e-415c-890c-a9a3fac76480 2023-11-29T08:56:08.767 INFO:teuthology.orchestra.run.smithi027.stdout:setting min_mon_release = pacific 2023-11-29T08:56:08.767 INFO:teuthology.orchestra.run.smithi027.stdout:epoch 0 2023-11-29T08:56:08.767 INFO:teuthology.orchestra.run.smithi027.stdout:fsid ae0bf9e4-fe2e-415c-890c-a9a3fac76480 2023-11-29T08:56:08.767 INFO:teuthology.orchestra.run.smithi027.stdout:last_changed 2023-11-29T08:56:08.767210+0000 2023-11-29T08:56:08.767 INFO:teuthology.orchestra.run.smithi027.stdout:created 2023-11-29T08:56:08.767210+0000 2023-11-29T08:56:08.767 INFO:teuthology.orchestra.run.smithi027.stdout:min_mon_release 16 (pacific) 2023-11-29T08:56:08.768 INFO:teuthology.orchestra.run.smithi027.stdout:election_strategy: 1 2023-11-29T08:56:08.768 INFO:teuthology.orchestra.run.smithi027.stdout:0: [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] mon.a 2023-11-29T08:56:08.768 INFO:teuthology.orchestra.run.smithi027.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2023-11-29T08:56:08.769 DEBUG:teuthology.orchestra.run.smithi027:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-11-29T08:56:08.783 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID ae0bf9e4-fe2e-415c-890c-a9a3fac76480... 2023-11-29T08:56:08.784 DEBUG:teuthology.orchestra.run.smithi027:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-29T08:56:08.826 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-29T08:56:08.876 INFO:teuthology.orchestra.run.smithi139.stdout:[global] 2023-11-29T08:56:08.876 INFO:teuthology.orchestra.run.smithi139.stdout: chdir = "" 2023-11-29T08:56:08.876 INFO:teuthology.orchestra.run.smithi139.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-29T08:56:08.876 INFO:teuthology.orchestra.run.smithi139.stdout: auth supported = cephx 2023-11-29T08:56:08.876 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:56:08.876 INFO:teuthology.orchestra.run.smithi139.stdout: filestore xattr use omap = true 2023-11-29T08:56:08.876 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:56:08.877 INFO:teuthology.orchestra.run.smithi139.stdout: mon clock drift allowed = 1.000 2023-11-29T08:56:08.877 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:56:08.877 INFO:teuthology.orchestra.run.smithi139.stdout: osd crush chooseleaf type = 0 2023-11-29T08:56:08.877 INFO:teuthology.orchestra.run.smithi139.stdout: auth debug = true 2023-11-29T08:56:08.877 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:56:08.877 INFO:teuthology.orchestra.run.smithi139.stdout: ms die on old message = true 2023-11-29T08:56:08.877 INFO:teuthology.orchestra.run.smithi139.stdout: ms die on bug = true 2023-11-29T08:56:08.877 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:56:08.877 INFO:teuthology.orchestra.run.smithi139.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-29T08:56:08.877 INFO:teuthology.orchestra.run.smithi139.stdout: mon pg warn max object skew = 0 2023-11-29T08:56:08.877 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:56:08.877 INFO:teuthology.orchestra.run.smithi139.stdout: # disable pg_autoscaler by default for new pools 2023-11-29T08:56:08.877 INFO:teuthology.orchestra.run.smithi139.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-29T08:56:08.877 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:56:08.877 INFO:teuthology.orchestra.run.smithi139.stdout: osd pool default size = 2 2023-11-29T08:56:08.878 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:56:08.878 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd allow primary affinity = true 2023-11-29T08:56:08.878 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd allow pg remap = true 2023-11-29T08:56:08.878 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on legacy crush tunables = false 2023-11-29T08:56:08.878 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on crush straw calc version zero = false 2023-11-29T08:56:08.878 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on no sortbitwise = false 2023-11-29T08:56:08.878 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on osd down out interval zero = false 2023-11-29T08:56:08.878 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on too few osds = false 2023-11-29T08:56:08.878 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-29T08:56:08.878 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-29T08:56:08.878 INFO:teuthology.orchestra.run.smithi139.stdout: mon_allow_pool_size_one = true 2023-11-29T08:56:08.878 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:56:08.878 INFO:teuthology.orchestra.run.smithi139.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-29T08:56:08.878 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:56:08.878 INFO:teuthology.orchestra.run.smithi139.stdout: osd default data pool replay window = 5 2023-11-29T08:56:08.879 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:56:08.879 INFO:teuthology.orchestra.run.smithi139.stdout: mon allow pool delete = true 2023-11-29T08:56:08.879 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:56:08.879 INFO:teuthology.orchestra.run.smithi139.stdout: mon cluster log file level = debug 2023-11-29T08:56:08.879 INFO:teuthology.orchestra.run.smithi139.stdout: debug asserts on shutdown = true 2023-11-29T08:56:08.879 INFO:teuthology.orchestra.run.smithi139.stdout: mon health detail to clog = false 2023-11-29T08:56:08.879 INFO:teuthology.orchestra.run.smithi139.stdout: mon host = 172.21.15.27 2023-11-29T08:56:08.879 INFO:teuthology.orchestra.run.smithi139.stdout: enable experimental unrecoverable data corrupting features = crimson 2023-11-29T08:56:08.879 INFO:teuthology.orchestra.run.smithi139.stdout: ms client mode = crc 2023-11-29T08:56:08.879 INFO:teuthology.orchestra.run.smithi139.stdout: ms cluster mode = crc 2023-11-29T08:56:08.879 INFO:teuthology.orchestra.run.smithi139.stdout: ms mon client mode = crc 2023-11-29T08:56:08.879 INFO:teuthology.orchestra.run.smithi139.stdout: ms mon cluster mode = crc 2023-11-29T08:56:08.879 INFO:teuthology.orchestra.run.smithi139.stdout: ms mon service mode = crc 2023-11-29T08:56:08.879 INFO:teuthology.orchestra.run.smithi139.stdout: ms service mode = crc 2023-11-29T08:56:08.879 INFO:teuthology.orchestra.run.smithi139.stdout: fsid = ae0bf9e4-fe2e-415c-890c-a9a3fac76480 2023-11-29T08:56:08.879 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:56:08.879 INFO:teuthology.orchestra.run.smithi139.stdout:[osd] 2023-11-29T08:56:08.880 INFO:teuthology.orchestra.run.smithi139.stdout: osd journal size = 100 2023-11-29T08:56:08.880 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:56:08.880 INFO:teuthology.orchestra.run.smithi139.stdout: osd scrub load threshold = 5.0 2023-11-29T08:56:08.880 INFO:teuthology.orchestra.run.smithi139.stdout: osd scrub max interval = 600 2023-11-29T08:56:08.880 INFO:teuthology.orchestra.run.smithi139.stdout: osd mclock profile = high_recovery_ops 2023-11-29T08:56:08.880 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:56:08.880 INFO:teuthology.orchestra.run.smithi139.stdout: osd recover clone overlap = true 2023-11-29T08:56:08.880 INFO:teuthology.orchestra.run.smithi139.stdout: osd recovery max chunk = 1048576 2023-11-29T08:56:08.880 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:56:08.880 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug shutdown = true 2023-11-29T08:56:08.880 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug op order = true 2023-11-29T08:56:08.880 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug verify stray on activate = true 2023-11-29T08:56:08.880 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug trim objects = true 2023-11-29T08:56:08.880 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:56:08.880 INFO:teuthology.orchestra.run.smithi139.stdout: osd open classes on start = true 2023-11-29T08:56:08.880 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug pg log writeout = true 2023-11-29T08:56:08.881 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:56:08.881 INFO:teuthology.orchestra.run.smithi139.stdout: osd deep scrub update digest min age = 30 2023-11-29T08:56:08.881 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:56:08.881 INFO:teuthology.orchestra.run.smithi139.stdout: osd map max advance = 10 2023-11-29T08:56:08.881 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:56:08.881 INFO:teuthology.orchestra.run.smithi139.stdout: journal zero on create = true 2023-11-29T08:56:08.881 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:56:08.881 INFO:teuthology.orchestra.run.smithi139.stdout: filestore ondisk finisher threads = 3 2023-11-29T08:56:08.881 INFO:teuthology.orchestra.run.smithi139.stdout: filestore apply finisher threads = 3 2023-11-29T08:56:08.881 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:56:08.881 INFO:teuthology.orchestra.run.smithi139.stdout: bdev debug aio = true 2023-11-29T08:56:08.881 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug misdirected ops = true 2023-11-29T08:56:08.881 INFO:teuthology.orchestra.run.smithi139.stdout: debug monc = 20 2023-11-29T08:56:08.881 INFO:teuthology.orchestra.run.smithi139.stdout: crimson seastar smp = 3 2023-11-29T08:56:08.881 INFO:teuthology.orchestra.run.smithi139.stdout: debug ms = 1 2023-11-29T08:56:08.882 INFO:teuthology.orchestra.run.smithi139.stdout: debug osd = 20 2023-11-29T08:56:08.882 INFO:teuthology.orchestra.run.smithi139.stdout: osd blocked scrub grace period = 3600 2023-11-29T08:56:08.882 INFO:teuthology.orchestra.run.smithi139.stdout: osd class default list = * 2023-11-29T08:56:08.882 INFO:teuthology.orchestra.run.smithi139.stdout: osd class load list = * 2023-11-29T08:56:08.882 INFO:teuthology.orchestra.run.smithi139.stdout: osd shutdown pgref assert = True 2023-11-29T08:56:08.882 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:56:08.882 INFO:teuthology.orchestra.run.smithi139.stdout:[mgr] 2023-11-29T08:56:08.882 INFO:teuthology.orchestra.run.smithi139.stdout: debug ms = 1 2023-11-29T08:56:08.882 INFO:teuthology.orchestra.run.smithi139.stdout: debug mgr = 20 2023-11-29T08:56:08.882 INFO:teuthology.orchestra.run.smithi139.stdout: debug mon = 20 2023-11-29T08:56:08.882 INFO:teuthology.orchestra.run.smithi139.stdout: debug auth = 20 2023-11-29T08:56:08.882 INFO:teuthology.orchestra.run.smithi139.stdout: mon reweight min pgs per osd = 4 2023-11-29T08:56:08.882 INFO:teuthology.orchestra.run.smithi139.stdout: mon reweight min bytes per osd = 10 2023-11-29T08:56:08.882 INFO:teuthology.orchestra.run.smithi139.stdout: mgr/telemetry/nag = false 2023-11-29T08:56:08.882 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:56:08.882 INFO:teuthology.orchestra.run.smithi139.stdout:[mon] 2023-11-29T08:56:08.882 INFO:teuthology.orchestra.run.smithi139.stdout: debug ms = 1 2023-11-29T08:56:08.883 INFO:teuthology.orchestra.run.smithi139.stdout: debug mon = 20 2023-11-29T08:56:08.883 INFO:teuthology.orchestra.run.smithi139.stdout: debug paxos = 20 2023-11-29T08:56:08.883 INFO:teuthology.orchestra.run.smithi139.stdout: debug auth = 20 2023-11-29T08:56:08.883 INFO:teuthology.orchestra.run.smithi139.stdout: mon data avail warn = 5 2023-11-29T08:56:08.883 INFO:teuthology.orchestra.run.smithi139.stdout: mon mgr mkfs grace = 240 2023-11-29T08:56:08.883 INFO:teuthology.orchestra.run.smithi139.stdout: mon reweight min pgs per osd = 4 2023-11-29T08:56:08.883 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd reporter subtree level = osd 2023-11-29T08:56:08.883 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd prime pg temp = true 2023-11-29T08:56:08.883 INFO:teuthology.orchestra.run.smithi139.stdout: mon reweight min bytes per osd = 10 2023-11-29T08:56:08.883 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:56:08.883 INFO:teuthology.orchestra.run.smithi139.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-29T08:56:08.883 INFO:teuthology.orchestra.run.smithi139.stdout: auth mon ticket ttl = 660 # 11m 2023-11-29T08:56:08.883 INFO:teuthology.orchestra.run.smithi139.stdout: auth service ticket ttl = 240 # 4m 2023-11-29T08:56:08.883 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:56:08.883 INFO:teuthology.orchestra.run.smithi139.stdout: # don't complain about insecure global_id in the test suite 2023-11-29T08:56:08.883 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-29T08:56:08.883 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-29T08:56:08.884 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:56:08.884 INFO:teuthology.orchestra.run.smithi139.stdout: # 1m isn't quite enough 2023-11-29T08:56:08.884 INFO:teuthology.orchestra.run.smithi139.stdout: mon_down_mkfs_grace = 2m 2023-11-29T08:56:08.884 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:56:08.884 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_filestore_osds = false 2023-11-29T08:56:08.884 INFO:teuthology.orchestra.run.smithi139.stdout: mon min osdmap epochs = 50 2023-11-29T08:56:08.884 INFO:teuthology.orchestra.run.smithi139.stdout: mon osdmap full prune interval = 2 2023-11-29T08:56:08.884 INFO:teuthology.orchestra.run.smithi139.stdout: mon osdmap full prune min = 15 2023-11-29T08:56:08.884 INFO:teuthology.orchestra.run.smithi139.stdout: mon osdmap full prune txsize = 2 2023-11-29T08:56:08.884 INFO:teuthology.orchestra.run.smithi139.stdout: paxos service trim min = 10 2023-11-29T08:56:08.884 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on pool no app = False 2023-11-29T08:56:08.884 INFO:teuthology.orchestra.run.smithi139.stdout: osd pool default crimson = True 2023-11-29T08:56:08.884 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-11-29T08:56:08.884 INFO:teuthology.orchestra.run.smithi139.stdout:[client] 2023-11-29T08:56:08.884 INFO:teuthology.orchestra.run.smithi139.stdout: rgw cache enabled = true 2023-11-29T08:56:08.884 INFO:teuthology.orchestra.run.smithi139.stdout: rgw enable ops log = true 2023-11-29T08:56:08.884 INFO:teuthology.orchestra.run.smithi139.stdout: rgw enable usage log = true 2023-11-29T08:56:08.884 INFO:teuthology.orchestra.run.smithi139.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-29T08:56:08.885 INFO:teuthology.orchestra.run.smithi139.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-29T08:56:08.885 INFO:teuthology.orchestra.run.smithi139.stdout: debug ms = 1 2023-11-29T08:56:08.885 INFO:teuthology.orchestra.run.smithi139.stdout:[mon.a] 2023-11-29T08:56:08.885 INFO:teuthology.orchestra.run.smithi027.stdout:[global] 2023-11-29T08:56:08.885 INFO:teuthology.orchestra.run.smithi027.stdout: chdir = "" 2023-11-29T08:56:08.885 INFO:teuthology.orchestra.run.smithi027.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-29T08:56:08.885 INFO:teuthology.orchestra.run.smithi027.stdout: auth supported = cephx 2023-11-29T08:56:08.885 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:56:08.885 INFO:teuthology.orchestra.run.smithi027.stdout: filestore xattr use omap = true 2023-11-29T08:56:08.885 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:56:08.886 INFO:teuthology.orchestra.run.smithi027.stdout: mon clock drift allowed = 1.000 2023-11-29T08:56:08.886 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:56:08.886 INFO:teuthology.orchestra.run.smithi027.stdout: osd crush chooseleaf type = 0 2023-11-29T08:56:08.886 INFO:teuthology.orchestra.run.smithi027.stdout: auth debug = true 2023-11-29T08:56:08.886 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:56:08.886 INFO:teuthology.orchestra.run.smithi027.stdout: ms die on old message = true 2023-11-29T08:56:08.886 INFO:teuthology.orchestra.run.smithi027.stdout: ms die on bug = true 2023-11-29T08:56:08.886 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:56:08.886 INFO:teuthology.orchestra.run.smithi027.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-29T08:56:08.886 INFO:teuthology.orchestra.run.smithi027.stdout: mon pg warn max object skew = 0 2023-11-29T08:56:08.886 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:56:08.886 INFO:teuthology.orchestra.run.smithi027.stdout: # disable pg_autoscaler by default for new pools 2023-11-29T08:56:08.886 INFO:teuthology.orchestra.run.smithi027.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-29T08:56:08.886 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:56:08.886 INFO:teuthology.orchestra.run.smithi027.stdout: osd pool default size = 2 2023-11-29T08:56:08.886 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:56:08.887 INFO:teuthology.orchestra.run.smithi027.stdout: mon osd allow primary affinity = true 2023-11-29T08:56:08.887 INFO:teuthology.orchestra.run.smithi027.stdout: mon osd allow pg remap = true 2023-11-29T08:56:08.887 INFO:teuthology.orchestra.run.smithi027.stdout: mon warn on legacy crush tunables = false 2023-11-29T08:56:08.887 INFO:teuthology.orchestra.run.smithi027.stdout: mon warn on crush straw calc version zero = false 2023-11-29T08:56:08.887 INFO:teuthology.orchestra.run.smithi027.stdout: mon warn on no sortbitwise = false 2023-11-29T08:56:08.887 INFO:teuthology.orchestra.run.smithi027.stdout: mon warn on osd down out interval zero = false 2023-11-29T08:56:08.887 INFO:teuthology.orchestra.run.smithi027.stdout: mon warn on too few osds = false 2023-11-29T08:56:08.887 INFO:teuthology.orchestra.run.smithi027.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-29T08:56:08.887 INFO:teuthology.orchestra.run.smithi027.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-29T08:56:08.887 INFO:teuthology.orchestra.run.smithi027.stdout: mon_allow_pool_size_one = true 2023-11-29T08:56:08.887 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:56:08.887 INFO:teuthology.orchestra.run.smithi027.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-29T08:56:08.887 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:56:08.887 INFO:teuthology.orchestra.run.smithi027.stdout: osd default data pool replay window = 5 2023-11-29T08:56:08.887 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:56:08.887 INFO:teuthology.orchestra.run.smithi027.stdout: mon allow pool delete = true 2023-11-29T08:56:08.888 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:56:08.888 INFO:teuthology.orchestra.run.smithi027.stdout: mon cluster log file level = debug 2023-11-29T08:56:08.888 INFO:teuthology.orchestra.run.smithi027.stdout: debug asserts on shutdown = true 2023-11-29T08:56:08.888 INFO:teuthology.orchestra.run.smithi027.stdout: mon health detail to clog = false 2023-11-29T08:56:08.888 INFO:teuthology.orchestra.run.smithi027.stdout: mon host = 172.21.15.27 2023-11-29T08:56:08.888 INFO:teuthology.orchestra.run.smithi027.stdout: enable experimental unrecoverable data corrupting features = crimson 2023-11-29T08:56:08.888 INFO:teuthology.orchestra.run.smithi027.stdout: ms client mode = crc 2023-11-29T08:56:08.888 INFO:teuthology.orchestra.run.smithi027.stdout: ms cluster mode = crc 2023-11-29T08:56:08.888 INFO:teuthology.orchestra.run.smithi027.stdout: ms mon client mode = crc 2023-11-29T08:56:08.888 INFO:teuthology.orchestra.run.smithi027.stdout: ms mon cluster mode = crc 2023-11-29T08:56:08.888 INFO:teuthology.orchestra.run.smithi027.stdout: ms mon service mode = crc 2023-11-29T08:56:08.888 INFO:teuthology.orchestra.run.smithi027.stdout: ms service mode = crc 2023-11-29T08:56:08.888 INFO:teuthology.orchestra.run.smithi027.stdout: fsid = ae0bf9e4-fe2e-415c-890c-a9a3fac76480 2023-11-29T08:56:08.888 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:56:08.888 INFO:teuthology.orchestra.run.smithi027.stdout:[osd] 2023-11-29T08:56:08.888 INFO:teuthology.orchestra.run.smithi027.stdout: osd journal size = 100 2023-11-29T08:56:08.889 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:56:08.889 INFO:teuthology.orchestra.run.smithi027.stdout: osd scrub load threshold = 5.0 2023-11-29T08:56:08.889 INFO:teuthology.orchestra.run.smithi027.stdout: osd scrub max interval = 600 2023-11-29T08:56:08.889 INFO:teuthology.orchestra.run.smithi027.stdout: osd mclock profile = high_recovery_ops 2023-11-29T08:56:08.889 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:56:08.889 INFO:teuthology.orchestra.run.smithi027.stdout: osd recover clone overlap = true 2023-11-29T08:56:08.889 INFO:teuthology.orchestra.run.smithi027.stdout: osd recovery max chunk = 1048576 2023-11-29T08:56:08.889 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:56:08.889 INFO:teuthology.orchestra.run.smithi027.stdout: osd debug shutdown = true 2023-11-29T08:56:08.889 INFO:teuthology.orchestra.run.smithi027.stdout: osd debug op order = true 2023-11-29T08:56:08.889 INFO:teuthology.orchestra.run.smithi027.stdout: osd debug verify stray on activate = true 2023-11-29T08:56:08.889 INFO:teuthology.orchestra.run.smithi027.stdout: osd debug trim objects = true 2023-11-29T08:56:08.889 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:56:08.889 INFO:teuthology.orchestra.run.smithi027.stdout: osd open classes on start = true 2023-11-29T08:56:08.889 INFO:teuthology.orchestra.run.smithi027.stdout: osd debug pg log writeout = true 2023-11-29T08:56:08.890 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:56:08.890 INFO:teuthology.orchestra.run.smithi027.stdout: osd deep scrub update digest min age = 30 2023-11-29T08:56:08.890 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:56:08.890 INFO:teuthology.orchestra.run.smithi027.stdout: osd map max advance = 10 2023-11-29T08:56:08.890 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:56:08.890 INFO:teuthology.orchestra.run.smithi027.stdout: journal zero on create = true 2023-11-29T08:56:08.890 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:56:08.890 INFO:teuthology.orchestra.run.smithi027.stdout: filestore ondisk finisher threads = 3 2023-11-29T08:56:08.890 INFO:teuthology.orchestra.run.smithi027.stdout: filestore apply finisher threads = 3 2023-11-29T08:56:08.890 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:56:08.890 INFO:teuthology.orchestra.run.smithi027.stdout: bdev debug aio = true 2023-11-29T08:56:08.890 INFO:teuthology.orchestra.run.smithi027.stdout: osd debug misdirected ops = true 2023-11-29T08:56:08.890 INFO:teuthology.orchestra.run.smithi027.stdout: debug monc = 20 2023-11-29T08:56:08.890 INFO:teuthology.orchestra.run.smithi027.stdout: crimson seastar smp = 3 2023-11-29T08:56:08.890 INFO:teuthology.orchestra.run.smithi027.stdout: debug ms = 1 2023-11-29T08:56:08.891 INFO:teuthology.orchestra.run.smithi027.stdout: debug osd = 20 2023-11-29T08:56:08.891 INFO:teuthology.orchestra.run.smithi027.stdout: osd blocked scrub grace period = 3600 2023-11-29T08:56:08.891 INFO:teuthology.orchestra.run.smithi027.stdout: osd class default list = * 2023-11-29T08:56:08.891 INFO:teuthology.orchestra.run.smithi027.stdout: osd class load list = * 2023-11-29T08:56:08.891 INFO:teuthology.orchestra.run.smithi027.stdout: osd shutdown pgref assert = True 2023-11-29T08:56:08.891 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:56:08.891 INFO:teuthology.orchestra.run.smithi027.stdout:[mgr] 2023-11-29T08:56:08.891 INFO:teuthology.orchestra.run.smithi027.stdout: debug ms = 1 2023-11-29T08:56:08.891 INFO:teuthology.orchestra.run.smithi027.stdout: debug mgr = 20 2023-11-29T08:56:08.891 INFO:teuthology.orchestra.run.smithi027.stdout: debug mon = 20 2023-11-29T08:56:08.891 INFO:teuthology.orchestra.run.smithi027.stdout: debug auth = 20 2023-11-29T08:56:08.891 INFO:teuthology.orchestra.run.smithi027.stdout: mon reweight min pgs per osd = 4 2023-11-29T08:56:08.891 INFO:teuthology.orchestra.run.smithi027.stdout: mon reweight min bytes per osd = 10 2023-11-29T08:56:08.891 INFO:teuthology.orchestra.run.smithi027.stdout: mgr/telemetry/nag = false 2023-11-29T08:56:08.891 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:56:08.891 INFO:teuthology.orchestra.run.smithi027.stdout:[mon] 2023-11-29T08:56:08.891 INFO:teuthology.orchestra.run.smithi027.stdout: debug ms = 1 2023-11-29T08:56:08.892 INFO:teuthology.orchestra.run.smithi027.stdout: debug mon = 20 2023-11-29T08:56:08.892 INFO:teuthology.orchestra.run.smithi027.stdout: debug paxos = 20 2023-11-29T08:56:08.892 INFO:teuthology.orchestra.run.smithi027.stdout: debug auth = 20 2023-11-29T08:56:08.892 INFO:teuthology.orchestra.run.smithi027.stdout: mon data avail warn = 5 2023-11-29T08:56:08.892 INFO:teuthology.orchestra.run.smithi027.stdout: mon mgr mkfs grace = 240 2023-11-29T08:56:08.892 INFO:teuthology.orchestra.run.smithi027.stdout: mon reweight min pgs per osd = 4 2023-11-29T08:56:08.892 INFO:teuthology.orchestra.run.smithi027.stdout: mon osd reporter subtree level = osd 2023-11-29T08:56:08.892 INFO:teuthology.orchestra.run.smithi027.stdout: mon osd prime pg temp = true 2023-11-29T08:56:08.892 INFO:teuthology.orchestra.run.smithi027.stdout: mon reweight min bytes per osd = 10 2023-11-29T08:56:08.892 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:56:08.892 INFO:teuthology.orchestra.run.smithi027.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-29T08:56:08.892 INFO:teuthology.orchestra.run.smithi027.stdout: auth mon ticket ttl = 660 # 11m 2023-11-29T08:56:08.892 INFO:teuthology.orchestra.run.smithi027.stdout: auth service ticket ttl = 240 # 4m 2023-11-29T08:56:08.892 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:56:08.892 INFO:teuthology.orchestra.run.smithi027.stdout: # don't complain about insecure global_id in the test suite 2023-11-29T08:56:08.892 INFO:teuthology.orchestra.run.smithi027.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-29T08:56:08.892 INFO:teuthology.orchestra.run.smithi027.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-29T08:56:08.893 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:56:08.893 INFO:teuthology.orchestra.run.smithi027.stdout: # 1m isn't quite enough 2023-11-29T08:56:08.893 INFO:teuthology.orchestra.run.smithi027.stdout: mon_down_mkfs_grace = 2m 2023-11-29T08:56:08.893 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:56:08.893 INFO:teuthology.orchestra.run.smithi027.stdout: mon_warn_on_filestore_osds = false 2023-11-29T08:56:08.893 INFO:teuthology.orchestra.run.smithi027.stdout: mon min osdmap epochs = 50 2023-11-29T08:56:08.893 INFO:teuthology.orchestra.run.smithi027.stdout: mon osdmap full prune interval = 2 2023-11-29T08:56:08.893 INFO:teuthology.orchestra.run.smithi027.stdout: mon osdmap full prune min = 15 2023-11-29T08:56:08.893 INFO:teuthology.orchestra.run.smithi027.stdout: mon osdmap full prune txsize = 2 2023-11-29T08:56:08.893 INFO:teuthology.orchestra.run.smithi027.stdout: paxos service trim min = 10 2023-11-29T08:56:08.893 INFO:teuthology.orchestra.run.smithi027.stdout: mon warn on pool no app = False 2023-11-29T08:56:08.893 INFO:teuthology.orchestra.run.smithi027.stdout: osd pool default crimson = True 2023-11-29T08:56:08.893 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:56:08.893 INFO:teuthology.orchestra.run.smithi027.stdout:[client] 2023-11-29T08:56:08.893 INFO:teuthology.orchestra.run.smithi027.stdout: rgw cache enabled = true 2023-11-29T08:56:08.893 INFO:teuthology.orchestra.run.smithi027.stdout: rgw enable ops log = true 2023-11-29T08:56:08.893 INFO:teuthology.orchestra.run.smithi027.stdout: rgw enable usage log = true 2023-11-29T08:56:08.894 INFO:teuthology.orchestra.run.smithi027.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-29T08:56:08.894 INFO:teuthology.orchestra.run.smithi027.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-29T08:56:08.894 INFO:teuthology.orchestra.run.smithi027.stdout: debug ms = 1 2023-11-29T08:56:08.894 INFO:teuthology.orchestra.run.smithi027.stdout:[mon.a] 2023-11-29T08:56:08.901 INFO:tasks.ceph:Creating admin key on mon.a... 2023-11-29T08:56:08.901 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-11-29T08:56:09.007 INFO:tasks.ceph:Copying monmap to all nodes... 2023-11-29T08:56:09.007 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-11-29T08:56:09.007 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-11-29T08:56:09.022 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-11-29T08:56:09.022 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-11-29T08:56:09.077 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi027.front.sepia.ceph.com 2023-11-29T08:56:09.077 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-11-29T08:56:09.077 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-29T08:56:09.077 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-29T08:56:09.163 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-11-29T08:56:09.163 DEBUG:teuthology.orchestra.run.smithi027:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-29T08:56:09.218 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi139.front.sepia.ceph.com 2023-11-29T08:56:09.218 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2023-11-29T08:56:09.218 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-29T08:56:09.219 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-29T08:56:09.258 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2023-11-29T08:56:09.258 DEBUG:teuthology.orchestra.run.smithi139:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-29T08:56:09.313 INFO:tasks.ceph:Setting up mon nodes... 2023-11-29T08:56:09.314 INFO:tasks.ceph:Setting up mgr nodes... 2023-11-29T08:56:09.314 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-11-29T08:56:09.421 INFO:teuthology.orchestra.run.smithi139.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-11-29T08:56:09.423 INFO:tasks.ceph:Setting up mds nodes... 2023-11-29T08:56:09.424 INFO:tasks.ceph_client:Setting up client nodes... 2023-11-29T08:56:09.424 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-11-29T08:56:09.476 INFO:teuthology.orchestra.run.smithi027.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-11-29T08:56:09.495 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-11-29T08:56:09.543 INFO:teuthology.orchestra.run.smithi139.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-11-29T08:56:09.558 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-11-29T08:56:09.559 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi027.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi139.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2023-11-29T08:56:09.559 DEBUG:teuthology.orchestra.run.smithi027:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-11-29T08:56:09.589 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2023-11-29T08:56:09.589 INFO:tasks.ceph:role: osd.0 2023-11-29T08:56:09.589 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi027.front.sepia.ceph.com 2023-11-29T08:56:09.589 DEBUG:teuthology.orchestra.run.smithi027:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-29T08:56:09.667 INFO:teuthology.orchestra.run.smithi027.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-29T08:56:09.667 INFO:teuthology.orchestra.run.smithi027.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-29T08:56:09.667 INFO:teuthology.orchestra.run.smithi027.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-29T08:56:09.667 INFO:teuthology.orchestra.run.smithi027.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-29T08:56:09.667 INFO:teuthology.orchestra.run.smithi027.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-29T08:56:09.667 INFO:teuthology.orchestra.run.smithi027.stdout: = sunit=0 swidth=0 blks 2023-11-29T08:56:09.667 INFO:teuthology.orchestra.run.smithi027.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-29T08:56:09.667 INFO:teuthology.orchestra.run.smithi027.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-29T08:56:09.668 INFO:teuthology.orchestra.run.smithi027.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-29T08:56:09.668 INFO:teuthology.orchestra.run.smithi027.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-29T08:56:10.126 INFO:teuthology.orchestra.run.smithi027.stdout:Discarding blocks...Done. 2023-11-29T08:56:10.128 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi027.front.sepia.ceph.com -o noatime 2023-11-29T08:56:10.128 DEBUG:teuthology.orchestra.run.smithi027:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-11-29T08:56:10.258 DEBUG:teuthology.orchestra.run.smithi027:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-11-29T08:56:10.296 DEBUG:teuthology.orchestra.run.smithi027:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-11-29T08:56:10.366 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2023-11-29T08:56:10.366 INFO:tasks.ceph:role: osd.1 2023-11-29T08:56:10.366 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi027.front.sepia.ceph.com 2023-11-29T08:56:10.367 DEBUG:teuthology.orchestra.run.smithi027:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-29T08:56:10.444 INFO:teuthology.orchestra.run.smithi027.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-29T08:56:10.445 INFO:teuthology.orchestra.run.smithi027.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-29T08:56:10.445 INFO:teuthology.orchestra.run.smithi027.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-29T08:56:10.445 INFO:teuthology.orchestra.run.smithi027.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-29T08:56:10.445 INFO:teuthology.orchestra.run.smithi027.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-29T08:56:10.445 INFO:teuthology.orchestra.run.smithi027.stdout: = sunit=0 swidth=0 blks 2023-11-29T08:56:10.445 INFO:teuthology.orchestra.run.smithi027.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-29T08:56:10.445 INFO:teuthology.orchestra.run.smithi027.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-29T08:56:10.445 INFO:teuthology.orchestra.run.smithi027.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-29T08:56:10.445 INFO:teuthology.orchestra.run.smithi027.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-29T08:56:10.911 INFO:teuthology.orchestra.run.smithi027.stdout:Discarding blocks...Done. 2023-11-29T08:56:10.913 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi027.front.sepia.ceph.com -o noatime 2023-11-29T08:56:10.913 DEBUG:teuthology.orchestra.run.smithi027:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-11-29T08:56:11.013 DEBUG:teuthology.orchestra.run.smithi027:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-11-29T08:56:11.049 DEBUG:teuthology.orchestra.run.smithi027:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-29T08:56:11.624 INFO:teuthology.orchestra.run.smithi027.stderr:WARNING: debug mode. Not for benchmarking or production 2023-11-29T08:56:11.625 INFO:teuthology.orchestra.run.smithi027.stderr:INFO 2023-11-29 08:56:11,625 seastar - Reactor backend: linux-aio 2023-11-29T08:56:11.645 INFO:teuthology.orchestra.run.smithi027.stderr:INFO 2023-11-29 08:56:11,645 [shard 0] seastar - Created fair group io-queue-0, capacity rate 2147483:2147483, limit 12582912, rate 16777216 (factor 1), threshold 2000 2023-11-29T08:56:11.645 INFO:teuthology.orchestra.run.smithi027.stderr:INFO 2023-11-29 08:56:11,645 [shard 0] seastar - IO queue uses 0.75ms latency goal for device 0 2023-11-29T08:56:11.645 INFO:teuthology.orchestra.run.smithi027.stderr:INFO 2023-11-29 08:56:11,645 [shard 0] seastar - Created io group dev(0), length limit 4194304:4194304, rate 2147483647:2147483647 2023-11-29T08:56:11.645 INFO:teuthology.orchestra.run.smithi027.stderr:INFO 2023-11-29 08:56:11,645 [shard 0] seastar - Created io queue dev(0) capacities: 512:2000:2000 1024:3000:3000 2048:5000:5000 4096:9000:9000 8192:17000:17000 16384:33000:33000 32768:65000:65000 65536:129000:129000 131072:257000:257000 2023-11-29T08:56:11.647 INFO:teuthology.orchestra.run.smithi027.stderr:==80347==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2023-11-29T08:56:11.653 INFO:teuthology.orchestra.run.smithi027.stderr:==80347==WARNING: ASan is ignoring requested __asan_handle_no_return: stack type: default top: 0x7ffd02f24000; bottom 0x7fea23265000; size: 0x0012dfcbf000 (81064095744) 2023-11-29T08:56:11.653 INFO:teuthology.orchestra.run.smithi027.stderr:False positive error reports may follow 2023-11-29T08:56:11.653 INFO:teuthology.orchestra.run.smithi027.stderr:For details see https://github.com/google/sanitizers/issues/189 2023-11-29T08:56:11.679 INFO:teuthology.orchestra.run.smithi027.stderr:Reactor stalled for 32 ms on shard 0. Backtrace: 0x45d5d 0x2c8178ec 0x2c818c9a 0x2c81a1e8 0x2c81a56c 0x2c81a6b6 0x2c81ab0c 0x54daf 0x22d57fc7 0x22dc2ae2 0x22c95ccf 0x22cbde65 0x22b62dde 0x22b957bb 0x24b532a0 0x24b5aa56 0x24b5d3a4 0x24b5e57d 0x226d8531 0x22716a4a 0x2273cb51 0x2c7bad53 0x2c858b78 0x2ca7ba30 0x2ca7d753 0x2c4d6030 0x2c4d7f39 0x1ee1ef87 0x1ee290f5 0x1ec98990 0x3feaf 0x3ff5f 0x1e743a44 2023-11-29T08:56:11.679 INFO:teuthology.orchestra.run.smithi027.stderr:kernel callstack: 2023-11-29T08:56:11.690 INFO:teuthology.orchestra.run.smithi027.stderr:INFO 2023-11-29 08:56:11,689 [shard 0] osd - bypassing the config fetch due to --no-mon-config 2023-11-29T08:56:11.690 INFO:teuthology.orchestra.run.smithi027.stderr:INFO 2023-11-29 08:56:11,690 [shard 0] osd - get_early_config: set --smp 3 2023-11-29T08:56:12.193 INFO:teuthology.orchestra.run.smithi027.stderr:----------------------------------------------------- 2023-11-29T08:56:12.193 INFO:teuthology.orchestra.run.smithi027.stderr:Suppressions used: 2023-11-29T08:56:12.193 INFO:teuthology.orchestra.run.smithi027.stderr: count bytes template 2023-11-29T08:56:12.193 INFO:teuthology.orchestra.run.smithi027.stderr: 1 8 MallocExtension::Register 2023-11-29T08:56:12.193 INFO:teuthology.orchestra.run.smithi027.stderr:----------------------------------------------------- 2023-11-29T08:56:12.193 INFO:teuthology.orchestra.run.smithi027.stderr: 2023-11-29T08:56:12.246 INFO:teuthology.orchestra.run.smithi027.stderr:WARNING: debug mode. Not for benchmarking or production 2023-11-29T08:56:12.246 INFO:teuthology.orchestra.run.smithi027.stderr:INFO 2023-11-29 08:56:12,247 seastar - Reactor backend: linux-aio 2023-11-29T08:56:12.264 INFO:teuthology.orchestra.run.smithi027.stderr:INFO 2023-11-29 08:56:12,264 [shard 1] seastar - Created fair group io-queue-0, capacity rate 2147483:2147483, limit 12582912, rate 16777216 (factor 1), threshold 2000 2023-11-29T08:56:12.264 INFO:teuthology.orchestra.run.smithi027.stderr:INFO 2023-11-29 08:56:12,264 [shard 1] seastar - IO queue uses 0.75ms latency goal for device 0 2023-11-29T08:56:12.264 INFO:teuthology.orchestra.run.smithi027.stderr:INFO 2023-11-29 08:56:12,264 [shard 1] seastar - Created io group dev(0), length limit 4194304:4194304, rate 2147483647:2147483647 2023-11-29T08:56:12.272 INFO:teuthology.orchestra.run.smithi027.stderr:INFO 2023-11-29 08:56:12,272 [shard 0] seastar - Created io queue dev(0) capacities: 512:2000:2000 1024:3000:3000 2048:5000:5000 4096:9000:9000 8192:17000:17000 16384:33000:33000 32768:65000:65000 65536:129000:129000 131072:257000:257000 2023-11-29T08:56:12.274 INFO:teuthology.orchestra.run.smithi027.stderr:==80345==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2023-11-29T08:56:12.281 INFO:teuthology.orchestra.run.smithi027.stderr:==80345==WARNING: ASan is ignoring requested __asan_handle_no_return: stack type: default top: 0x7ffd02f24000; bottom 0x7fea2105e000; size: 0x0012e1ec6000 (81099776000) 2023-11-29T08:56:12.281 INFO:teuthology.orchestra.run.smithi027.stderr:False positive error reports may follow 2023-11-29T08:56:12.281 INFO:teuthology.orchestra.run.smithi027.stderr:For details see https://github.com/google/sanitizers/issues/189 2023-11-29T08:56:15.903 INFO:teuthology.orchestra.run.smithi027.stderr:----------------------------------------------------- 2023-11-29T08:56:15.904 INFO:teuthology.orchestra.run.smithi027.stderr:Suppressions used: 2023-11-29T08:56:15.904 INFO:teuthology.orchestra.run.smithi027.stderr: count bytes template 2023-11-29T08:56:15.904 INFO:teuthology.orchestra.run.smithi027.stderr: 1 8 MallocExtension::Register 2023-11-29T08:56:15.904 INFO:teuthology.orchestra.run.smithi027.stderr:----------------------------------------------------- 2023-11-29T08:56:15.904 INFO:teuthology.orchestra.run.smithi027.stderr: 2023-11-29T08:56:15.904 INFO:teuthology.orchestra.run.smithi027.stdout:created object store /var/lib/ceph/osd/ceph-0 for osd.0 fsid ae0bf9e4-fe2e-415c-890c-a9a3fac76480 2023-11-29T08:56:15.944 DEBUG:teuthology.orchestra.run.smithi027:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-11-29T08:56:15.975 DEBUG:teuthology.orchestra.run.smithi027:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-29T08:56:16.535 INFO:teuthology.orchestra.run.smithi027.stderr:WARNING: debug mode. Not for benchmarking or production 2023-11-29T08:56:16.536 INFO:teuthology.orchestra.run.smithi027.stderr:INFO 2023-11-29 08:56:16,536 seastar - Reactor backend: linux-aio 2023-11-29T08:56:16.557 INFO:teuthology.orchestra.run.smithi027.stderr:INFO 2023-11-29 08:56:16,557 [shard 0] seastar - Created fair group io-queue-0, capacity rate 2147483:2147483, limit 12582912, rate 16777216 (factor 1), threshold 2000 2023-11-29T08:56:16.557 INFO:teuthology.orchestra.run.smithi027.stderr:INFO 2023-11-29 08:56:16,557 [shard 0] seastar - IO queue uses 0.75ms latency goal for device 0 2023-11-29T08:56:16.557 INFO:teuthology.orchestra.run.smithi027.stderr:INFO 2023-11-29 08:56:16,557 [shard 0] seastar - Created io group dev(0), length limit 4194304:4194304, rate 2147483647:2147483647 2023-11-29T08:56:16.557 INFO:teuthology.orchestra.run.smithi027.stderr:INFO 2023-11-29 08:56:16,557 [shard 0] seastar - Created io queue dev(0) capacities: 512:2000:2000 1024:3000:3000 2048:5000:5000 4096:9000:9000 8192:17000:17000 16384:33000:33000 32768:65000:65000 65536:129000:129000 131072:257000:257000 2023-11-29T08:56:16.559 INFO:teuthology.orchestra.run.smithi027.stderr:==81155==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2023-11-29T08:56:16.565 INFO:teuthology.orchestra.run.smithi027.stderr:==81155==WARNING: ASan is ignoring requested __asan_handle_no_return: stack type: default top: 0x7ffdbf687000; bottom 0x7f8645230000; size: 0x00777a457000 (513152479232) 2023-11-29T08:56:16.565 INFO:teuthology.orchestra.run.smithi027.stderr:False positive error reports may follow 2023-11-29T08:56:16.565 INFO:teuthology.orchestra.run.smithi027.stderr:For details see https://github.com/google/sanitizers/issues/189 2023-11-29T08:56:16.591 INFO:teuthology.orchestra.run.smithi027.stderr:Reactor stalled for 32 ms on shard 0. Backtrace: 0x45d5d 0x2c8178ec 0x2c818c9a 0x2c81a1e8 0x2c81a56c 0x2c81a6b6 0x2c81ab0c 0x54daf 0x22d57eea 0x22dc2ae2 0x22c95ccf 0x22cbde65 0x22b62dde 0x22b957bb 0x24b532a0 0x24b5aa56 0x24b5d3a4 0x24b5e57d 0x226d8531 0x22716a4a 0x2273cb51 0x2c7bad53 0x2c858b78 0x2ca7ba30 0x2ca7d753 0x2c4d6030 0x2c4d7f39 0x1ee1ef87 0x1ee290f5 0x1ec98990 0x3feaf 0x3ff5f 0x1e743a44 2023-11-29T08:56:16.591 INFO:teuthology.orchestra.run.smithi027.stderr:kernel callstack: 2023-11-29T08:56:16.602 INFO:teuthology.orchestra.run.smithi027.stderr:INFO 2023-11-29 08:56:16,602 [shard 0] osd - bypassing the config fetch due to --no-mon-config 2023-11-29T08:56:16.602 INFO:teuthology.orchestra.run.smithi027.stderr:INFO 2023-11-29 08:56:16,602 [shard 0] osd - get_early_config: set --smp 3 2023-11-29T08:56:17.097 INFO:teuthology.orchestra.run.smithi027.stderr:----------------------------------------------------- 2023-11-29T08:56:17.097 INFO:teuthology.orchestra.run.smithi027.stderr:Suppressions used: 2023-11-29T08:56:17.097 INFO:teuthology.orchestra.run.smithi027.stderr: count bytes template 2023-11-29T08:56:17.097 INFO:teuthology.orchestra.run.smithi027.stderr: 1 8 MallocExtension::Register 2023-11-29T08:56:17.097 INFO:teuthology.orchestra.run.smithi027.stderr:----------------------------------------------------- 2023-11-29T08:56:17.097 INFO:teuthology.orchestra.run.smithi027.stderr: 2023-11-29T08:56:17.146 INFO:teuthology.orchestra.run.smithi027.stderr:WARNING: debug mode. Not for benchmarking or production 2023-11-29T08:56:17.147 INFO:teuthology.orchestra.run.smithi027.stderr:INFO 2023-11-29 08:56:17,147 seastar - Reactor backend: linux-aio 2023-11-29T08:56:17.164 INFO:teuthology.orchestra.run.smithi027.stderr:INFO 2023-11-29 08:56:17,164 [shard 1] seastar - Created fair group io-queue-0, capacity rate 2147483:2147483, limit 12582912, rate 16777216 (factor 1), threshold 2000 2023-11-29T08:56:17.165 INFO:teuthology.orchestra.run.smithi027.stderr:INFO 2023-11-29 08:56:17,164 [shard 1] seastar - IO queue uses 0.75ms latency goal for device 0 2023-11-29T08:56:17.165 INFO:teuthology.orchestra.run.smithi027.stderr:INFO 2023-11-29 08:56:17,164 [shard 1] seastar - Created io group dev(0), length limit 4194304:4194304, rate 2147483647:2147483647 2023-11-29T08:56:17.172 INFO:teuthology.orchestra.run.smithi027.stderr:INFO 2023-11-29 08:56:17,172 [shard 0] seastar - Created io queue dev(0) capacities: 512:2000:2000 1024:3000:3000 2048:5000:5000 4096:9000:9000 8192:17000:17000 16384:33000:33000 32768:65000:65000 65536:129000:129000 131072:257000:257000 2023-11-29T08:56:17.175 INFO:teuthology.orchestra.run.smithi027.stderr:==81153==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2023-11-29T08:56:17.181 INFO:teuthology.orchestra.run.smithi027.stderr:==81153==WARNING: ASan is ignoring requested __asan_handle_no_return: stack type: default top: 0x7ffdbf687000; bottom 0x7f8643029000; size: 0x00777c65e000 (513188159488) 2023-11-29T08:56:17.181 INFO:teuthology.orchestra.run.smithi027.stderr:False positive error reports may follow 2023-11-29T08:56:17.181 INFO:teuthology.orchestra.run.smithi027.stderr:For details see https://github.com/google/sanitizers/issues/189 2023-11-29T08:56:20.800 INFO:teuthology.orchestra.run.smithi027.stderr:----------------------------------------------------- 2023-11-29T08:56:20.801 INFO:teuthology.orchestra.run.smithi027.stderr:Suppressions used: 2023-11-29T08:56:20.801 INFO:teuthology.orchestra.run.smithi027.stderr: count bytes template 2023-11-29T08:56:20.801 INFO:teuthology.orchestra.run.smithi027.stderr: 1 8 MallocExtension::Register 2023-11-29T08:56:20.801 INFO:teuthology.orchestra.run.smithi027.stderr:----------------------------------------------------- 2023-11-29T08:56:20.801 INFO:teuthology.orchestra.run.smithi027.stderr: 2023-11-29T08:56:20.801 INFO:teuthology.orchestra.run.smithi027.stdout:created object store /var/lib/ceph/osd/ceph-1 for osd.1 fsid ae0bf9e4-fe2e-415c-890c-a9a3fac76480 2023-11-29T08:56:20.842 DEBUG:teuthology.orchestra.run.smithi027:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-11-29T08:56:20.872 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-11-29T08:56:20.903 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2023-11-29T08:56:20.904 INFO:tasks.ceph:role: osd.2 2023-11-29T08:56:20.904 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi139.front.sepia.ceph.com 2023-11-29T08:56:20.904 DEBUG:teuthology.orchestra.run.smithi139:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-29T08:56:20.982 INFO:teuthology.orchestra.run.smithi139.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-29T08:56:20.982 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-29T08:56:20.982 INFO:teuthology.orchestra.run.smithi139.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-29T08:56:20.982 INFO:teuthology.orchestra.run.smithi139.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-29T08:56:20.982 INFO:teuthology.orchestra.run.smithi139.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-29T08:56:20.983 INFO:teuthology.orchestra.run.smithi139.stdout: = sunit=0 swidth=0 blks 2023-11-29T08:56:20.983 INFO:teuthology.orchestra.run.smithi139.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-29T08:56:20.983 INFO:teuthology.orchestra.run.smithi139.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-29T08:56:20.983 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-29T08:56:20.983 INFO:teuthology.orchestra.run.smithi139.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-29T08:56:21.497 INFO:teuthology.orchestra.run.smithi139.stdout:Discarding blocks...Done. 2023-11-29T08:56:21.499 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi139.front.sepia.ceph.com -o noatime 2023-11-29T08:56:21.500 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2023-11-29T08:56:21.651 DEBUG:teuthology.orchestra.run.smithi139:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-11-29T08:56:21.690 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-11-29T08:56:21.759 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2023-11-29T08:56:21.760 INFO:tasks.ceph:role: osd.3 2023-11-29T08:56:21.760 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi139.front.sepia.ceph.com 2023-11-29T08:56:21.760 DEBUG:teuthology.orchestra.run.smithi139:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-29T08:56:21.836 INFO:teuthology.orchestra.run.smithi139.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-29T08:56:21.836 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-29T08:56:21.836 INFO:teuthology.orchestra.run.smithi139.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-29T08:56:21.836 INFO:teuthology.orchestra.run.smithi139.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-29T08:56:21.836 INFO:teuthology.orchestra.run.smithi139.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-29T08:56:21.836 INFO:teuthology.orchestra.run.smithi139.stdout: = sunit=0 swidth=0 blks 2023-11-29T08:56:21.836 INFO:teuthology.orchestra.run.smithi139.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-29T08:56:21.836 INFO:teuthology.orchestra.run.smithi139.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-29T08:56:21.836 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-29T08:56:21.836 INFO:teuthology.orchestra.run.smithi139.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-29T08:56:22.290 INFO:teuthology.orchestra.run.smithi139.stdout:Discarding blocks...Done. 2023-11-29T08:56:22.292 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi139.front.sepia.ceph.com -o noatime 2023-11-29T08:56:22.292 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-3 2023-11-29T08:56:22.390 DEBUG:teuthology.orchestra.run.smithi139:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-11-29T08:56:22.425 DEBUG:teuthology.orchestra.run.smithi139:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-29T08:56:22.964 INFO:teuthology.orchestra.run.smithi139.stderr:WARNING: debug mode. Not for benchmarking or production 2023-11-29T08:56:22.964 INFO:teuthology.orchestra.run.smithi139.stderr:INFO 2023-11-29 08:56:22,965 seastar - Reactor backend: linux-aio 2023-11-29T08:56:22.984 INFO:teuthology.orchestra.run.smithi139.stderr:INFO 2023-11-29 08:56:22,984 [shard 0] seastar - Created fair group io-queue-0, capacity rate 2147483:2147483, limit 12582912, rate 16777216 (factor 1), threshold 2000 2023-11-29T08:56:22.984 INFO:teuthology.orchestra.run.smithi139.stderr:INFO 2023-11-29 08:56:22,984 [shard 0] seastar - IO queue uses 0.75ms latency goal for device 0 2023-11-29T08:56:22.984 INFO:teuthology.orchestra.run.smithi139.stderr:INFO 2023-11-29 08:56:22,984 [shard 0] seastar - Created io group dev(0), length limit 4194304:4194304, rate 2147483647:2147483647 2023-11-29T08:56:22.984 INFO:teuthology.orchestra.run.smithi139.stderr:INFO 2023-11-29 08:56:22,984 [shard 0] seastar - Created io queue dev(0) capacities: 512:2000:2000 1024:3000:3000 2048:5000:5000 4096:9000:9000 8192:17000:17000 16384:33000:33000 32768:65000:65000 65536:129000:129000 131072:257000:257000 2023-11-29T08:56:22.986 INFO:teuthology.orchestra.run.smithi139.stderr:==79949==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2023-11-29T08:56:22.992 INFO:teuthology.orchestra.run.smithi139.stderr:==79949==WARNING: ASan is ignoring requested __asan_handle_no_return: stack type: default top: 0x7ffd33546000; bottom 0x7f83c44b1000; size: 0x00796f095000 (521553924096) 2023-11-29T08:56:22.992 INFO:teuthology.orchestra.run.smithi139.stderr:False positive error reports may follow 2023-11-29T08:56:22.992 INFO:teuthology.orchestra.run.smithi139.stderr:For details see https://github.com/google/sanitizers/issues/189 2023-11-29T08:56:23.027 INFO:teuthology.orchestra.run.smithi139.stderr:INFO 2023-11-29 08:56:23,027 [shard 0] osd - bypassing the config fetch due to --no-mon-config 2023-11-29T08:56:23.027 INFO:teuthology.orchestra.run.smithi139.stderr:INFO 2023-11-29 08:56:23,027 [shard 0] osd - get_early_config: set --smp 3 2023-11-29T08:56:23.531 INFO:teuthology.orchestra.run.smithi139.stderr:----------------------------------------------------- 2023-11-29T08:56:23.531 INFO:teuthology.orchestra.run.smithi139.stderr:Suppressions used: 2023-11-29T08:56:23.531 INFO:teuthology.orchestra.run.smithi139.stderr: count bytes template 2023-11-29T08:56:23.531 INFO:teuthology.orchestra.run.smithi139.stderr: 1 8 MallocExtension::Register 2023-11-29T08:56:23.531 INFO:teuthology.orchestra.run.smithi139.stderr:----------------------------------------------------- 2023-11-29T08:56:23.531 INFO:teuthology.orchestra.run.smithi139.stderr: 2023-11-29T08:56:23.583 INFO:teuthology.orchestra.run.smithi139.stderr:WARNING: debug mode. Not for benchmarking or production 2023-11-29T08:56:23.584 INFO:teuthology.orchestra.run.smithi139.stderr:INFO 2023-11-29 08:56:23,584 seastar - Reactor backend: linux-aio 2023-11-29T08:56:23.602 INFO:teuthology.orchestra.run.smithi139.stderr:INFO 2023-11-29 08:56:23,602 [shard 2] seastar - Created fair group io-queue-0, capacity rate 2147483:2147483, limit 12582912, rate 16777216 (factor 1), threshold 2000 2023-11-29T08:56:23.602 INFO:teuthology.orchestra.run.smithi139.stderr:INFO 2023-11-29 08:56:23,602 [shard 2] seastar - IO queue uses 0.75ms latency goal for device 0 2023-11-29T08:56:23.602 INFO:teuthology.orchestra.run.smithi139.stderr:INFO 2023-11-29 08:56:23,602 [shard 2] seastar - Created io group dev(0), length limit 4194304:4194304, rate 2147483647:2147483647 2023-11-29T08:56:23.609 INFO:teuthology.orchestra.run.smithi139.stderr:INFO 2023-11-29 08:56:23,609 [shard 0] seastar - Created io queue dev(0) capacities: 512:2000:2000 1024:3000:3000 2048:5000:5000 4096:9000:9000 8192:17000:17000 16384:33000:33000 32768:65000:65000 65536:129000:129000 131072:257000:257000 2023-11-29T08:56:23.612 INFO:teuthology.orchestra.run.smithi139.stderr:==79947==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2023-11-29T08:56:23.617 INFO:teuthology.orchestra.run.smithi139.stderr:==79947==WARNING: ASan is ignoring requested __asan_handle_no_return: stack type: default top: 0x7ffd33546000; bottom 0x7f83c22aa000; size: 0x00797129c000 (521589604352) 2023-11-29T08:56:23.618 INFO:teuthology.orchestra.run.smithi139.stderr:False positive error reports may follow 2023-11-29T08:56:23.618 INFO:teuthology.orchestra.run.smithi139.stderr:For details see https://github.com/google/sanitizers/issues/189 2023-11-29T08:56:26.956 INFO:teuthology.orchestra.run.smithi139.stderr:----------------------------------------------------- 2023-11-29T08:56:26.956 INFO:teuthology.orchestra.run.smithi139.stderr:Suppressions used: 2023-11-29T08:56:26.956 INFO:teuthology.orchestra.run.smithi139.stderr: count bytes template 2023-11-29T08:56:26.956 INFO:teuthology.orchestra.run.smithi139.stderr: 1 8 MallocExtension::Register 2023-11-29T08:56:26.956 INFO:teuthology.orchestra.run.smithi139.stderr:----------------------------------------------------- 2023-11-29T08:56:26.957 INFO:teuthology.orchestra.run.smithi139.stderr: 2023-11-29T08:56:26.957 INFO:teuthology.orchestra.run.smithi139.stdout:created object store /var/lib/ceph/osd/ceph-2 for osd.2 fsid ae0bf9e4-fe2e-415c-890c-a9a3fac76480 2023-11-29T08:56:26.997 DEBUG:teuthology.orchestra.run.smithi139:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-11-29T08:56:27.024 DEBUG:teuthology.orchestra.run.smithi139:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-29T08:56:27.533 INFO:teuthology.orchestra.run.smithi139.stderr:WARNING: debug mode. Not for benchmarking or production 2023-11-29T08:56:27.533 INFO:teuthology.orchestra.run.smithi139.stderr:INFO 2023-11-29 08:56:27,533 seastar - Reactor backend: linux-aio 2023-11-29T08:56:27.551 INFO:teuthology.orchestra.run.smithi139.stderr:INFO 2023-11-29 08:56:27,550 [shard 0] seastar - Created fair group io-queue-0, capacity rate 2147483:2147483, limit 12582912, rate 16777216 (factor 1), threshold 2000 2023-11-29T08:56:27.551 INFO:teuthology.orchestra.run.smithi139.stderr:INFO 2023-11-29 08:56:27,550 [shard 0] seastar - IO queue uses 0.75ms latency goal for device 0 2023-11-29T08:56:27.551 INFO:teuthology.orchestra.run.smithi139.stderr:INFO 2023-11-29 08:56:27,550 [shard 0] seastar - Created io group dev(0), length limit 4194304:4194304, rate 2147483647:2147483647 2023-11-29T08:56:27.551 INFO:teuthology.orchestra.run.smithi139.stderr:INFO 2023-11-29 08:56:27,550 [shard 0] seastar - Created io queue dev(0) capacities: 512:2000:2000 1024:3000:3000 2048:5000:5000 4096:9000:9000 8192:17000:17000 16384:33000:33000 32768:65000:65000 65536:129000:129000 131072:257000:257000 2023-11-29T08:56:27.553 INFO:teuthology.orchestra.run.smithi139.stderr:==80757==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2023-11-29T08:56:27.559 INFO:teuthology.orchestra.run.smithi139.stderr:==80757==WARNING: ASan is ignoring requested __asan_handle_no_return: stack type: default top: 0x7ffdd837b000; bottom 0x7f22bac32000; size: 0x00db1d749000 (941092016128) 2023-11-29T08:56:27.559 INFO:teuthology.orchestra.run.smithi139.stderr:False positive error reports may follow 2023-11-29T08:56:27.559 INFO:teuthology.orchestra.run.smithi139.stderr:For details see https://github.com/google/sanitizers/issues/189 2023-11-29T08:56:27.585 INFO:teuthology.orchestra.run.smithi139.stderr:Reactor stalled for 32 ms on shard 0. Backtrace: 0x45d5d 0x2c8178ec 0x2c818c9a 0x2c81a1e8 0x2c81a56c 0x2c81a6b6 0x2c81ab0c 0x54daf 0x22dc422a 0x22c95478 0x22cbde65 0x22b62dde 0x22b957bb 0x24b532a0 0x24b5aa56 0x24b5d3a4 0x24b5e57d 0x226d8531 0x22716a4a 0x2273cb51 0x2c7bad53 0x2c858b78 0x2ca7ba30 0x2ca7d753 0x2c4d6030 0x2c4d7f39 0x1ee1ef87 0x1ee290f5 0x1ec98990 0x3feaf 0x3ff5f 0x1e743a44 2023-11-29T08:56:27.585 INFO:teuthology.orchestra.run.smithi139.stderr:kernel callstack: 2023-11-29T08:56:27.593 INFO:teuthology.orchestra.run.smithi139.stderr:INFO 2023-11-29 08:56:27,593 [shard 0] osd - bypassing the config fetch due to --no-mon-config 2023-11-29T08:56:27.594 INFO:teuthology.orchestra.run.smithi139.stderr:INFO 2023-11-29 08:56:27,593 [shard 0] osd - get_early_config: set --smp 3 2023-11-29T08:56:28.065 INFO:teuthology.orchestra.run.smithi139.stderr:----------------------------------------------------- 2023-11-29T08:56:28.065 INFO:teuthology.orchestra.run.smithi139.stderr:Suppressions used: 2023-11-29T08:56:28.065 INFO:teuthology.orchestra.run.smithi139.stderr: count bytes template 2023-11-29T08:56:28.065 INFO:teuthology.orchestra.run.smithi139.stderr: 1 8 MallocExtension::Register 2023-11-29T08:56:28.065 INFO:teuthology.orchestra.run.smithi139.stderr:----------------------------------------------------- 2023-11-29T08:56:28.065 INFO:teuthology.orchestra.run.smithi139.stderr: 2023-11-29T08:56:28.119 INFO:teuthology.orchestra.run.smithi139.stderr:WARNING: debug mode. Not for benchmarking or production 2023-11-29T08:56:28.120 INFO:teuthology.orchestra.run.smithi139.stderr:INFO 2023-11-29 08:56:28,120 seastar - Reactor backend: linux-aio 2023-11-29T08:56:28.138 INFO:teuthology.orchestra.run.smithi139.stderr:INFO 2023-11-29 08:56:28,138 [shard 1] seastar - Created fair group io-queue-0, capacity rate 2147483:2147483, limit 12582912, rate 16777216 (factor 1), threshold 2000 2023-11-29T08:56:28.138 INFO:teuthology.orchestra.run.smithi139.stderr:INFO 2023-11-29 08:56:28,138 [shard 1] seastar - IO queue uses 0.75ms latency goal for device 0 2023-11-29T08:56:28.138 INFO:teuthology.orchestra.run.smithi139.stderr:INFO 2023-11-29 08:56:28,138 [shard 1] seastar - Created io group dev(0), length limit 4194304:4194304, rate 2147483647:2147483647 2023-11-29T08:56:28.145 INFO:teuthology.orchestra.run.smithi139.stderr:INFO 2023-11-29 08:56:28,145 [shard 0] seastar - Created io queue dev(0) capacities: 512:2000:2000 1024:3000:3000 2048:5000:5000 4096:9000:9000 8192:17000:17000 16384:33000:33000 32768:65000:65000 65536:129000:129000 131072:257000:257000 2023-11-29T08:56:28.148 INFO:teuthology.orchestra.run.smithi139.stderr:==80755==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2023-11-29T08:56:28.154 INFO:teuthology.orchestra.run.smithi139.stderr:==80755==WARNING: ASan is ignoring requested __asan_handle_no_return: stack type: default top: 0x7ffdd837b000; bottom 0x7f22b8a2b000; size: 0x00db1f950000 (941127696384) 2023-11-29T08:56:28.154 INFO:teuthology.orchestra.run.smithi139.stderr:False positive error reports may follow 2023-11-29T08:56:28.154 INFO:teuthology.orchestra.run.smithi139.stderr:For details see https://github.com/google/sanitizers/issues/189 2023-11-29T08:56:31.506 INFO:teuthology.orchestra.run.smithi139.stderr:----------------------------------------------------- 2023-11-29T08:56:31.506 INFO:teuthology.orchestra.run.smithi139.stderr:Suppressions used: 2023-11-29T08:56:31.506 INFO:teuthology.orchestra.run.smithi139.stderr: count bytes template 2023-11-29T08:56:31.506 INFO:teuthology.orchestra.run.smithi139.stderr: 1 8 MallocExtension::Register 2023-11-29T08:56:31.506 INFO:teuthology.orchestra.run.smithi139.stderr:----------------------------------------------------- 2023-11-29T08:56:31.506 INFO:teuthology.orchestra.run.smithi139.stderr: 2023-11-29T08:56:31.506 INFO:teuthology.orchestra.run.smithi139.stdout:created object store /var/lib/ceph/osd/ceph-3 for osd.3 fsid ae0bf9e4-fe2e-415c-890c-a9a3fac76480 2023-11-29T08:56:31.546 DEBUG:teuthology.orchestra.run.smithi139:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-11-29T08:56:31.572 INFO:tasks.ceph:Reading keys from all nodes... 2023-11-29T08:56:31.573 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-11-29T08:56:31.573 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-11-29T08:56:31.609 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-11-29T08:56:31.610 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-11-29T08:56:31.684 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2023-11-29T08:56:31.685 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-11-29T08:56:31.711 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2023-11-29T08:56:31.711 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-11-29T08:56:31.778 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2023-11-29T08:56:31.778 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-11-29T08:56:31.844 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-11-29T08:56:31.844 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-11-29T08:56:31.863 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2023-11-29T08:56:31.863 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-11-29T08:56:31.899 INFO:tasks.ceph:Adding keys to all mons... 2023-11-29T08:56:31.899 DEBUG:teuthology.orchestra.run.smithi027:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-29T08:56:31.937 INFO:teuthology.orchestra.run.smithi027.stdout:[osd.0] 2023-11-29T08:56:31.937 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQCs/GZlmuHNExAAdX8zzOlu2yzu/eZczwh6/A== 2023-11-29T08:56:31.937 INFO:teuthology.orchestra.run.smithi027.stdout:[osd.1] 2023-11-29T08:56:31.937 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQCx/GZlcMrZDRAAK1nE3r4dn7Vblpvjz4xITQ== 2023-11-29T08:56:31.937 INFO:teuthology.orchestra.run.smithi027.stdout:[mgr.x] 2023-11-29T08:56:31.938 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQCp/GZlPF0ZGRAAjTOBhhiPpgA+Ut04LlZHMQ== 2023-11-29T08:56:31.938 INFO:teuthology.orchestra.run.smithi027.stdout:[osd.2] 2023-11-29T08:56:31.938 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQC3/GZlsBrCJxAAwXQylaoRTtKqWSNXf51nyA== 2023-11-29T08:56:31.938 INFO:teuthology.orchestra.run.smithi027.stdout:[osd.3] 2023-11-29T08:56:31.938 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQC8/GZlWg8WDBAARdG1jWfWb06xdXorbZH0nA== 2023-11-29T08:56:31.938 INFO:teuthology.orchestra.run.smithi027.stdout:[client.0] 2023-11-29T08:56:31.938 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQCp/GZlj29gHBAABPavv71WvOaemN0ld68zug== 2023-11-29T08:56:31.938 INFO:teuthology.orchestra.run.smithi027.stdout:[client.1] 2023-11-29T08:56:31.938 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQCp/GZldMVeIBAAZgE0h5LyD4yZvPr6QWgs7w== 2023-11-29T08:56:31.939 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-29T08:56:32.051 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-29T08:56:32.116 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-29T08:56:32.178 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-29T08:56:32.240 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-29T08:56:32.302 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-29T08:56:32.367 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-29T08:56:32.432 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-11-29T08:56:32.433 DEBUG:teuthology.orchestra.run.smithi027:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-11-29T08:56:32.463 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-29T08:56:32.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:32.563+0000 7f9599636980 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:56:32.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:32.563+0000 7f9599636980 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:56:32.579 DEBUG:teuthology.orchestra.run.smithi027:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-11-29T08:56:32.610 DEBUG:teuthology.orchestra.run.smithi027:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-29T08:56:32.666 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-11-29T08:56:32.666 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-29T08:56:32.666 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-11-29T08:56:32.709 INFO:tasks.ceph.mon.a:Started 2023-11-29T08:56:32.709 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-11-29T08:56:32.709 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-11-29T08:56:32.709 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-11-29T08:56:32.712 INFO:tasks.ceph.mgr.x:Started 2023-11-29T08:56:32.712 INFO:tasks.ceph:Setting crush tunables to default 2023-11-29T08:56:32.712 DEBUG:teuthology.orchestra.run.smithi027:> sudo ceph --cluster ceph osd crush tunables default 2023-11-29T08:56:32.792 INFO:tasks.ceph.mon.a.smithi027.stderr:2023-11-29T08:56:32.791+0000 7f124c0db980 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:56:32.792 INFO:tasks.ceph.mon.a.smithi027.stderr:2023-11-29T08:56:32.791+0000 7f124c0db980 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:56:32.792 INFO:tasks.ceph.mon.a.smithi027.stderr:2023-11-29T08:56:32.791+0000 7f124c0db980 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:56:32.814 INFO:tasks.ceph.mgr.x.smithi139.stderr:2023-11-29T08:56:32.813+0000 7ff9da81bf00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:56:32.822 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:32.817+0000 7f29c802d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:56:32.823 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:32.822+0000 7f29c802d640 1 Processor -- start 2023-11-29T08:56:32.823 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:32.823+0000 7f29c802d640 1 -- start start 2023-11-29T08:56:32.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:32.823+0000 7f29c802d640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f29c00a1040 0x7f29c0132f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:32.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:32.823+0000 7f29c802d640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29c00a1870 con 0x7f29c01334c0 2023-11-29T08:56:32.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:32.823+0000 7f29c802d640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29c009cb90 con 0x7f29c00a1040 2023-11-29T08:56:32.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:32.823+0000 7f29c5dc9640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f29c00a1040 0x7f29c0132f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:56:32.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:32.824+0000 7f29c5dc9640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f29c00a1040 0x7f29c0132f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:49342/0 (socket says 172.21.15.27:49342) 2023-11-29T08:56:32.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:32.824+0000 7f29c5dc9640 1 -- 172.21.15.27:0/4276753201 learned_addr learned my addr 172.21.15.27:0/4276753201 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-11-29T08:56:32.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:32.824+0000 7f29c55c8640 1 --1- 172.21.15.27:0/4276753201 >> v1:172.21.15.27:6789/0 conn(0x7f29c01334c0 0x7f29c01382c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:53968/0 (socket says 172.21.15.27:53968) 2023-11-29T08:56:32.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:32.824+0000 7f29c5dc9640 1 -- 172.21.15.27:0/4276753201 >> v2:172.21.15.27:3300/0 conn(0x7f29c00a1040 msgr2=0x7f29c0132f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-29T08:56:32.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:32.824+0000 7f29c5dc9640 1 -- 172.21.15.27:0/4276753201 >> v2:172.21.15.27:3300/0 conn(0x7f29c00a1040 msgr2=0x7f29c0132f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-29T08:56:32.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:32.824+0000 7f29c5dc9640 1 --2- 172.21.15.27:0/4276753201 >> v2:172.21.15.27:3300/0 conn(0x7f29c00a1040 0x7f29c0132f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-29T08:56:32.825 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:32.824+0000 7f29c5dc9640 1 --2- 172.21.15.27:0/4276753201 >> v2:172.21.15.27:3300/0 conn(0x7f29c00a1040 0x7f29c0132f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-29T08:56:32.851 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:32.850+0000 7f29c4dc7640 1 -- 172.21.15.27:0/4276753201 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3766550749 0 0) 0x7f29c00a1870 con 0x7f29c01334c0 2023-11-29T08:56:32.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:32.850+0000 7f29c4dc7640 1 -- 172.21.15.27:0/4276753201 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29ac0034f0 con 0x7f29c01334c0 2023-11-29T08:56:32.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:32.850+0000 7f29c4dc7640 1 -- 172.21.15.27:0/4276753201 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1764549915 0 0) 0x7f29ac0034f0 con 0x7f29c01334c0 2023-11-29T08:56:32.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:32.850+0000 7f29c4dc7640 1 -- 172.21.15.27:0/4276753201 >> v2:172.21.15.27:3300/0 conn(0x7f29c00a1040 msgr2=0x7f29c0132f80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T08:56:32.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:32.850+0000 7f29c4dc7640 1 --2- 172.21.15.27:0/4276753201 >> v2:172.21.15.27:3300/0 conn(0x7f29c00a1040 0x7f29c0132f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:32.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:32.850+0000 7f29c4dc7640 1 -- 172.21.15.27:0/4276753201 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29c01300a0 con 0x7f29c01334c0 2023-11-29T08:56:32.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:32.850+0000 7f29c4dc7640 1 -- 172.21.15.27:0/4276753201 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (unknown 3047634389 0 0) 0x7f29b00015a0 con 0x7f29c01334c0 2023-11-29T08:56:32.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:32.850+0000 7f29c4dc7640 1 -- 172.21.15.27:0/4276753201 >> v1:172.21.15.27:6789/0 conn(0x7f29c01334c0 legacy=0x7f29c01382c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:32.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:32.850+0000 7f29c4dc7640 1 --2- 172.21.15.27:0/4276753201 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29ac003940 0x7f29ac003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:32.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:32.850+0000 7f29c4dc7640 1 -- 172.21.15.27:0/4276753201 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c009cb90 con 0x7f29ac003940 2023-11-29T08:56:32.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:32.850+0000 7f29c5dc9640 1 --2- 172.21.15.27:0/4276753201 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29ac003940 0x7f29ac003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:56:32.852 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:32.851+0000 7f29c5dc9640 1 -- 172.21.15.27:0/4276753201 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29ac0034f0 con 0x7f29ac003940 2023-11-29T08:56:32.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:32.852+0000 7f29c5dc9640 1 --2- 172.21.15.27:0/4276753201 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29ac003940 0x7f29ac003d90 crc :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9a2bd8150078c13 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:32.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:32.853+0000 7f29c4dc7640 1 -- 172.21.15.27:0/4276753201 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f29bc009600 con 0x7f29ac003940 2023-11-29T08:56:32.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:32.853+0000 7f29c4dc7640 1 -- 172.21.15.27:0/4276753201 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f29bc00c040 con 0x7f29ac003940 2023-11-29T08:56:32.853 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:32.853+0000 7f29c4dc7640 1 -- 172.21.15.27:0/4276753201 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f29bc009ca0 con 0x7f29ac003940 2023-11-29T08:56:32.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:32.853+0000 7f29c802d640 1 -- 172.21.15.27:0/4276753201 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29ac003940 msgr2=0x7f29ac003d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:32.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:32.853+0000 7f29c802d640 1 --2- 172.21.15.27:0/4276753201 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29ac003940 0x7f29ac003d90 crc :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:32.854 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:32.853+0000 7f29c802d640 1 -- 172.21.15.27:0/4276753201 shutdown_connections 2023-11-29T08:56:32.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:32.853+0000 7f29c802d640 1 --2- 172.21.15.27:0/4276753201 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29ac003940 0x7f29ac003d90 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:32.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:32.853+0000 7f29c802d640 1 --2- 172.21.15.27:0/4276753201 >> v2:172.21.15.27:3300/0 conn(0x7f29c00a1040 0x7f29c0132f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:32.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:32.853+0000 7f29c802d640 1 -- 172.21.15.27:0/4276753201 >> 172.21.15.27:0/4276753201 conn(0x7f29c006c9c0 msgr2=0x7f29c006cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T08:56:32.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:32.853+0000 7f29c802d640 1 -- 172.21.15.27:0/4276753201 shutdown_connections 2023-11-29T08:56:32.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:32.854+0000 7f29c802d640 1 -- 172.21.15.27:0/4276753201 wait complete. 2023-11-29T08:56:32.855 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:32.854+0000 7f29c802d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:56:32.856 INFO:tasks.ceph.mgr.x.smithi139.stderr:2023-11-29T08:56:32.853+0000 7ff9da81bf00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:56:32.856 INFO:tasks.ceph.mgr.x.smithi139.stderr:2023-11-29T08:56:32.853+0000 7ff9da81bf00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:56:32.857 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:32.855+0000 7f29c802d640 1 Processor -- start 2023-11-29T08:56:32.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:32.855+0000 7f29c802d640 1 -- start start 2023-11-29T08:56:32.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:32.855+0000 7f29c802d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29ac003940 0x7f29c01c8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:32.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:32.855+0000 7f29c802d640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c01c7b80 con 0x7f29ac003940 2023-11-29T08:56:32.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:32.855+0000 7f29c5dc9640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29ac003940 0x7f29c01c8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:56:32.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:32.855+0000 7f29c5dc9640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29ac003940 0x7f29c01c8150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:49358/0 (socket says 172.21.15.27:49358) 2023-11-29T08:56:32.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:32.855+0000 7f29c5dc9640 1 -- 172.21.15.27:0/4292633217 learned_addr learned my addr 172.21.15.27:0/4292633217 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-11-29T08:56:32.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:32.856+0000 7f29c5dc9640 1 -- 172.21.15.27:0/4292633217 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29c011cef0 con 0x7f29ac003940 2023-11-29T08:56:32.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:32.856+0000 7f29c5dc9640 1 --2- 172.21.15.27:0/4292633217 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29ac003940 0x7f29c01c8150 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:32.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:32.856+0000 7f29b67fc640 1 -- 172.21.15.27:0/4292633217 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f29bc0147e0 con 0x7f29ac003940 2023-11-29T08:56:32.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:32.856+0000 7f29b67fc640 1 -- 172.21.15.27:0/4292633217 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f29bc014940 con 0x7f29ac003940 2023-11-29T08:56:32.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:32.856+0000 7f29b67fc640 1 -- 172.21.15.27:0/4292633217 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f29bc014be0 con 0x7f29ac003940 2023-11-29T08:56:32.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:32.856+0000 7f29c802d640 1 -- 172.21.15.27:0/4292633217 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29c01c7db0 con 0x7f29ac003940 2023-11-29T08:56:32.858 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:32.856+0000 7f29c802d640 1 -- 172.21.15.27:0/4292633217 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29c011dec0 con 0x7f29ac003940 2023-11-29T08:56:32.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:32.856+0000 7f29b67fc640 1 -- 172.21.15.27:0/4292633217 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (crc 0 0 0) 0x7f29bc016430 con 0x7f29ac003940 2023-11-29T08:56:32.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:32.856+0000 7f29b67fc640 1 -- 172.21.15.27:0/4292633217 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (crc 0 0 0) 0x7f29bc01b040 con 0x7f29ac003940 2023-11-29T08:56:32.859 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:32.857+0000 7f29c802d640 1 -- 172.21.15.27:0/4292633217 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29c0067c60 con 0x7f29ac003940 2023-11-29T08:56:32.860 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:32.859+0000 7f29b67fc640 1 -- 172.21.15.27:0/4292633217 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (crc 0 0 0) 0x7f29bc00f040 con 0x7f29ac003940 2023-11-29T08:56:32.926 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:32.925+0000 7f29c802d640 1 -- 172.21.15.27:0/4292633217 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f29c0062350 con 0x7f29ac003940 2023-11-29T08:56:32.927 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:32.927+0000 7f29b67fc640 1 -- 172.21.15.27:0/4292633217 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (crc 0 0 0) 0x7f29bc005960 con 0x7f29ac003940 2023-11-29T08:56:32.927 INFO:teuthology.orchestra.run.smithi027.stderr:adjusted tunables profile to default 2023-11-29T08:56:32.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:32.927+0000 7f29c802d640 1 -- 172.21.15.27:0/4292633217 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29ac003940 msgr2=0x7f29c01c8150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:32.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:32.927+0000 7f29c802d640 1 --2- 172.21.15.27:0/4292633217 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29ac003940 0x7f29c01c8150 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:32.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:32.927+0000 7f29c802d640 1 -- 172.21.15.27:0/4292633217 shutdown_connections 2023-11-29T08:56:32.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:32.927+0000 7f29c802d640 1 --2- 172.21.15.27:0/4292633217 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29ac003940 0x7f29c01c8150 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:32.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:32.927+0000 7f29c802d640 1 -- 172.21.15.27:0/4292633217 >> 172.21.15.27:0/4292633217 conn(0x7f29c006c9c0 msgr2=0x7f29c00a1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T08:56:32.928 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:32.927+0000 7f29c802d640 1 -- 172.21.15.27:0/4292633217 shutdown_connections 2023-11-29T08:56:32.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:32.927+0000 7f29c802d640 1 -- 172.21.15.27:0/4292633217 wait complete. 2023-11-29T08:56:32.938 INFO:tasks.ceph:check_enable_crimson: True 2023-11-29T08:56:32.938 INFO:tasks.ceph:check_enable_crimson: setting set-allow-crimson 2023-11-29T08:56:32.938 DEBUG:teuthology.orchestra.run.smithi027:> sudo ceph --cluster ceph osd set-allow-crimson --yes-i-really-mean-it 2023-11-29T08:56:33.047 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:33.042+0000 7fdb76420640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:56:33.048 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:33.047+0000 7fdb76420640 1 Processor -- start 2023-11-29T08:56:33.048 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:33.047+0000 7fdb76420640 1 -- start start 2023-11-29T08:56:33.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:33.048+0000 7fdb76420640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fdb7006fa50 0x7fdb7006fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:33.049 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:33.048+0000 7fdb76420640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb70071b40 con 0x7fdb700703a0 2023-11-29T08:56:33.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:33.048+0000 7fdb76420640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb70070d50 con 0x7fdb7006fa50 2023-11-29T08:56:33.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:33.048+0000 7fdb6ffff640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fdb7006fa50 0x7fdb7006fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:56:33.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:33.048+0000 7fdb6f7fe640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fdb700703a0 0x7fdb70135110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:53982/0 (socket says 172.21.15.27:53982) 2023-11-29T08:56:33.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:33.048+0000 7fdb6ffff640 1 --2- 172.21.15.27:0/2275169402 >> v2:172.21.15.27:3300/0 conn(0x7fdb7006fa50 0x7fdb7006fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:49360/0 (socket says 172.21.15.27:49360) 2023-11-29T08:56:33.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:33.048+0000 7fdb6f7fe640 1 -- 172.21.15.27:0/2275169402 learned_addr learned my addr 172.21.15.27:0/2275169402 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-11-29T08:56:33.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:33.048+0000 7fdb6ffff640 1 -- 172.21.15.27:0/2275169402 >> v1:172.21.15.27:6789/0 conn(0x7fdb700703a0 legacy=0x7fdb70135110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:33.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:33.048+0000 7fdb6ffff640 1 -- 172.21.15.27:0/2275169402 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb70071830 con 0x7fdb7006fa50 2023-11-29T08:56:33.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:33.049+0000 7fdb6ffff640 1 --2- 172.21.15.27:0/2275169402 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb7006fa50 0x7fdb7006fe60 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba4c76de7af1041a server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:33.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:33.049+0000 7fdb6effd640 1 -- 172.21.15.27:0/2275169402 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fdb64009ce0 con 0x7fdb7006fa50 2023-11-29T08:56:33.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:33.049+0000 7fdb6effd640 1 -- 172.21.15.27:0/2275169402 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fdb64009e40 con 0x7fdb7006fa50 2023-11-29T08:56:33.050 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:33.049+0000 7fdb6effd640 1 -- 172.21.15.27:0/2275169402 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fdb6400e360 con 0x7fdb7006fa50 2023-11-29T08:56:33.051 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:33.049+0000 7fdb76420640 1 -- 172.21.15.27:0/2275169402 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb7006fa50 msgr2=0x7fdb7006fe60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:33.051 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:33.049+0000 7fdb76420640 1 --2- 172.21.15.27:0/2275169402 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb7006fa50 0x7fdb7006fe60 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:33.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:33.049+0000 7fdb76420640 1 -- 172.21.15.27:0/2275169402 shutdown_connections 2023-11-29T08:56:33.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:33.049+0000 7fdb76420640 1 --2- 172.21.15.27:0/2275169402 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb7006fa50 0x7fdb7006fe60 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:33.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:33.049+0000 7fdb76420640 1 -- 172.21.15.27:0/2275169402 >> 172.21.15.27:0/2275169402 conn(0x7fdb7009dff0 msgr2=0x7fdb7009e400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T08:56:33.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:33.049+0000 7fdb76420640 1 -- 172.21.15.27:0/2275169402 shutdown_connections 2023-11-29T08:56:33.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:33.049+0000 7fdb76420640 1 -- 172.21.15.27:0/2275169402 wait complete. 2023-11-29T08:56:33.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:33.050+0000 7fdb76420640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:56:33.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:33.051+0000 7fdb76420640 1 Processor -- start 2023-11-29T08:56:33.052 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:33.051+0000 7fdb76420640 1 -- start start 2023-11-29T08:56:33.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:33.051+0000 7fdb76420640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb7006fa50 0x7fdb7012d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:33.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:33.051+0000 7fdb76420640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb70130840 con 0x7fdb7006fa50 2023-11-29T08:56:33.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:33.051+0000 7fdb6ffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb7006fa50 0x7fdb7012d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:56:33.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:33.051+0000 7fdb6ffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb7006fa50 0x7fdb7012d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:49370/0 (socket says 172.21.15.27:49370) 2023-11-29T08:56:33.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:33.051+0000 7fdb6ffff640 1 -- 172.21.15.27:0/124047697 learned_addr learned my addr 172.21.15.27:0/124047697 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-11-29T08:56:33.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:33.052+0000 7fdb6ffff640 1 -- 172.21.15.27:0/124047697 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb701339b0 con 0x7fdb7006fa50 2023-11-29T08:56:33.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:33.052+0000 7fdb6ffff640 1 --2- 172.21.15.27:0/124047697 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb7006fa50 0x7fdb7012d3c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:33.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:33.052+0000 7fdb6cff9640 1 -- 172.21.15.27:0/124047697 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fdb64014620 con 0x7fdb7006fa50 2023-11-29T08:56:33.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:33.052+0000 7fdb6cff9640 1 -- 172.21.15.27:0/124047697 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fdb64014780 con 0x7fdb7006fa50 2023-11-29T08:56:33.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:33.052+0000 7fdb6cff9640 1 -- 172.21.15.27:0/124047697 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fdb64014a20 con 0x7fdb7006fa50 2023-11-29T08:56:33.054 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:33.052+0000 7fdb76420640 1 -- 172.21.15.27:0/124047697 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb701304e0 con 0x7fdb7006fa50 2023-11-29T08:56:33.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:33.052+0000 7fdb6cff9640 1 -- 172.21.15.27:0/124047697 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (crc 0 0 0) 0x7fdb64011380 con 0x7fdb7006fa50 2023-11-29T08:56:33.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:33.052+0000 7fdb76420640 1 -- 172.21.15.27:0/124047697 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb70130f10 con 0x7fdb7006fa50 2023-11-29T08:56:33.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:33.052+0000 7fdb6cff9640 1 -- 172.21.15.27:0/124047697 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (crc 0 0 0) 0x7fdb64019040 con 0x7fdb7006fa50 2023-11-29T08:56:33.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:33.053+0000 7fdb76420640 1 -- 172.21.15.27:0/124047697 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb70133b40 con 0x7fdb7006fa50 2023-11-29T08:56:33.055 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:33.055+0000 7fdb6cff9640 1 -- 172.21.15.27:0/124047697 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (crc 0 0 0) 0x7fdb640118b0 con 0x7fdb7006fa50 2023-11-29T08:56:33.132 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:33.131+0000 7fdb76420640 1 -- 172.21.15.27:0/124047697 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd set-allow-crimson", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fdb70062350 con 0x7fdb7006fa50 2023-11-29T08:56:33.132 INFO:tasks.ceph.mon.a.smithi027.stderr:2023-11-29T08:56:33.132+0000 7f1243ff1640 -1 WARNING: experimental feature 'crimson' is enabled 2023-11-29T08:56:33.132 INFO:tasks.ceph.mon.a.smithi027.stderr:Please be aware that this feature is experimental, untested, 2023-11-29T08:56:33.132 INFO:tasks.ceph.mon.a.smithi027.stderr:unsupported, and may result in data corruption, data loss, 2023-11-29T08:56:33.133 INFO:tasks.ceph.mon.a.smithi027.stderr:and/or irreparable damage to your cluster. Do not use 2023-11-29T08:56:33.133 INFO:tasks.ceph.mon.a.smithi027.stderr:feature with important data. 2023-11-29T08:56:33.133 INFO:tasks.ceph.mon.a.smithi027.stderr: 2023-11-29T08:56:33.309 INFO:tasks.ceph.mgr.x.smithi139.stderr:2023-11-29T08:56:33.307+0000 7ff9da81bf00 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-29T08:56:33.360 INFO:tasks.ceph.mgr.x.smithi139.stderr:2023-11-29T08:56:33.359+0000 7ff9da81bf00 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-29T08:56:33.883 INFO:tasks.ceph.mgr.x.smithi139.stderr:2023-11-29T08:56:33.882+0000 7ff9da81bf00 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-29T08:56:33.929 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:33.927+0000 7fdb6cff9640 1 -- 172.21.15.27:0/124047697 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd set-allow-crimson", "yes_i_really_mean_it": true}]=0 v3) v1 ==== 99+0+0 (crc 0 0 0) 0x7fdb64011b20 con 0x7fdb7006fa50 2023-11-29T08:56:33.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:33.928+0000 7fdb76420640 1 -- 172.21.15.27:0/124047697 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb7006fa50 msgr2=0x7fdb7012d3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:33.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:33.928+0000 7fdb76420640 1 --2- 172.21.15.27:0/124047697 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb7006fa50 0x7fdb7012d3c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:33.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:33.928+0000 7fdb76420640 1 -- 172.21.15.27:0/124047697 shutdown_connections 2023-11-29T08:56:33.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:33.928+0000 7fdb76420640 1 --2- 172.21.15.27:0/124047697 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb7006fa50 0x7fdb7012d3c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:33.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:33.928+0000 7fdb76420640 1 -- 172.21.15.27:0/124047697 >> 172.21.15.27:0/124047697 conn(0x7fdb7009dff0 msgr2=0x7fdb70126040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T08:56:33.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:33.928+0000 7fdb76420640 1 -- 172.21.15.27:0/124047697 shutdown_connections 2023-11-29T08:56:33.930 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:33.928+0000 7fdb76420640 1 -- 172.21.15.27:0/124047697 wait complete. 2023-11-29T08:56:33.935 INFO:tasks.ceph.mgr.x.smithi139.stderr:2023-11-29T08:56:33.934+0000 7ff9da81bf00 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-29T08:56:33.943 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-11-29T08:56:33.943 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-11-29T08:56:33.943 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-11-29T08:56:33.977 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-11-29T08:56:33.977 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-11-29T08:56:33.980 INFO:tasks.ceph.mgr.x.smithi139.stderr:2023-11-29T08:56:33.979+0000 7ff9da81bf00 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-29T08:56:34.033 INFO:tasks.ceph.mgr.x.smithi139.stderr:2023-11-29T08:56:34.032+0000 7ff9da81bf00 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-29T08:56:34.050 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2023-11-29T08:56:34.050 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-11-29T08:56:34.077 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2023-11-29T08:56:34.077 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-11-29T08:56:34.078 INFO:tasks.ceph.mgr.x.smithi139.stderr:2023-11-29T08:56:34.076+0000 7ff9da81bf00 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-29T08:56:34.145 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --cluster ceph osd new c3a4fc31-c7e4-4b1e-b91a-00c2ee6a3d17 0 2023-11-29T08:56:34.182 INFO:tasks.ceph.mgr.x.smithi139.stderr:2023-11-29T08:56:34.181+0000 7ff9da81bf00 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-11-29T08:56:34.258 INFO:tasks.ceph.mgr.x.smithi139.stderr:2023-11-29T08:56:34.257+0000 7ff9da81bf00 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-29T08:56:34.287 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.281+0000 7f5e7022d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:56:34.288 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.287+0000 7f5e7022d640 1 Processor -- start 2023-11-29T08:56:34.288 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.287+0000 7f5e7022d640 1 -- start start 2023-11-29T08:56:34.289 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.287+0000 7f5e7022d640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f5e68118200 0x7f5e68111ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:34.289 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.287+0000 7f5e7022d640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e68112ab0 con 0x7f5e681186d0 2023-11-29T08:56:34.289 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.287+0000 7f5e7022d640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e6811ebd0 con 0x7f5e68118200 2023-11-29T08:56:34.290 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.288+0000 7f5e6dfc9640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f5e68118200 0x7f5e68111ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:56:34.290 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.288+0000 7f5e6dfc9640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f5e68118200 0x7f5e68111ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.139:48260/0 (socket says 172.21.15.139:48260) 2023-11-29T08:56:34.290 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.288+0000 7f5e6dfc9640 1 -- 172.21.15.139:0/2499330656 learned_addr learned my addr 172.21.15.139:0/2499330656 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-11-29T08:56:34.290 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.288+0000 7f5e6d7c8640 1 --1- 172.21.15.139:0/2499330656 >> v1:172.21.15.27:6789/0 conn(0x7f5e681186d0 0x7f5e68112260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.139:55504/0 (socket says 172.21.15.139:55504) 2023-11-29T08:56:34.290 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.288+0000 7f5e6dfc9640 1 -- 172.21.15.139:0/2499330656 >> v1:172.21.15.27:6789/0 conn(0x7f5e681186d0 legacy=0x7f5e68112260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:34.290 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.288+0000 7f5e6dfc9640 1 -- 172.21.15.139:0/2499330656 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e6811ed10 con 0x7f5e68118200 2023-11-29T08:56:34.290 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.288+0000 7f5e6dfc9640 1 --2- 172.21.15.139:0/2499330656 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5e68118200 0x7f5e68111ca0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af76dce68b688f4d server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:34.290 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.289+0000 7f5e6cfc7640 1 -- 172.21.15.139:0/2499330656 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f5e58009dd0 con 0x7f5e68118200 2023-11-29T08:56:34.290 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.289+0000 7f5e6cfc7640 1 -- 172.21.15.139:0/2499330656 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f5e5800e230 con 0x7f5e68118200 2023-11-29T08:56:34.290 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.289+0000 7f5e6cfc7640 1 -- 172.21.15.139:0/2499330656 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f5e5800e4d0 con 0x7f5e68118200 2023-11-29T08:56:34.292 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.289+0000 7f5e7022d640 1 -- 172.21.15.139:0/2499330656 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5e68118200 msgr2=0x7f5e68111ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:34.292 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.289+0000 7f5e7022d640 1 --2- 172.21.15.139:0/2499330656 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5e68118200 0x7f5e68111ca0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:34.292 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.289+0000 7f5e7022d640 1 -- 172.21.15.139:0/2499330656 shutdown_connections 2023-11-29T08:56:34.292 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.289+0000 7f5e7022d640 1 --2- 172.21.15.139:0/2499330656 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5e68118200 0x7f5e68111ca0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:34.292 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.289+0000 7f5e7022d640 1 -- 172.21.15.139:0/2499330656 >> 172.21.15.139:0/2499330656 conn(0x7f5e6810dd70 msgr2=0x7f5e68110190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T08:56:34.292 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.289+0000 7f5e7022d640 1 -- 172.21.15.139:0/2499330656 shutdown_connections 2023-11-29T08:56:34.292 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.289+0000 7f5e7022d640 1 -- 172.21.15.139:0/2499330656 wait complete. 2023-11-29T08:56:34.292 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.290+0000 7f5e7022d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:56:34.292 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.290+0000 7f5e7022d640 1 Processor -- start 2023-11-29T08:56:34.292 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.290+0000 7f5e7022d640 1 -- start start 2023-11-29T08:56:34.293 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.290+0000 7f5e7022d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5e68118200 0x7f5e681a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:34.293 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.290+0000 7f5e7022d640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e681a74f0 con 0x7f5e68118200 2023-11-29T08:56:34.293 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.291+0000 7f5e6dfc9640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5e68118200 0x7f5e681a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:56:34.293 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.291+0000 7f5e6dfc9640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5e68118200 0x7f5e681a6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.139:48274/0 (socket says 172.21.15.139:48274) 2023-11-29T08:56:34.293 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.291+0000 7f5e6dfc9640 1 -- 172.21.15.139:0/2335588423 learned_addr learned my addr 172.21.15.139:0/2335588423 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-11-29T08:56:34.293 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.291+0000 7f5e6dfc9640 1 -- 172.21.15.139:0/2335588423 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e681a7630 con 0x7f5e68118200 2023-11-29T08:56:34.294 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.291+0000 7f5e6dfc9640 1 --2- 172.21.15.139:0/2335588423 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5e68118200 0x7f5e681a6fb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:34.294 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.292+0000 7f5e5e7fc640 1 -- 172.21.15.139:0/2335588423 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f5e58014540 con 0x7f5e68118200 2023-11-29T08:56:34.294 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.292+0000 7f5e5e7fc640 1 -- 172.21.15.139:0/2335588423 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f5e580146a0 con 0x7f5e68118200 2023-11-29T08:56:34.294 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.292+0000 7f5e7022d640 1 -- 172.21.15.139:0/2335588423 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e681a7880 con 0x7f5e68118200 2023-11-29T08:56:34.294 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.292+0000 7f5e5e7fc640 1 -- 172.21.15.139:0/2335588423 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f5e58014940 con 0x7f5e68118200 2023-11-29T08:56:34.294 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.292+0000 7f5e7022d640 1 -- 172.21.15.139:0/2335588423 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e681ab730 con 0x7f5e68118200 2023-11-29T08:56:34.294 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.292+0000 7f5e5e7fc640 1 -- 172.21.15.139:0/2335588423 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (crc 0 0 0) 0x7f5e58013400 con 0x7f5e68118200 2023-11-29T08:56:34.294 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.292+0000 7f5e5e7fc640 1 -- 172.21.15.139:0/2335588423 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 747+0+0 (crc 0 0 0) 0x7f5e58019040 con 0x7f5e68118200 2023-11-29T08:56:34.294 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.292+0000 7f5e7022d640 1 -- 172.21.15.139:0/2335588423 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e68062350 con 0x7f5e68118200 2023-11-29T08:56:34.296 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.295+0000 7f5e5e7fc640 1 -- 172.21.15.139:0/2335588423 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (crc 0 0 0) 0x7f5e58013940 con 0x7f5e68118200 2023-11-29T08:56:34.306 INFO:tasks.ceph.mgr.x.smithi139.stderr:2023-11-29T08:56:34.306+0000 7ff9da81bf00 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-29T08:56:34.360 INFO:tasks.ceph.mgr.x.smithi139.stderr:2023-11-29T08:56:34.359+0000 7ff9da81bf00 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-29T08:56:34.368 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.367+0000 7f5e7022d640 1 -- 172.21.15.139:0/2335588423 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c3a4fc31-c7e4-4b1e-b91a-00c2ee6a3d17", "id": 0} v 0) v1 -- 0x7f5e681186d0 con 0x7f5e68118200 2023-11-29T08:56:34.369 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.368+0000 7f5e5e7fc640 1 -- 172.21.15.139:0/2335588423 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c3a4fc31-c7e4-4b1e-b91a-00c2ee6a3d17", "id": 0}]=0 v4) v1 ==== 112+0+2 (crc 0 0 0) 0x7f5e58013c30 con 0x7f5e68118200 2023-11-29T08:56:34.369 INFO:teuthology.orchestra.run.smithi139.stdout:0 2023-11-29T08:56:34.371 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.369+0000 7f5e7022d640 1 -- 172.21.15.139:0/2335588423 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5e68118200 msgr2=0x7f5e681a6fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:34.371 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.369+0000 7f5e7022d640 1 --2- 172.21.15.139:0/2335588423 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5e68118200 0x7f5e681a6fb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:34.371 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.369+0000 7f5e7022d640 1 -- 172.21.15.139:0/2335588423 shutdown_connections 2023-11-29T08:56:34.371 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.369+0000 7f5e7022d640 1 --2- 172.21.15.139:0/2335588423 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5e68118200 0x7f5e681a6fb0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:34.371 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.369+0000 7f5e7022d640 1 -- 172.21.15.139:0/2335588423 >> 172.21.15.139:0/2335588423 conn(0x7f5e6810dd70 msgr2=0x7f5e681106a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T08:56:34.371 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.369+0000 7f5e7022d640 1 -- 172.21.15.139:0/2335588423 shutdown_connections 2023-11-29T08:56:34.371 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.369+0000 7f5e7022d640 1 -- 172.21.15.139:0/2335588423 wait complete. 2023-11-29T08:56:34.381 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --cluster ceph osd new af3af16a-a1a1-44c4-bff0-ae118c84e89b 1 2023-11-29T08:56:34.411 INFO:tasks.ceph.mgr.x.smithi139.stderr:2023-11-29T08:56:34.410+0000 7ff9da81bf00 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-29T08:56:34.486 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.480+0000 7f3bbc60f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:56:34.487 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.485+0000 7f3bbc60f640 1 Processor -- start 2023-11-29T08:56:34.487 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.485+0000 7f3bbc60f640 1 -- start start 2023-11-29T08:56:34.487 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.486+0000 7f3bbc60f640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f3bb41186d0 0x7f3bb4112430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:34.487 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.486+0000 7f3bbc60f640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bb4112ab0 con 0x7f3bb4118200 2023-11-29T08:56:34.487 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.486+0000 7f3bbc60f640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bb411ebd0 con 0x7f3bb41186d0 2023-11-29T08:56:34.487 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.486+0000 7f3bb9baa640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f3bb41186d0 0x7f3bb4112430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:56:34.487 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.486+0000 7f3bb9baa640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f3bb41186d0 0x7f3bb4112430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.139:48276/0 (socket says 172.21.15.139:48276) 2023-11-29T08:56:34.488 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.486+0000 7f3bb9baa640 1 -- 172.21.15.139:0/2882027383 learned_addr learned my addr 172.21.15.139:0/2882027383 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-11-29T08:56:34.488 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.486+0000 7f3bba3ab640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f3bb4118200 0x7f3bb4111ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.139:55510/0 (socket says 172.21.15.139:55510) 2023-11-29T08:56:34.489 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.486+0000 7f3bb9baa640 1 -- 172.21.15.139:0/2882027383 >> v1:172.21.15.27:6789/0 conn(0x7f3bb4118200 legacy=0x7f3bb4111ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:34.489 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.486+0000 7f3bb9baa640 1 -- 172.21.15.139:0/2882027383 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb411ed10 con 0x7f3bb41186d0 2023-11-29T08:56:34.489 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.487+0000 7f3bb9baa640 1 --2- 172.21.15.139:0/2882027383 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3bb41186d0 0x7f3bb4112430 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3310c215d62a140a server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:34.489 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.487+0000 7f3bb93a9640 1 -- 172.21.15.139:0/2882027383 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f3bb0009dd0 con 0x7f3bb41186d0 2023-11-29T08:56:34.489 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.487+0000 7f3bb93a9640 1 -- 172.21.15.139:0/2882027383 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f3bb000e230 con 0x7f3bb41186d0 2023-11-29T08:56:34.489 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.487+0000 7f3bb93a9640 1 -- 172.21.15.139:0/2882027383 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f3bb000e4d0 con 0x7f3bb41186d0 2023-11-29T08:56:34.490 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.487+0000 7f3bbc60f640 1 -- 172.21.15.139:0/2882027383 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3bb41186d0 msgr2=0x7f3bb4112430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:34.490 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.487+0000 7f3bbc60f640 1 --2- 172.21.15.139:0/2882027383 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3bb41186d0 0x7f3bb4112430 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:34.490 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.488+0000 7f3bbc60f640 1 -- 172.21.15.139:0/2882027383 shutdown_connections 2023-11-29T08:56:34.490 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.488+0000 7f3bbc60f640 1 --2- 172.21.15.139:0/2882027383 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3bb41186d0 0x7f3bb4112430 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:34.490 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.488+0000 7f3bbc60f640 1 -- 172.21.15.139:0/2882027383 >> 172.21.15.139:0/2882027383 conn(0x7f3bb410dd70 msgr2=0x7f3bb4110190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T08:56:34.490 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.488+0000 7f3bbc60f640 1 -- 172.21.15.139:0/2882027383 shutdown_connections 2023-11-29T08:56:34.490 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.488+0000 7f3bbc60f640 1 -- 172.21.15.139:0/2882027383 wait complete. 2023-11-29T08:56:34.490 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.488+0000 7f3bbc60f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:56:34.490 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.488+0000 7f3bbc60f640 1 Processor -- start 2023-11-29T08:56:34.490 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.488+0000 7f3bbc60f640 1 -- start start 2023-11-29T08:56:34.492 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.489+0000 7f3bbc60f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3bb4118200 0x7f3bb41a6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:34.492 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.489+0000 7f3bbc60f640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb41a73b0 con 0x7f3bb4118200 2023-11-29T08:56:34.492 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.489+0000 7f3bba3ab640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3bb4118200 0x7f3bb41a6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:56:34.492 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.489+0000 7f3bba3ab640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3bb4118200 0x7f3bb41a6de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.139:48280/0 (socket says 172.21.15.139:48280) 2023-11-29T08:56:34.492 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.489+0000 7f3bba3ab640 1 -- 172.21.15.139:0/2232969528 learned_addr learned my addr 172.21.15.139:0/2232969528 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-11-29T08:56:34.492 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.489+0000 7f3bba3ab640 1 -- 172.21.15.139:0/2232969528 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb41a74f0 con 0x7f3bb4118200 2023-11-29T08:56:34.492 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.489+0000 7f3bba3ab640 1 --2- 172.21.15.139:0/2232969528 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3bb4118200 0x7f3bb41a6de0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:34.492 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.489+0000 7f3baaffd640 1 -- 172.21.15.139:0/2232969528 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f3ba40071e0 con 0x7f3bb4118200 2023-11-29T08:56:34.492 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.489+0000 7f3baaffd640 1 -- 172.21.15.139:0/2232969528 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f3ba4007340 con 0x7f3bb4118200 2023-11-29T08:56:34.492 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.490+0000 7f3bbc60f640 1 -- 172.21.15.139:0/2232969528 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bb41a77a0 con 0x7f3bb4118200 2023-11-29T08:56:34.492 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.490+0000 7f3baaffd640 1 -- 172.21.15.139:0/2232969528 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f3ba40075e0 con 0x7f3bb4118200 2023-11-29T08:56:34.493 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.490+0000 7f3bbc60f640 1 -- 172.21.15.139:0/2232969528 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bb41ab6e0 con 0x7f3bb4118200 2023-11-29T08:56:34.493 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.490+0000 7f3baaffd640 1 -- 172.21.15.139:0/2232969528 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (crc 0 0 0) 0x7f3ba4005ae0 con 0x7f3bb4118200 2023-11-29T08:56:34.493 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.490+0000 7f3baaffd640 1 -- 172.21.15.139:0/2232969528 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 862+0+0 (crc 0 0 0) 0x7f3ba400f5f0 con 0x7f3bb4118200 2023-11-29T08:56:34.493 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.490+0000 7f3bbc60f640 1 -- 172.21.15.139:0/2232969528 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bb41a7990 con 0x7f3bb4118200 2023-11-29T08:56:34.494 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.493+0000 7f3baaffd640 1 -- 172.21.15.139:0/2232969528 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (crc 0 0 0) 0x7f3ba400c6a0 con 0x7f3bb4118200 2023-11-29T08:56:34.565 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.564+0000 7f3bbc60f640 1 -- 172.21.15.139:0/2232969528 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd new", "uuid": "af3af16a-a1a1-44c4-bff0-ae118c84e89b", "id": 1} v 0) v1 -- 0x7f3bb41186d0 con 0x7f3bb4118200 2023-11-29T08:56:34.567 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.565+0000 7f3baaffd640 1 -- 172.21.15.139:0/2232969528 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "af3af16a-a1a1-44c4-bff0-ae118c84e89b", "id": 1}]=0 v5) v1 ==== 112+0+2 (crc 0 0 0) 0x7f3ba400c8c0 con 0x7f3bb4118200 2023-11-29T08:56:34.567 INFO:teuthology.orchestra.run.smithi139.stdout:1 2023-11-29T08:56:34.568 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.566+0000 7f3bbc60f640 1 -- 172.21.15.139:0/2232969528 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3bb4118200 msgr2=0x7f3bb41a6de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:34.568 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.566+0000 7f3bbc60f640 1 --2- 172.21.15.139:0/2232969528 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3bb4118200 0x7f3bb41a6de0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:34.568 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.566+0000 7f3bbc60f640 1 -- 172.21.15.139:0/2232969528 shutdown_connections 2023-11-29T08:56:34.568 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.566+0000 7f3bbc60f640 1 --2- 172.21.15.139:0/2232969528 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3bb4118200 0x7f3bb41a6de0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:34.568 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.566+0000 7f3bbc60f640 1 -- 172.21.15.139:0/2232969528 >> 172.21.15.139:0/2232969528 conn(0x7f3bb410dd70 msgr2=0x7f3bb41106d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T08:56:34.568 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.567+0000 7f3bbc60f640 1 -- 172.21.15.139:0/2232969528 shutdown_connections 2023-11-29T08:56:34.568 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.567+0000 7f3bbc60f640 1 -- 172.21.15.139:0/2232969528 wait complete. 2023-11-29T08:56:34.578 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --cluster ceph osd new 785f8fdd-8dc3-49b7-b1f9-97d50c7c5b2e 2 2023-11-29T08:56:34.724 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.718+0000 7fcbbbf9e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:56:34.725 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.723+0000 7fcbbbf9e640 1 Processor -- start 2023-11-29T08:56:34.725 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.724+0000 7fcbbbf9e640 1 -- start start 2023-11-29T08:56:34.726 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.724+0000 7fcbbbf9e640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fcbb4112340 0x7fcbb411db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:34.726 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.724+0000 7fcbbbf9e640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbb4118880 con 0x7fcbb41181c0 2023-11-29T08:56:34.726 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.724+0000 7fcbbbf9e640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbb4112750 con 0x7fcbb4112340 2023-11-29T08:56:34.726 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.724+0000 7fcbb9539640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fcbb4112340 0x7fcbb411db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:56:34.726 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.724+0000 7fcbb9d3a640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fcbb41181c0 0x7fcbb4111c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.139:55512/0 (socket says 172.21.15.139:55512) 2023-11-29T08:56:34.726 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.724+0000 7fcbb9539640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fcbb4112340 0x7fcbb411db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.139:48284/0 (socket says 172.21.15.139:48284) 2023-11-29T08:56:34.726 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.724+0000 7fcbb9d3a640 1 -- 172.21.15.139:0/4073081389 learned_addr learned my addr 172.21.15.139:0/4073081389 (peer_addr_for_me v1:172.21.15.139:0/0) 2023-11-29T08:56:34.727 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.725+0000 7fcbb9539640 1 -- 172.21.15.139:0/4073081389 >> v1:172.21.15.27:6789/0 conn(0x7fcbb41181c0 legacy=0x7fcbb4111c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:34.727 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.725+0000 7fcbb9539640 1 -- 172.21.15.139:0/4073081389 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbb41128c0 con 0x7fcbb4112340 2023-11-29T08:56:34.727 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.725+0000 7fcbb9539640 1 --2- 172.21.15.139:0/4073081389 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcbb4112340 0x7fcbb411db80 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9965ce9b7029b457 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:34.727 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.725+0000 7fcbb8d38640 1 -- 172.21.15.139:0/4073081389 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fcba4009ce0 con 0x7fcbb4112340 2023-11-29T08:56:34.727 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.725+0000 7fcbb8d38640 1 -- 172.21.15.139:0/4073081389 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fcba4009e40 con 0x7fcbb4112340 2023-11-29T08:56:34.727 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.725+0000 7fcbb8d38640 1 -- 172.21.15.139:0/4073081389 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fcba400e360 con 0x7fcbb4112340 2023-11-29T08:56:34.729 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.726+0000 7fcbbbf9e640 1 -- 172.21.15.139:0/4073081389 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcbb4112340 msgr2=0x7fcbb411db80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:34.729 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.726+0000 7fcbbbf9e640 1 --2- 172.21.15.139:0/4073081389 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcbb4112340 0x7fcbb411db80 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:34.729 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.726+0000 7fcbbbf9e640 1 -- 172.21.15.139:0/4073081389 shutdown_connections 2023-11-29T08:56:34.729 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.726+0000 7fcbbbf9e640 1 --2- 172.21.15.139:0/4073081389 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcbb4112340 0x7fcbb411db80 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:34.729 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.726+0000 7fcbbbf9e640 1 -- 172.21.15.139:0/4073081389 >> 172.21.15.139:0/4073081389 conn(0x7fcbb410dd70 msgr2=0x7fcbb4110190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T08:56:34.729 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.726+0000 7fcbbbf9e640 1 -- 172.21.15.139:0/4073081389 shutdown_connections 2023-11-29T08:56:34.730 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.726+0000 7fcbbbf9e640 1 -- 172.21.15.139:0/4073081389 wait complete. 2023-11-29T08:56:34.730 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.726+0000 7fcbbbf9e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:56:34.730 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.727+0000 7fcbbbf9e640 1 Processor -- start 2023-11-29T08:56:34.730 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.727+0000 7fcbbbf9e640 1 -- start start 2023-11-29T08:56:34.730 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.727+0000 7fcbbbf9e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcbb4112340 0x7fcbb41acb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:34.730 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.727+0000 7fcbbbf9e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb41ad100 con 0x7fcbb4112340 2023-11-29T08:56:34.730 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.727+0000 7fcbb9d3a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcbb4112340 0x7fcbb41acb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:56:34.730 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.727+0000 7fcbb9d3a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcbb4112340 0x7fcbb41acb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.139:48286/0 (socket says 172.21.15.139:48286) 2023-11-29T08:56:34.730 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.727+0000 7fcbb9d3a640 1 -- 172.21.15.139:0/2613693521 learned_addr learned my addr 172.21.15.139:0/2613693521 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-11-29T08:56:34.730 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.727+0000 7fcbb9d3a640 1 -- 172.21.15.139:0/2613693521 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbb41ad240 con 0x7fcbb4112340 2023-11-29T08:56:34.730 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.728+0000 7fcbb9d3a640 1 --2- 172.21.15.139:0/2613693521 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcbb4112340 0x7fcbb41acb30 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:34.730 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.728+0000 7fcbaa7fc640 1 -- 172.21.15.139:0/2613693521 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fcbb00059d0 con 0x7fcbb4112340 2023-11-29T08:56:34.730 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.728+0000 7fcbaa7fc640 1 -- 172.21.15.139:0/2613693521 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fcbb0005b30 con 0x7fcbb4112340 2023-11-29T08:56:34.730 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.728+0000 7fcbbbf9e640 1 -- 172.21.15.139:0/2613693521 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbb41ad490 con 0x7fcbb4112340 2023-11-29T08:56:34.730 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.728+0000 7fcbaa7fc640 1 -- 172.21.15.139:0/2613693521 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fcbb0005dd0 con 0x7fcbb4112340 2023-11-29T08:56:34.730 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.728+0000 7fcbbbf9e640 1 -- 172.21.15.139:0/2613693521 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbb41a6e20 con 0x7fcbb4112340 2023-11-29T08:56:34.731 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.728+0000 7fcbaa7fc640 1 -- 172.21.15.139:0/2613693521 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (crc 0 0 0) 0x7fcbb00073b0 con 0x7fcbb4112340 2023-11-29T08:56:34.731 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.728+0000 7fcbaa7fc640 1 -- 172.21.15.139:0/2613693521 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 977+0+0 (crc 0 0 0) 0x7fcbb0007660 con 0x7fcbb4112340 2023-11-29T08:56:34.731 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.729+0000 7fcbbbf9e640 1 -- 172.21.15.139:0/2613693521 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbb4062350 con 0x7fcbb4112340 2023-11-29T08:56:34.732 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.731+0000 7fcbaa7fc640 1 -- 172.21.15.139:0/2613693521 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (crc 0 0 0) 0x7fcbb000c740 con 0x7fcbb4112340 2023-11-29T08:56:34.804 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.802+0000 7fcbbbf9e640 1 -- 172.21.15.139:0/2613693521 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd new", "uuid": "785f8fdd-8dc3-49b7-b1f9-97d50c7c5b2e", "id": 2} v 0) v1 -- 0x7fcbb41181f0 con 0x7fcbb4112340 2023-11-29T08:56:34.805 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.804+0000 7fcbaa7fc640 1 -- 172.21.15.139:0/2613693521 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "785f8fdd-8dc3-49b7-b1f9-97d50c7c5b2e", "id": 2}]=0 v6) v1 ==== 112+0+2 (crc 0 0 0) 0x7fcbb000c9b0 con 0x7fcbb4112340 2023-11-29T08:56:34.805 INFO:teuthology.orchestra.run.smithi139.stdout:2 2023-11-29T08:56:34.806 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.805+0000 7fcbbbf9e640 1 -- 172.21.15.139:0/2613693521 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcbb4112340 msgr2=0x7fcbb41acb30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:34.806 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.805+0000 7fcbbbf9e640 1 --2- 172.21.15.139:0/2613693521 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcbb4112340 0x7fcbb41acb30 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:34.806 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.805+0000 7fcbbbf9e640 1 -- 172.21.15.139:0/2613693521 shutdown_connections 2023-11-29T08:56:34.806 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.805+0000 7fcbbbf9e640 1 --2- 172.21.15.139:0/2613693521 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcbb4112340 0x7fcbb41acb30 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:34.806 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.805+0000 7fcbbbf9e640 1 -- 172.21.15.139:0/2613693521 >> 172.21.15.139:0/2613693521 conn(0x7fcbb410dd70 msgr2=0x7fcbb4113e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T08:56:34.807 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.805+0000 7fcbbbf9e640 1 -- 172.21.15.139:0/2613693521 shutdown_connections 2023-11-29T08:56:34.807 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.805+0000 7fcbbbf9e640 1 -- 172.21.15.139:0/2613693521 wait complete. 2023-11-29T08:56:34.812 INFO:tasks.ceph.mgr.x.smithi139.stderr:2023-11-29T08:56:34.811+0000 7ff9da81bf00 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-29T08:56:34.816 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --cluster ceph osd new b6f10cdd-088d-4969-858e-ba29f1b77cd0 3 2023-11-29T08:56:34.921 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.915+0000 7efc5279e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:56:34.923 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.921+0000 7efc5279e640 1 Processor -- start 2023-11-29T08:56:34.923 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.921+0000 7efc5279e640 1 -- start start 2023-11-29T08:56:34.923 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.921+0000 7efc5279e640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7efc4c1181c0 0x7efc4c111c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:34.923 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.921+0000 7efc5279e640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc4c118880 con 0x7efc4c112170 2023-11-29T08:56:34.923 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.921+0000 7efc5279e640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc4c112580 con 0x7efc4c1181c0 2023-11-29T08:56:34.923 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.921+0000 7efc4bfff640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7efc4c1181c0 0x7efc4c111c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:56:34.923 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.921+0000 7efc4b7fe640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7efc4c112170 0x7efc4c11cb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.139:55528/0 (socket says 172.21.15.139:55528) 2023-11-29T08:56:34.923 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.921+0000 7efc4b7fe640 1 -- 172.21.15.139:0/830222337 learned_addr learned my addr 172.21.15.139:0/830222337 (peer_addr_for_me v1:172.21.15.139:0/0) 2023-11-29T08:56:34.923 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.922+0000 7efc4bfff640 1 -- 172.21.15.139:0/830222337 >> v1:172.21.15.27:6789/0 conn(0x7efc4c112170 legacy=0x7efc4c11cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:34.923 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.922+0000 7efc4bfff640 1 -- 172.21.15.139:0/830222337 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc4c1126f0 con 0x7efc4c1181c0 2023-11-29T08:56:34.923 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.922+0000 7efc4bfff640 1 --2- 172.21.15.139:0/830222337 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efc4c1181c0 0x7efc4c111c30 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5116bc8f1311081c server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:34.925 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.922+0000 7efc4affd640 1 -- 172.21.15.139:0/830222337 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7efc3c009ce0 con 0x7efc4c1181c0 2023-11-29T08:56:34.925 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.922+0000 7efc4affd640 1 -- 172.21.15.139:0/830222337 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7efc3c009e40 con 0x7efc4c1181c0 2023-11-29T08:56:34.925 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.922+0000 7efc4affd640 1 -- 172.21.15.139:0/830222337 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7efc3c00e360 con 0x7efc4c1181c0 2023-11-29T08:56:34.926 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.923+0000 7efc5279e640 1 -- 172.21.15.139:0/830222337 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efc4c1181c0 msgr2=0x7efc4c111c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:34.926 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.923+0000 7efc5279e640 1 --2- 172.21.15.139:0/830222337 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efc4c1181c0 0x7efc4c111c30 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:34.926 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.923+0000 7efc5279e640 1 -- 172.21.15.139:0/830222337 shutdown_connections 2023-11-29T08:56:34.926 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.923+0000 7efc5279e640 1 --2- 172.21.15.139:0/830222337 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efc4c1181c0 0x7efc4c111c30 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:34.926 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.923+0000 7efc5279e640 1 -- 172.21.15.139:0/830222337 >> 172.21.15.139:0/830222337 conn(0x7efc4c10dd70 msgr2=0x7efc4c110190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T08:56:34.926 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.923+0000 7efc5279e640 1 -- 172.21.15.139:0/830222337 shutdown_connections 2023-11-29T08:56:34.926 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.923+0000 7efc5279e640 1 -- 172.21.15.139:0/830222337 wait complete. 2023-11-29T08:56:34.926 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.923+0000 7efc5279e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:56:34.926 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.924+0000 7efc5279e640 1 Processor -- start 2023-11-29T08:56:34.926 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.924+0000 7efc5279e640 1 -- start start 2023-11-29T08:56:34.926 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.924+0000 7efc5279e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efc4c112170 0x7efc4c1aca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:34.926 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.924+0000 7efc5279e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc4c1acfe0 con 0x7efc4c112170 2023-11-29T08:56:34.926 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.924+0000 7efc4bfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efc4c112170 0x7efc4c1aca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:56:34.926 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.924+0000 7efc4bfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efc4c112170 0x7efc4c1aca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.139:48310/0 (socket says 172.21.15.139:48310) 2023-11-29T08:56:34.927 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.924+0000 7efc4bfff640 1 -- 172.21.15.139:0/1951561248 learned_addr learned my addr 172.21.15.139:0/1951561248 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-11-29T08:56:34.928 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.925+0000 7efc4bfff640 1 -- 172.21.15.139:0/1951561248 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc4c1ad120 con 0x7efc4c112170 2023-11-29T08:56:34.928 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.925+0000 7efc4bfff640 1 --2- 172.21.15.139:0/1951561248 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efc4c112170 0x7efc4c1aca10 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:34.928 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.925+0000 7efc48ff9640 1 -- 172.21.15.139:0/1951561248 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7efc3c014540 con 0x7efc4c112170 2023-11-29T08:56:34.928 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.925+0000 7efc48ff9640 1 -- 172.21.15.139:0/1951561248 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7efc3c0146a0 con 0x7efc4c112170 2023-11-29T08:56:34.928 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.925+0000 7efc5279e640 1 -- 172.21.15.139:0/1951561248 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc4c1ad310 con 0x7efc4c112170 2023-11-29T08:56:34.928 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.925+0000 7efc48ff9640 1 -- 172.21.15.139:0/1951561248 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7efc3c014940 con 0x7efc4c112170 2023-11-29T08:56:34.928 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.925+0000 7efc5279e640 1 -- 172.21.15.139:0/1951561248 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc4c1a6d00 con 0x7efc4c112170 2023-11-29T08:56:34.928 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.925+0000 7efc48ff9640 1 -- 172.21.15.139:0/1951561248 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (crc 0 0 0) 0x7efc3c013400 con 0x7efc4c112170 2023-11-29T08:56:34.928 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.925+0000 7efc48ff9640 1 -- 172.21.15.139:0/1951561248 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1092+0+0 (crc 0 0 0) 0x7efc3c013b60 con 0x7efc4c112170 2023-11-29T08:56:34.928 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.926+0000 7efc5279e640 1 -- 172.21.15.139:0/1951561248 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc4c062350 con 0x7efc4c112170 2023-11-29T08:56:34.929 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.928+0000 7efc48ff9640 1 -- 172.21.15.139:0/1951561248 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (crc 0 0 0) 0x7efc3c013dd0 con 0x7efc4c112170 2023-11-29T08:56:34.945 INFO:tasks.ceph.mgr.x.smithi139.stderr:2023-11-29T08:56:34.944+0000 7ff9da81bf00 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-29T08:56:35.000 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:34.999+0000 7efc5279e640 1 -- 172.21.15.139:0/1951561248 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b6f10cdd-088d-4969-858e-ba29f1b77cd0", "id": 3} v 0) v1 -- 0x7efc4c1181f0 con 0x7efc4c112170 2023-11-29T08:56:35.004 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:35.003+0000 7efc48ff9640 1 -- 172.21.15.139:0/1951561248 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b6f10cdd-088d-4969-858e-ba29f1b77cd0", "id": 3}]=0 v7) v1 ==== 112+0+2 (crc 0 0 0) 0x7efc3c013780 con 0x7efc4c112170 2023-11-29T08:56:35.004 INFO:teuthology.orchestra.run.smithi139.stdout:3 2023-11-29T08:56:35.005 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:35.004+0000 7efc5279e640 1 -- 172.21.15.139:0/1951561248 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efc4c112170 msgr2=0x7efc4c1aca10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:35.005 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:35.004+0000 7efc5279e640 1 --2- 172.21.15.139:0/1951561248 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efc4c112170 0x7efc4c1aca10 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:35.006 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:35.004+0000 7efc5279e640 1 -- 172.21.15.139:0/1951561248 shutdown_connections 2023-11-29T08:56:35.006 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:35.004+0000 7efc5279e640 1 --2- 172.21.15.139:0/1951561248 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efc4c112170 0x7efc4c1aca10 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:35.006 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:35.004+0000 7efc5279e640 1 -- 172.21.15.139:0/1951561248 >> 172.21.15.139:0/1951561248 conn(0x7efc4c10dd70 msgr2=0x7efc4c113ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T08:56:35.006 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:35.004+0000 7efc5279e640 1 -- 172.21.15.139:0/1951561248 shutdown_connections 2023-11-29T08:56:35.006 INFO:teuthology.orchestra.run.smithi139.stderr:2023-11-29T08:56:35.004+0000 7efc5279e640 1 -- 172.21.15.139:0/1951561248 wait complete. 2023-11-29T08:56:35.015 DEBUG:teuthology.orchestra.run.smithi027:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.0.log 2023-11-29T08:56:35.055 INFO:tasks.ceph.mgr.x.smithi139.stderr:2023-11-29T08:56:35.054+0000 7ff9da81bf00 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-29T08:56:35.056 INFO:tasks.ceph.osd.0:Restarting daemon 2023-11-29T08:56:35.056 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2023-11-29T08:56:35.099 INFO:tasks.ceph.osd.0:Started 2023-11-29T08:56:35.099 DEBUG:teuthology.orchestra.run.smithi027:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.1.log 2023-11-29T08:56:35.101 INFO:tasks.ceph.mgr.x.smithi139.stderr:2023-11-29T08:56:35.099+0000 7ff9da81bf00 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-29T08:56:35.136 INFO:tasks.ceph.osd.1:Restarting daemon 2023-11-29T08:56:35.137 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log 2023-11-29T08:56:35.179 INFO:tasks.ceph.osd.1:Started 2023-11-29T08:56:35.179 DEBUG:teuthology.orchestra.run.smithi139:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.2.log 2023-11-29T08:56:35.198 INFO:tasks.ceph.mgr.x.smithi139.stderr:2023-11-29T08:56:35.197+0000 7ff9da81bf00 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-29T08:56:35.210 INFO:tasks.ceph.osd.2:Restarting daemon 2023-11-29T08:56:35.210 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log 2023-11-29T08:56:35.252 INFO:tasks.ceph.osd.2:Started 2023-11-29T08:56:35.252 DEBUG:teuthology.orchestra.run.smithi139:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.3.log 2023-11-29T08:56:35.282 INFO:tasks.ceph.osd.3:Restarting daemon 2023-11-29T08:56:35.282 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2>> /var/log/ceph/ceph-osd.3.log 2023-11-29T08:56:35.299 INFO:tasks.ceph.mgr.x.smithi139.stderr:2023-11-29T08:56:35.297+0000 7ff9da81bf00 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-29T08:56:35.300 INFO:tasks.ceph.osd.3:Started 2023-11-29T08:56:35.300 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T08:56:35.430 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:35.424+0000 7f6d7ccf7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:56:35.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:35.429+0000 7f6d7ccf7640 1 Processor -- start 2023-11-29T08:56:35.431 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:35.429+0000 7f6d7ccf7640 1 -- start start 2023-11-29T08:56:35.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:35.430+0000 7f6d7ccf7640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f6d78133690 0x7f6d781392d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:35.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:35.430+0000 7f6d7ccf7640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d780a1870 con 0x7f6d780a1040 2023-11-29T08:56:35.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:35.430+0000 7f6d7ccf7640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d7809cb90 con 0x7f6d78133690 2023-11-29T08:56:35.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:35.430+0000 7f6d75d9b640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f6d78133690 0x7f6d781392d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:56:35.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:35.430+0000 7f6d7659c640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f6d780a1040 0x7f6d78132f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:53984/0 (socket says 172.21.15.27:53984) 2023-11-29T08:56:35.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:35.430+0000 7f6d7659c640 1 -- 172.21.15.27:0/3207628770 learned_addr learned my addr 172.21.15.27:0/3207628770 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-11-29T08:56:35.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:35.431+0000 7f6d75d9b640 1 -- 172.21.15.27:0/3207628770 >> v1:172.21.15.27:6789/0 conn(0x7f6d780a1040 legacy=0x7f6d78132f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:35.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:35.431+0000 7f6d75d9b640 1 -- 172.21.15.27:0/3207628770 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d781300a0 con 0x7f6d78133690 2023-11-29T08:56:35.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:35.431+0000 7f6d75d9b640 1 --2- 172.21.15.27:0/3207628770 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d78133690 0x7f6d781392d0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74467d8caea0efa0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:35.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:35.431+0000 7f6d7559a640 1 -- 172.21.15.27:0/3207628770 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f6d6c009ce0 con 0x7f6d78133690 2023-11-29T08:56:35.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:35.431+0000 7f6d7559a640 1 -- 172.21.15.27:0/3207628770 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f6d6c009e40 con 0x7f6d78133690 2023-11-29T08:56:35.433 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:35.431+0000 7f6d7559a640 1 -- 172.21.15.27:0/3207628770 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f6d6c00e360 con 0x7f6d78133690 2023-11-29T08:56:35.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:35.433+0000 7f6d7ccf7640 1 -- 172.21.15.27:0/3207628770 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d78133690 msgr2=0x7f6d781392d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:35.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:35.433+0000 7f6d7ccf7640 1 --2- 172.21.15.27:0/3207628770 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d78133690 0x7f6d781392d0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:35.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:35.433+0000 7f6d7ccf7640 1 -- 172.21.15.27:0/3207628770 shutdown_connections 2023-11-29T08:56:35.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:35.433+0000 7f6d7ccf7640 1 --2- 172.21.15.27:0/3207628770 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d78133690 0x7f6d781392d0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:35.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:35.433+0000 7f6d7ccf7640 1 -- 172.21.15.27:0/3207628770 >> 172.21.15.27:0/3207628770 conn(0x7f6d7806c9c0 msgr2=0x7f6d7806cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T08:56:35.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:35.433+0000 7f6d7ccf7640 1 -- 172.21.15.27:0/3207628770 shutdown_connections 2023-11-29T08:56:35.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:35.433+0000 7f6d7ccf7640 1 -- 172.21.15.27:0/3207628770 wait complete. 2023-11-29T08:56:35.435 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:35.433+0000 7f6d7ccf7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:56:35.437 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:35.435+0000 7f6d7ccf7640 1 Processor -- start 2023-11-29T08:56:35.437 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:35.435+0000 7f6d7ccf7640 1 -- start start 2023-11-29T08:56:35.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:35.437+0000 7f6d7ccf7640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d780a1040 0x7f6d7811c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:35.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:35.437+0000 7f6d7ccf7640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d7811fe90 con 0x7f6d780a1040 2023-11-29T08:56:35.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:35.437+0000 7f6d7659c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d780a1040 0x7f6d7811c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:56:35.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:35.437+0000 7f6d7659c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d780a1040 0x7f6d7811c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:49384/0 (socket says 172.21.15.27:49384) 2023-11-29T08:56:35.439 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:35.437+0000 7f6d7659c640 1 -- 172.21.15.27:0/1512421631 learned_addr learned my addr 172.21.15.27:0/1512421631 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-11-29T08:56:35.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:35.437+0000 7f6d7659c640 1 -- 172.21.15.27:0/1512421631 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d7811bc20 con 0x7f6d780a1040 2023-11-29T08:56:35.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:35.438+0000 7f6d7659c640 1 --2- 172.21.15.27:0/1512421631 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d780a1040 0x7f6d7811c2d0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:35.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:35.438+0000 7f6d66ffd640 1 -- 172.21.15.27:0/1512421631 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f6d680059d0 con 0x7f6d780a1040 2023-11-29T08:56:35.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:35.438+0000 7f6d66ffd640 1 -- 172.21.15.27:0/1512421631 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f6d68005b30 con 0x7f6d780a1040 2023-11-29T08:56:35.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:35.438+0000 7f6d66ffd640 1 -- 172.21.15.27:0/1512421631 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f6d68005dd0 con 0x7f6d780a1040 2023-11-29T08:56:35.440 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:35.438+0000 7f6d7ccf7640 1 -- 172.21.15.27:0/1512421631 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d7811bf30 con 0x7f6d780a1040 2023-11-29T08:56:35.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:35.438+0000 7f6d7ccf7640 1 -- 172.21.15.27:0/1512421631 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d7811f9b0 con 0x7f6d780a1040 2023-11-29T08:56:35.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:35.438+0000 7f6d66ffd640 1 -- 172.21.15.27:0/1512421631 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (crc 0 0 0) 0x7f6d680073b0 con 0x7f6d780a1040 2023-11-29T08:56:35.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:35.438+0000 7f6d66ffd640 1 -- 172.21.15.27:0/1512421631 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1207+0+0 (crc 0 0 0) 0x7f6d6800f750 con 0x7f6d780a1040 2023-11-29T08:56:35.441 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:35.439+0000 7f6d7ccf7640 1 -- 172.21.15.27:0/1512421631 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d78067c60 con 0x7f6d780a1040 2023-11-29T08:56:35.443 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:35.441+0000 7f6d66ffd640 1 -- 172.21.15.27:0/1512421631 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (crc 0 0 0) 0x7f6d6800f230 con 0x7f6d780a1040 2023-11-29T08:56:35.462 INFO:tasks.ceph.mgr.x.smithi139.stderr:2023-11-29T08:56:35.461+0000 7ff9da81bf00 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-29T08:56:35.507 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:35.505+0000 7f6d7ccf7640 1 -- 172.21.15.27:0/1512421631 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6d7811c120 con 0x7f6d780a1040 2023-11-29T08:56:35.508 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:35.506+0000 7f6d66ffd640 1 -- 172.21.15.27:0/1512421631 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v7) v1 ==== 74+0+4151 (crc 0 0 0) 0x7f6d6800f480 con 0x7f6d780a1040 2023-11-29T08:56:35.508 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:56:35.508 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":7,"fsid":"ae0bf9e4-fe2e-415c-890c-a9a3fac76480","created":"2023-11-29T08:56:32.841290+0000","modified":"2023-11-29T08:56:35.001193+0000","last_up_change":"0.000000","last_in_change":"2023-11-29T08:56:35.001193+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"c3a4fc31-c7e4-4b1e-b91a-00c2ee6a3d17","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"af3af16a-a1a1-44c4-bff0-ae118c84e89b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"785f8fdd-8dc3-49b7-b1f9-97d50c7c5b2e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b6f10cdd-088d-4969-858e-ba29f1b77cd0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T08:56:35.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:35.507+0000 7f6d7ccf7640 1 -- 172.21.15.27:0/1512421631 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d780a1040 msgr2=0x7f6d7811c2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:35.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:35.507+0000 7f6d7ccf7640 1 --2- 172.21.15.27:0/1512421631 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d780a1040 0x7f6d7811c2d0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:35.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:35.507+0000 7f6d7ccf7640 1 -- 172.21.15.27:0/1512421631 shutdown_connections 2023-11-29T08:56:35.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:35.507+0000 7f6d7ccf7640 1 --2- 172.21.15.27:0/1512421631 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d780a1040 0x7f6d7811c2d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:35.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:35.507+0000 7f6d7ccf7640 1 -- 172.21.15.27:0/1512421631 >> 172.21.15.27:0/1512421631 conn(0x7f6d7806c9c0 msgr2=0x7f6d7809e190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T08:56:35.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:35.507+0000 7f6d7ccf7640 1 -- 172.21.15.27:0/1512421631 shutdown_connections 2023-11-29T08:56:35.509 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:35.507+0000 7f6d7ccf7640 1 -- 172.21.15.27:0/1512421631 wait complete. 2023-11-29T08:56:35.514 INFO:tasks.ceph.mgr.x.smithi139.stderr:2023-11-29T08:56:35.513+0000 7ff9da81bf00 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-29T08:56:35.522 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-11-29T08:56:35.522 INFO:tasks.ceph:Waiting for OSDs to come up 2023-11-29T08:56:35.679 INFO:tasks.ceph.mgr.x.smithi139.stderr:2023-11-29T08:56:35.678+0000 7ff9da81bf00 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-29T08:56:35.925 DEBUG:teuthology.orchestra.run.smithi027:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-29T08:56:36.026 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:36.021+0000 7ff01f66d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:56:36.027 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:36.025+0000 7ff01f66d640 1 Processor -- start 2023-11-29T08:56:36.027 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:36.025+0000 7ff01f66d640 1 -- start start 2023-11-29T08:56:36.028 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:36.026+0000 7ff01f66d640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff0180a0a40 0x7ff018138a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:36.028 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:36.026+0000 7ff01f66d640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff01809d400 con 0x7ff01809ff20 2023-11-29T08:56:36.028 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:36.026+0000 7ff01f66d640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0180a0e50 con 0x7ff0180a0a40 2023-11-29T08:56:36.028 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:36.026+0000 7ff01cc08640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff0180a0a40 0x7ff018138a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:56:36.028 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:36.026+0000 7ff01d409640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7ff01809ff20 0x7ff0180a0330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:53988/0 (socket says 172.21.15.27:53988) 2023-11-29T08:56:36.028 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:36.026+0000 7ff01d409640 1 -- 172.21.15.27:0/835328736 learned_addr learned my addr 172.21.15.27:0/835328736 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-11-29T08:56:36.030 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:36.027+0000 7ff01cc08640 1 -- 172.21.15.27:0/835328736 >> v1:172.21.15.27:6789/0 conn(0x7ff01809ff20 legacy=0x7ff0180a0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:36.030 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:36.027+0000 7ff01cc08640 1 -- 172.21.15.27:0/835328736 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff01809f6f0 con 0x7ff0180a0a40 2023-11-29T08:56:36.030 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:36.027+0000 7ff01cc08640 1 --2- 172.21.15.27:0/835328736 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff0180a0a40 0x7ff018138a10 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1a188a741a29e70 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:36.030 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:36.027+0000 7ff00ffff640 1 -- 172.21.15.27:0/835328736 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7ff008009ce0 con 0x7ff0180a0a40 2023-11-29T08:56:36.030 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:36.027+0000 7ff00ffff640 1 -- 172.21.15.27:0/835328736 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7ff008009e40 con 0x7ff0180a0a40 2023-11-29T08:56:36.030 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:36.027+0000 7ff00ffff640 1 -- 172.21.15.27:0/835328736 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7ff00800e360 con 0x7ff0180a0a40 2023-11-29T08:56:36.030 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:36.028+0000 7ff01f66d640 1 -- 172.21.15.27:0/835328736 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff0180a0a40 msgr2=0x7ff018138a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:36.030 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:36.028+0000 7ff01f66d640 1 --2- 172.21.15.27:0/835328736 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff0180a0a40 0x7ff018138a10 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:36.030 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:36.028+0000 7ff01f66d640 1 -- 172.21.15.27:0/835328736 shutdown_connections 2023-11-29T08:56:36.030 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:36.028+0000 7ff01f66d640 1 --2- 172.21.15.27:0/835328736 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff0180a0a40 0x7ff018138a10 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:36.031 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:36.028+0000 7ff01f66d640 1 -- 172.21.15.27:0/835328736 >> 172.21.15.27:0/835328736 conn(0x7ff0180a2280 msgr2=0x7ff0180a2690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T08:56:36.031 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:36.028+0000 7ff01f66d640 1 -- 172.21.15.27:0/835328736 shutdown_connections 2023-11-29T08:56:36.031 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:36.028+0000 7ff01f66d640 1 -- 172.21.15.27:0/835328736 wait complete. 2023-11-29T08:56:36.031 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:36.028+0000 7ff01f66d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:56:36.032 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:36.029+0000 7ff01f66d640 1 Processor -- start 2023-11-29T08:56:36.032 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:36.029+0000 7ff01f66d640 1 -- start start 2023-11-29T08:56:36.033 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:36.030+0000 7ff01f66d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff01809ff20 0x7ff0181a8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:36.033 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:36.030+0000 7ff01f66d640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0181abfb0 con 0x7ff01809ff20 2023-11-29T08:56:36.033 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:36.030+0000 7ff01d409640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff01809ff20 0x7ff0181a8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:56:36.033 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:36.030+0000 7ff01d409640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff01809ff20 0x7ff0181a8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:49394/0 (socket says 172.21.15.27:49394) 2023-11-29T08:56:36.033 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:36.030+0000 7ff01d409640 1 -- 172.21.15.27:0/4136103423 learned_addr learned my addr 172.21.15.27:0/4136103423 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-11-29T08:56:36.033 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:36.030+0000 7ff01d409640 1 -- 172.21.15.27:0/4136103423 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0181a92d0 con 0x7ff01809ff20 2023-11-29T08:56:36.033 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:36.030+0000 7ff01d409640 1 --2- 172.21.15.27:0/4136103423 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff01809ff20 0x7ff0181a8140 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:36.033 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:36.031+0000 7ff00dffb640 1 -- 172.21.15.27:0/4136103423 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7ff0140059d0 con 0x7ff01809ff20 2023-11-29T08:56:36.033 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:36.031+0000 7ff00dffb640 1 -- 172.21.15.27:0/4136103423 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7ff014005b30 con 0x7ff01809ff20 2023-11-29T08:56:36.033 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:36.031+0000 7ff01f66d640 1 -- 172.21.15.27:0/4136103423 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0181a9cd0 con 0x7ff01809ff20 2023-11-29T08:56:36.033 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:36.031+0000 7ff00dffb640 1 -- 172.21.15.27:0/4136103423 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7ff014005dd0 con 0x7ff01809ff20 2023-11-29T08:56:36.033 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:36.031+0000 7ff00dffb640 1 -- 172.21.15.27:0/4136103423 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (crc 0 0 0) 0x7ff0140073b0 con 0x7ff01809ff20 2023-11-29T08:56:36.033 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:36.031+0000 7ff01f66d640 1 -- 172.21.15.27:0/4136103423 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0181ab750 con 0x7ff01809ff20 2023-11-29T08:56:36.034 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:36.031+0000 7ff00dffb640 1 -- 172.21.15.27:0/4136103423 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1207+0+0 (crc 0 0 0) 0x7ff014007660 con 0x7ff01809ff20 2023-11-29T08:56:36.034 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:36.032+0000 7ff01f66d640 1 -- 172.21.15.27:0/4136103423 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0181a9520 con 0x7ff01809ff20 2023-11-29T08:56:36.035 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:36.034+0000 7ff00dffb640 1 -- 172.21.15.27:0/4136103423 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (crc 0 0 0) 0x7ff01809d400 con 0x7ff01809ff20 2023-11-29T08:56:36.098 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:36.096+0000 7ff01f66d640 1 -- 172.21.15.27:0/4136103423 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff018062350 con 0x7ff01809ff20 2023-11-29T08:56:36.098 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:36.097+0000 7ff00dffb640 1 -- 172.21.15.27:0/4136103423 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v7) v1 ==== 74+0+4151 (crc 0 0 0) 0x7ff01400caf0 con 0x7ff01809ff20 2023-11-29T08:56:36.098 INFO:teuthology.misc.health.smithi027.stdout: 2023-11-29T08:56:36.098 INFO:teuthology.misc.health.smithi027.stdout:{"epoch":7,"fsid":"ae0bf9e4-fe2e-415c-890c-a9a3fac76480","created":"2023-11-29T08:56:32.841290+0000","modified":"2023-11-29T08:56:35.001193+0000","last_up_change":"0.000000","last_in_change":"2023-11-29T08:56:35.001193+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"c3a4fc31-c7e4-4b1e-b91a-00c2ee6a3d17","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"af3af16a-a1a1-44c4-bff0-ae118c84e89b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"785f8fdd-8dc3-49b7-b1f9-97d50c7c5b2e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b6f10cdd-088d-4969-858e-ba29f1b77cd0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T08:56:36.099 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:36.098+0000 7ff01f66d640 1 -- 172.21.15.27:0/4136103423 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff01809ff20 msgr2=0x7ff0181a8140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:36.099 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:36.098+0000 7ff01f66d640 1 --2- 172.21.15.27:0/4136103423 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff01809ff20 0x7ff0181a8140 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:36.099 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:36.098+0000 7ff01f66d640 1 -- 172.21.15.27:0/4136103423 shutdown_connections 2023-11-29T08:56:36.100 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:36.098+0000 7ff01f66d640 1 --2- 172.21.15.27:0/4136103423 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff01809ff20 0x7ff0181a8140 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:36.100 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:36.098+0000 7ff01f66d640 1 -- 172.21.15.27:0/4136103423 >> 172.21.15.27:0/4136103423 conn(0x7ff0180a2280 msgr2=0x7ff01809a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T08:56:36.100 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:36.098+0000 7ff01f66d640 1 -- 172.21.15.27:0/4136103423 shutdown_connections 2023-11-29T08:56:36.100 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:36.098+0000 7ff01f66d640 1 -- 172.21.15.27:0/4136103423 wait complete. 2023-11-29T08:56:36.108 DEBUG:teuthology.misc:0 of 4 OSDs are up 2023-11-29T08:56:36.567 INFO:tasks.ceph.mgr.x.smithi139.stderr:2023-11-29T08:56:36.566+0000 7ff9da81bf00 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-29T08:56:36.842 INFO:tasks.ceph.mgr.x.smithi139.stderr:2023-11-29T08:56:36.841+0000 7ff9da81bf00 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-29T08:56:36.896 INFO:tasks.ceph.mgr.x.smithi139.stderr:2023-11-29T08:56:36.895+0000 7ff9da81bf00 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-29T08:56:37.013 INFO:tasks.ceph.mgr.x.smithi139.stderr:2023-11-29T08:56:37.011+0000 7ff9da81bf00 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-29T08:56:38.039 INFO:tasks.ceph.mgr.x.smithi139.stderr:2023-11-29T08:56:38.037+0000 7ff97aa30640 -1 mgr.server handle_report got status from non-daemon mon.a 2023-11-29T08:56:42.512 DEBUG:teuthology.orchestra.run.smithi027:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-29T08:56:42.610 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:42.605+0000 7f193e91e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:56:42.610 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:42.609+0000 7f193e91e640 1 Processor -- start 2023-11-29T08:56:42.610 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:42.609+0000 7f193e91e640 1 -- start start 2023-11-29T08:56:42.611 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:42.610+0000 7f193e91e640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f193809ff20 0x7f19380a0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:42.611 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:42.610+0000 7f193e91e640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f193809d400 con 0x7f19380a0870 2023-11-29T08:56:42.612 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:42.610+0000 7f193e91e640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f193809f6f0 con 0x7f193809ff20 2023-11-29T08:56:42.612 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:42.610+0000 7f1937fff640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f193809ff20 0x7f19380a0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:56:42.612 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:42.610+0000 7f1937fff640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f193809ff20 0x7f19380a0330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40848/0 (socket says 172.21.15.27:40848) 2023-11-29T08:56:42.612 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:42.610+0000 7f1937fff640 1 -- 172.21.15.27:0/887339870 learned_addr learned my addr 172.21.15.27:0/887339870 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-11-29T08:56:42.612 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:42.610+0000 7f1937fff640 1 -- 172.21.15.27:0/887339870 >> v1:172.21.15.27:6789/0 conn(0x7f19380a0870 legacy=0x7f1938137a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:42.612 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:42.610+0000 7f1937fff640 1 -- 172.21.15.27:0/887339870 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19380a1380 con 0x7f193809ff20 2023-11-29T08:56:42.613 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:42.611+0000 7f1937fff640 1 --2- 172.21.15.27:0/887339870 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f193809ff20 0x7f19380a0330 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c49a1a89302320c1 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:42.787 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:42.785+0000 7f1936ffd640 1 -- 172.21.15.27:0/887339870 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f192c009dd0 con 0x7f193809ff20 2023-11-29T08:56:42.787 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:42.785+0000 7f1936ffd640 1 -- 172.21.15.27:0/887339870 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f192c00e230 con 0x7f193809ff20 2023-11-29T08:56:42.787 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:42.785+0000 7f1936ffd640 1 -- 172.21.15.27:0/887339870 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f192c00e4d0 con 0x7f193809ff20 2023-11-29T08:56:42.788 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:42.786+0000 7f193e91e640 1 -- 172.21.15.27:0/887339870 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f193809ff20 msgr2=0x7f19380a0330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:42.788 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:42.786+0000 7f193e91e640 1 --2- 172.21.15.27:0/887339870 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f193809ff20 0x7f19380a0330 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:42.788 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:42.786+0000 7f193e91e640 1 -- 172.21.15.27:0/887339870 shutdown_connections 2023-11-29T08:56:42.788 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:42.786+0000 7f193e91e640 1 --2- 172.21.15.27:0/887339870 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f193809ff20 0x7f19380a0330 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:42.788 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:42.786+0000 7f193e91e640 1 -- 172.21.15.27:0/887339870 >> 172.21.15.27:0/887339870 conn(0x7f19380a2280 msgr2=0x7f19380a2690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T08:56:42.788 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:42.786+0000 7f193e91e640 1 -- 172.21.15.27:0/887339870 shutdown_connections 2023-11-29T08:56:42.788 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:42.786+0000 7f193e91e640 1 -- 172.21.15.27:0/887339870 wait complete. 2023-11-29T08:56:42.789 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:42.786+0000 7f193e91e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:56:42.789 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:42.787+0000 7f193e91e640 1 Processor -- start 2023-11-29T08:56:42.789 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:42.787+0000 7f193e91e640 1 -- start start 2023-11-29T08:56:42.790 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:42.788+0000 7f193e91e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f193809ff20 0x7f19381c4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:42.791 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:42.788+0000 7f193e91e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19381aa5e0 con 0x7f193809ff20 2023-11-29T08:56:42.791 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:42.788+0000 7f1937fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f193809ff20 0x7f19381c4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:56:42.791 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:42.788+0000 7f1937fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f193809ff20 0x7f19381c4f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40854/0 (socket says 172.21.15.27:40854) 2023-11-29T08:56:42.791 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:42.788+0000 7f1937fff640 1 -- 172.21.15.27:0/3938950941 learned_addr learned my addr 172.21.15.27:0/3938950941 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-11-29T08:56:42.791 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:42.789+0000 7f1937fff640 1 -- 172.21.15.27:0/3938950941 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19381c4c20 con 0x7f193809ff20 2023-11-29T08:56:42.791 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:42.789+0000 7f1937fff640 1 --2- 172.21.15.27:0/3938950941 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f193809ff20 0x7f19381c4f30 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:42.791 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:42.789+0000 7f1934ff9640 1 -- 172.21.15.27:0/3938950941 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f192c014410 con 0x7f193809ff20 2023-11-29T08:56:42.791 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:42.789+0000 7f1934ff9640 1 -- 172.21.15.27:0/3938950941 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f192c014570 con 0x7f193809ff20 2023-11-29T08:56:42.791 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:42.789+0000 7f193e91e640 1 -- 172.21.15.27:0/3938950941 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19381ac100 con 0x7f193809ff20 2023-11-29T08:56:42.791 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:42.789+0000 7f1934ff9640 1 -- 172.21.15.27:0/3938950941 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f192c014810 con 0x7f193809ff20 2023-11-29T08:56:42.791 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:42.789+0000 7f193e91e640 1 -- 172.21.15.27:0/3938950941 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19381ab690 con 0x7f193809ff20 2023-11-29T08:56:42.792 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:42.790+0000 7f1934ff9640 1 -- 172.21.15.27:0/3938950941 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 44800+0+0 (crc 0 0 0) 0x7f192c0149c0 con 0x7f193809ff20 2023-11-29T08:56:42.792 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:42.790+0000 7f1934ff9640 1 --2- 172.21.15.27:0/3938950941 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f1924037780 0x7f1924039c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:42.792 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:42.790+0000 7f1934ff9640 1 -- 172.21.15.27:0/3938950941 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 2319+0+0 (crc 0 0 0) 0x7f192c019040 con 0x7f193809ff20 2023-11-29T08:56:42.792 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:42.790+0000 7f19377fe640 1 --2- 172.21.15.27:0/3938950941 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f1924037780 0x7f1924039c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:56:42.792 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:42.790+0000 7f193e91e640 1 -- 172.21.15.27:0/3938950941 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f193809e630 con 0x7f193809ff20 2023-11-29T08:56:42.793 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:42.791+0000 7f19377fe640 1 --2- 172.21.15.27:0/3938950941 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f1924037780 0x7f1924039c90 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:42.799 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:42.797+0000 7f1934ff9640 1 -- 172.21.15.27:0/3938950941 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (crc 0 0 0) 0x7f192c019a80 con 0x7f193809ff20 2023-11-29T08:56:42.979 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:42.977+0000 7f193e91e640 1 -- 172.21.15.27:0/3938950941 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1938062350 con 0x7f193809ff20 2023-11-29T08:56:42.979 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:42.978+0000 7f1934ff9640 1 -- 172.21.15.27:0/3938950941 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) v1 ==== 74+0+6897 (crc 0 0 0) 0x7f192c019670 con 0x7f193809ff20 2023-11-29T08:56:42.979 INFO:teuthology.misc.health.smithi027.stdout: 2023-11-29T08:56:42.979 INFO:teuthology.misc.health.smithi027.stdout:{"epoch":11,"fsid":"ae0bf9e4-fe2e-415c-890c-a9a3fac76480","created":"2023-11-29T08:56:32.841290+0000","modified":"2023-11-29T08:56:42.143185+0000","last_up_change":"2023-11-29T08:56:39.083412+0000","last_in_change":"2023-11-29T08:56:35.001193+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-29T08:56:41.091847+0000","flags":294945,"flags_names":"hashpspool,nopgchange,creating,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c3a4fc31-c7e4-4b1e-b91a-00c2ee6a3d17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":601592489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6801","nonce":601592489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":601592489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6805","nonce":601592489}]},"public_addr":"172.21.15.27:6800/601592489","cluster_addr":"172.21.15.27:6801/601592489","heartbeat_back_addr":"172.21.15.27:6804/601592489","heartbeat_front_addr":"172.21.15.27:6805/601592489","state":["exists","up"]},{"osd":1,"uuid":"af3af16a-a1a1-44c4-bff0-ae118c84e89b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":441902163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6803","nonce":441902163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":441902163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6807","nonce":441902163}]},"public_addr":"172.21.15.27:6802/441902163","cluster_addr":"172.21.15.27:6803/441902163","heartbeat_back_addr":"172.21.15.27:6806/441902163","heartbeat_front_addr":"172.21.15.27:6807/441902163","state":["exists","up"]},{"osd":2,"uuid":"785f8fdd-8dc3-49b7-b1f9-97d50c7c5b2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6803","nonce":3090700196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":3090700196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":3090700196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6807","nonce":3090700196}]},"public_addr":"172.21.15.139:6803/3090700196","cluster_addr":"172.21.15.139:6802/3090700196","heartbeat_back_addr":"172.21.15.139:6806/3090700196","heartbeat_front_addr":"172.21.15.139:6807/3090700196","state":["exists","up"]},{"osd":3,"uuid":"b6f10cdd-088d-4969-858e-ba29f1b77cd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6805","nonce":1054546365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":1054546365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":1054546365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6809","nonce":1054546365}]},"public_addr":"172.21.15.139:6805/1054546365","cluster_addr":"172.21.15.139:6804/1054546365","heartbeat_back_addr":"172.21.15.139:6808/1054546365","heartbeat_front_addr":"172.21.15.139:6809/1054546365","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T08:56:42.982 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:42.980+0000 7f193e91e640 1 -- 172.21.15.27:0/3938950941 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f1924037780 msgr2=0x7f1924039c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:42.982 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:42.980+0000 7f193e91e640 1 --2- 172.21.15.27:0/3938950941 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f1924037780 0x7f1924039c90 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:42.982 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:42.980+0000 7f193e91e640 1 -- 172.21.15.27:0/3938950941 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f193809ff20 msgr2=0x7f19381c4f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:42.982 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:42.980+0000 7f193e91e640 1 --2- 172.21.15.27:0/3938950941 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f193809ff20 0x7f19381c4f30 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:42.982 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:42.980+0000 7f193e91e640 1 -- 172.21.15.27:0/3938950941 shutdown_connections 2023-11-29T08:56:42.982 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:42.980+0000 7f193e91e640 1 --2- 172.21.15.27:0/3938950941 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f1924037780 0x7f1924039c90 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:42.982 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:42.980+0000 7f193e91e640 1 --2- 172.21.15.27:0/3938950941 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f193809ff20 0x7f19381c4f30 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:42.982 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:42.980+0000 7f193e91e640 1 -- 172.21.15.27:0/3938950941 >> 172.21.15.27:0/3938950941 conn(0x7f19380a2280 msgr2=0x7f193809a160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T08:56:42.982 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:42.980+0000 7f193e91e640 1 -- 172.21.15.27:0/3938950941 shutdown_connections 2023-11-29T08:56:42.982 INFO:teuthology.misc.health.smithi027.stderr:2023-11-29T08:56:42.980+0000 7f193e91e640 1 -- 172.21.15.27:0/3938950941 wait complete. 2023-11-29T08:56:42.991 DEBUG:teuthology.misc:4 of 4 OSDs are up 2023-11-29T08:56:42.991 INFO:tasks.ceph:Creating RBD pool 2023-11-29T08:56:42.991 DEBUG:teuthology.orchestra.run.smithi027:> sudo ceph --cluster ceph osd pool create rbd 8 2023-11-29T08:56:43.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:43.094+0000 7f19acc2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:56:43.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:43.100+0000 7f19acc2d640 1 Processor -- start 2023-11-29T08:56:43.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:43.101+0000 7f19acc2d640 1 -- start start 2023-11-29T08:56:43.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:43.101+0000 7f19acc2d640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f19a806fa50 0x7f19a806fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:43.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:43.101+0000 7f19acc2d640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19a8071b40 con 0x7f19a80703a0 2023-11-29T08:56:43.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:43.101+0000 7f19acc2d640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19a8070d50 con 0x7f19a806fa50 2023-11-29T08:56:43.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:43.102+0000 7f19a659c640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f19a806fa50 0x7f19a806fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:56:43.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:43.102+0000 7f19a5d9b640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f19a80703a0 0x7f19a8135110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:54150/0 (socket says 172.21.15.27:54150) 2023-11-29T08:56:43.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:43.102+0000 7f19a5d9b640 1 -- 172.21.15.27:0/2290186769 learned_addr learned my addr 172.21.15.27:0/2290186769 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-11-29T08:56:43.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:43.102+0000 7f19a659c640 1 -- 172.21.15.27:0/2290186769 >> v1:172.21.15.27:6789/0 conn(0x7f19a80703a0 legacy=0x7f19a8135110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:43.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:43.102+0000 7f19a659c640 1 -- 172.21.15.27:0/2290186769 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a8071830 con 0x7f19a806fa50 2023-11-29T08:56:43.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:43.102+0000 7f19a659c640 1 --2- 172.21.15.27:0/2290186769 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f19a806fa50 0x7f19a806fe60 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7876b70c91fe12ec server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:43.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:43.102+0000 7f19a559a640 1 -- 172.21.15.27:0/2290186769 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f19a0009ce0 con 0x7f19a806fa50 2023-11-29T08:56:43.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:43.102+0000 7f19a559a640 1 -- 172.21.15.27:0/2290186769 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f19a0009e40 con 0x7f19a806fa50 2023-11-29T08:56:43.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:43.102+0000 7f19a559a640 1 -- 172.21.15.27:0/2290186769 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f19a000e360 con 0x7f19a806fa50 2023-11-29T08:56:43.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:43.103+0000 7f19acc2d640 1 -- 172.21.15.27:0/2290186769 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f19a806fa50 msgr2=0x7f19a806fe60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:43.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:43.103+0000 7f19acc2d640 1 --2- 172.21.15.27:0/2290186769 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f19a806fa50 0x7f19a806fe60 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:43.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:43.103+0000 7f19acc2d640 1 -- 172.21.15.27:0/2290186769 shutdown_connections 2023-11-29T08:56:43.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:43.103+0000 7f19acc2d640 1 --2- 172.21.15.27:0/2290186769 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f19a806fa50 0x7f19a806fe60 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:43.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:43.103+0000 7f19acc2d640 1 -- 172.21.15.27:0/2290186769 >> 172.21.15.27:0/2290186769 conn(0x7f19a809dff0 msgr2=0x7f19a809e400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T08:56:43.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:43.103+0000 7f19acc2d640 1 -- 172.21.15.27:0/2290186769 shutdown_connections 2023-11-29T08:56:43.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:43.103+0000 7f19acc2d640 1 -- 172.21.15.27:0/2290186769 wait complete. 2023-11-29T08:56:43.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:43.103+0000 7f19acc2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:56:43.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:43.104+0000 7f19acc2d640 1 Processor -- start 2023-11-29T08:56:43.106 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:43.104+0000 7f19acc2d640 1 -- start start 2023-11-29T08:56:43.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:43.105+0000 7f19acc2d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f19a806fa50 0x7f19a812ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:43.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:43.105+0000 7f19acc2d640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a8130f20 con 0x7f19a806fa50 2023-11-29T08:56:43.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:43.105+0000 7f19a659c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f19a806fa50 0x7f19a812ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:56:43.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:43.105+0000 7f19a659c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f19a806fa50 0x7f19a812ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40874/0 (socket says 172.21.15.27:40874) 2023-11-29T08:56:43.108 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:43.105+0000 7f19a659c640 1 -- 172.21.15.27:0/355169295 learned_addr learned my addr 172.21.15.27:0/355169295 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-11-29T08:56:43.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:43.105+0000 7f19a659c640 1 -- 172.21.15.27:0/355169295 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a812dfc0 con 0x7f19a806fa50 2023-11-29T08:56:43.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:43.105+0000 7f19a659c640 1 --2- 172.21.15.27:0/355169295 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f19a806fa50 0x7f19a812ce30 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:43.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:43.105+0000 7f199effd640 1 -- 172.21.15.27:0/355169295 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f19a0014410 con 0x7f19a806fa50 2023-11-29T08:56:43.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:43.105+0000 7f199effd640 1 -- 172.21.15.27:0/355169295 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f19a0014570 con 0x7f19a806fa50 2023-11-29T08:56:43.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:43.105+0000 7f19acc2d640 1 -- 172.21.15.27:0/355169295 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19a812e9c0 con 0x7f19a806fa50 2023-11-29T08:56:43.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:43.105+0000 7f199effd640 1 -- 172.21.15.27:0/355169295 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f19a0014810 con 0x7f19a806fa50 2023-11-29T08:56:43.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:43.106+0000 7f19acc2d640 1 -- 172.21.15.27:0/355169295 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19a812f960 con 0x7f19a806fa50 2023-11-29T08:56:43.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:43.106+0000 7f199effd640 1 -- 172.21.15.27:0/355169295 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 44800+0+0 (crc 0 0 0) 0x7f19a0014a10 con 0x7f19a806fa50 2023-11-29T08:56:43.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:43.106+0000 7f199effd640 1 --2- 172.21.15.27:0/355169295 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f1988037730 0x7f1988039c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:43.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:43.107+0000 7f199effd640 1 -- 172.21.15.27:0/355169295 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 2319+0+0 (crc 0 0 0) 0x7f19a0019040 con 0x7f19a806fa50 2023-11-29T08:56:43.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:43.106+0000 7f19acc2d640 1 -- 172.21.15.27:0/355169295 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19a812e1b0 con 0x7f19a806fa50 2023-11-29T08:56:43.109 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:43.107+0000 7f19a5d9b640 1 --2- 172.21.15.27:0/355169295 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f1988037730 0x7f1988039c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:56:43.110 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:43.107+0000 7f19a5d9b640 1 --2- 172.21.15.27:0/355169295 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f1988037730 0x7f1988039c40 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:43.113 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:43.111+0000 7f199effd640 1 -- 172.21.15.27:0/355169295 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (crc 0 0 0) 0x7f19a0018190 con 0x7f19a806fa50 2023-11-29T08:56:43.290 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:43.289+0000 7f19acc2d640 1 -- 172.21.15.27:0/355169295 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f19a8062350 con 0x7f19a806fa50 2023-11-29T08:56:43.886 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:43.885+0000 7f199effd640 1 -- 172.21.15.27:0/355169295 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mgrmap(e 5) v1 ==== 44856+0+0 (crc 0 0 0) 0x7f19a0014d10 con 0x7f19a806fa50 2023-11-29T08:56:44.154 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:44.152+0000 7f199effd640 1 -- 172.21.15.27:0/355169295 <== mon.0 v2:172.21.15.27:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v13) v1 ==== 109+0+0 (crc 0 0 0) 0x7f19a0010310 con 0x7f19a806fa50 2023-11-29T08:56:44.154 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'rbd' created 2023-11-29T08:56:44.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:44.155+0000 7f19acc2d640 1 -- 172.21.15.27:0/355169295 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f1988037730 msgr2=0x7f1988039c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:44.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:44.155+0000 7f19acc2d640 1 --2- 172.21.15.27:0/355169295 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f1988037730 0x7f1988039c40 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:44.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:44.155+0000 7f19acc2d640 1 -- 172.21.15.27:0/355169295 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f19a806fa50 msgr2=0x7f19a812ce30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:44.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:44.155+0000 7f19acc2d640 1 --2- 172.21.15.27:0/355169295 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f19a806fa50 0x7f19a812ce30 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:44.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:44.155+0000 7f19acc2d640 1 -- 172.21.15.27:0/355169295 shutdown_connections 2023-11-29T08:56:44.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:44.155+0000 7f19acc2d640 1 --2- 172.21.15.27:0/355169295 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f1988037730 0x7f1988039c40 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:44.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:44.155+0000 7f19acc2d640 1 --2- 172.21.15.27:0/355169295 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f19a806fa50 0x7f19a812ce30 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:44.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:44.155+0000 7f19acc2d640 1 -- 172.21.15.27:0/355169295 >> 172.21.15.27:0/355169295 conn(0x7f19a809dff0 msgr2=0x7f19a8126040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T08:56:44.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:44.155+0000 7f19acc2d640 1 -- 172.21.15.27:0/355169295 shutdown_connections 2023-11-29T08:56:44.157 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:44.155+0000 7f19acc2d640 1 -- 172.21.15.27:0/355169295 wait complete. 2023-11-29T08:56:44.171 DEBUG:teuthology.orchestra.run.smithi027:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-11-29T08:56:44.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:44.284+0000 7f7c97e6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:56:44.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:44.293+0000 7f7c97e6d640 1 Processor -- start 2023-11-29T08:56:44.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:44.293+0000 7f7c97e6d640 1 -- start start 2023-11-29T08:56:44.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:44.294+0000 7f7c97e6d640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f7c900a0bb0 0x7f7c900a0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:44.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:44.294+0000 7f7c97e6d640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c9009c730 con 0x7f7c90132fa0 2023-11-29T08:56:44.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:44.294+0000 7f7c97e6d640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c901309b0 con 0x7f7c900a0bb0 2023-11-29T08:56:44.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:44.294+0000 7f7c95c09640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f7c900a0bb0 0x7f7c900a0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:56:44.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:44.294+0000 7f7c95408640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f7c90132fa0 0x7f7c901333b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:54160/0 (socket says 172.21.15.27:54160) 2023-11-29T08:56:44.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:44.294+0000 7f7c95408640 1 -- 172.21.15.27:0/1165784623 learned_addr learned my addr 172.21.15.27:0/1165784623 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-11-29T08:56:44.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:44.295+0000 7f7c95c09640 1 -- 172.21.15.27:0/1165784623 >> v1:172.21.15.27:6789/0 conn(0x7f7c90132fa0 legacy=0x7f7c901333b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:44.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:44.295+0000 7f7c95c09640 1 -- 172.21.15.27:0/1165784623 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c9012faa0 con 0x7f7c900a0bb0 2023-11-29T08:56:44.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:44.295+0000 7f7c95c09640 1 --2- 172.21.15.27:0/1165784623 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c900a0bb0 0x7f7c900a0fc0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a90545230de99fae server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:44.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:44.295+0000 7f7c94c07640 1 -- 172.21.15.27:0/1165784623 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f7c88009ce0 con 0x7f7c900a0bb0 2023-11-29T08:56:44.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:44.295+0000 7f7c94c07640 1 -- 172.21.15.27:0/1165784623 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f7c88009e40 con 0x7f7c900a0bb0 2023-11-29T08:56:44.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:44.295+0000 7f7c94c07640 1 -- 172.21.15.27:0/1165784623 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f7c8800e360 con 0x7f7c900a0bb0 2023-11-29T08:56:44.299 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:44.296+0000 7f7c97e6d640 1 -- 172.21.15.27:0/1165784623 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c900a0bb0 msgr2=0x7f7c900a0fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:44.299 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:44.296+0000 7f7c97e6d640 1 --2- 172.21.15.27:0/1165784623 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c900a0bb0 0x7f7c900a0fc0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:44.299 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:44.296+0000 7f7c97e6d640 1 -- 172.21.15.27:0/1165784623 shutdown_connections 2023-11-29T08:56:44.299 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:44.296+0000 7f7c97e6d640 1 --2- 172.21.15.27:0/1165784623 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c900a0bb0 0x7f7c900a0fc0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:44.299 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:44.296+0000 7f7c97e6d640 1 -- 172.21.15.27:0/1165784623 >> 172.21.15.27:0/1165784623 conn(0x7f7c9006c9a0 msgr2=0x7f7c9006cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T08:56:44.299 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:44.296+0000 7f7c97e6d640 1 -- 172.21.15.27:0/1165784623 shutdown_connections 2023-11-29T08:56:44.299 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:44.296+0000 7f7c97e6d640 1 -- 172.21.15.27:0/1165784623 wait complete. 2023-11-29T08:56:44.299 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:44.296+0000 7f7c97e6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:56:44.299 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:44.297+0000 7f7c97e6d640 1 Processor -- start 2023-11-29T08:56:44.299 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:44.297+0000 7f7c97e6d640 1 -- start start 2023-11-29T08:56:44.301 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:44.298+0000 7f7c97e6d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c900a0bb0 0x7f7c901c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:44.301 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:44.298+0000 7f7c97e6d640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9011e0b0 con 0x7f7c900a0bb0 2023-11-29T08:56:44.301 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:44.298+0000 7f7c95c09640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c900a0bb0 0x7f7c901c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:56:44.301 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:44.298+0000 7f7c95c09640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c900a0bb0 0x7f7c901c8560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40888/0 (socket says 172.21.15.27:40888) 2023-11-29T08:56:44.302 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:44.298+0000 7f7c95c09640 1 -- 172.21.15.27:0/821827161 learned_addr learned my addr 172.21.15.27:0/821827161 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-11-29T08:56:44.302 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:44.298+0000 7f7c95c09640 1 -- 172.21.15.27:0/821827161 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c9011f0a0 con 0x7f7c900a0bb0 2023-11-29T08:56:44.302 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:44.298+0000 7f7c95c09640 1 --2- 172.21.15.27:0/821827161 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c900a0bb0 0x7f7c901c8560 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:44.302 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:44.298+0000 7f7c8e7fc640 1 -- 172.21.15.27:0/821827161 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f7c88014540 con 0x7f7c900a0bb0 2023-11-29T08:56:44.302 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:44.298+0000 7f7c8e7fc640 1 -- 172.21.15.27:0/821827161 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f7c880146a0 con 0x7f7c900a0bb0 2023-11-29T08:56:44.302 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:44.298+0000 7f7c97e6d640 1 -- 172.21.15.27:0/821827161 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c9011dda0 con 0x7f7c900a0bb0 2023-11-29T08:56:44.302 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:44.298+0000 7f7c8e7fc640 1 -- 172.21.15.27:0/821827161 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f7c88014940 con 0x7f7c900a0bb0 2023-11-29T08:56:44.302 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:44.298+0000 7f7c97e6d640 1 -- 172.21.15.27:0/821827161 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c901200c0 con 0x7f7c900a0bb0 2023-11-29T08:56:44.302 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:44.299+0000 7f7c8e7fc640 1 -- 172.21.15.27:0/821827161 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (crc 0 0 0) 0x7f7c88014af0 con 0x7f7c900a0bb0 2023-11-29T08:56:44.302 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:44.299+0000 7f7c97e6d640 1 -- 172.21.15.27:0/821827161 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c9011e750 con 0x7f7c900a0bb0 2023-11-29T08:56:44.302 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:44.299+0000 7f7c8e7fc640 1 --2- 172.21.15.27:0/821827161 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f7c7c037810 0x7f7c7c039d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:44.302 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:44.299+0000 7f7c8e7fc640 1 -- 172.21.15.27:0/821827161 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2661+0+0 (crc 0 0 0) 0x7f7c88019040 con 0x7f7c900a0bb0 2023-11-29T08:56:44.302 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:44.300+0000 7f7c95408640 1 --2- 172.21.15.27:0/821827161 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f7c7c037810 0x7f7c7c039d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:56:44.303 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:44.300+0000 7f7c95408640 1 --2- 172.21.15.27:0/821827161 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f7c7c037810 0x7f7c7c039d20 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:44.306 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:44.304+0000 7f7c8e7fc640 1 -- 172.21.15.27:0/821827161 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (crc 0 0 0) 0x7f7c88018190 con 0x7f7c900a0bb0 2023-11-29T08:56:44.483 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:44.481+0000 7f7c97e6d640 1 -- 172.21.15.27:0/821827161 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f7c90075080 con 0x7f7c900a0bb0 2023-11-29T08:56:45.163 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.161+0000 7f7c8e7fc640 1 -- 172.21.15.27:0/821827161 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v14) v1 ==== 173+0+0 (crc 0 0 0) 0x7f7c8800fa90 con 0x7f7c900a0bb0 2023-11-29T08:56:45.163 INFO:teuthology.orchestra.run.smithi027.stderr:enabled application 'rbd' on pool 'rbd' 2023-11-29T08:56:45.166 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.164+0000 7f7c97e6d640 1 -- 172.21.15.27:0/821827161 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f7c7c037810 msgr2=0x7f7c7c039d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:45.166 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.164+0000 7f7c97e6d640 1 --2- 172.21.15.27:0/821827161 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f7c7c037810 0x7f7c7c039d20 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:45.166 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.164+0000 7f7c97e6d640 1 -- 172.21.15.27:0/821827161 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c900a0bb0 msgr2=0x7f7c901c8560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:45.166 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.164+0000 7f7c97e6d640 1 --2- 172.21.15.27:0/821827161 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c900a0bb0 0x7f7c901c8560 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:45.166 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.164+0000 7f7c97e6d640 1 -- 172.21.15.27:0/821827161 shutdown_connections 2023-11-29T08:56:45.166 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.164+0000 7f7c97e6d640 1 --2- 172.21.15.27:0/821827161 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f7c7c037810 0x7f7c7c039d20 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:45.166 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.164+0000 7f7c97e6d640 1 --2- 172.21.15.27:0/821827161 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7c900a0bb0 0x7f7c901c8560 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:45.167 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.164+0000 7f7c97e6d640 1 -- 172.21.15.27:0/821827161 >> 172.21.15.27:0/821827161 conn(0x7f7c9006c9a0 msgr2=0x7f7c900a4960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T08:56:45.167 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.164+0000 7f7c97e6d640 1 -- 172.21.15.27:0/821827161 shutdown_connections 2023-11-29T08:56:45.167 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.164+0000 7f7c97e6d640 1 -- 172.21.15.27:0/821827161 wait complete. 2023-11-29T08:56:45.180 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-11-29T08:56:45.180 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-11-29T08:56:45.180 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-11-29T08:56:45.180 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-11-29T08:56:45.181 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-11-29T08:56:45.304 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.300+0000 7f737f99e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:56:45.305 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.304+0000 7f737f99e640 1 Processor -- start 2023-11-29T08:56:45.305 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.304+0000 7f737f99e640 1 -- start start 2023-11-29T08:56:45.307 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.304+0000 7f737f99e640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f7378097960 0x7f737812f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:45.307 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.304+0000 7f737f99e640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7378098960 con 0x7f7378097d70 2023-11-29T08:56:45.307 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.304+0000 7f737f99e640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f737809a2a0 con 0x7f7378097960 2023-11-29T08:56:45.307 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.305+0000 7f737d73a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f7378097960 0x7f737812f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:56:45.307 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.305+0000 7f737cf39640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f7378097d70 0x7f737812f780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:54164/0 (socket says 172.21.15.27:54164) 2023-11-29T08:56:45.307 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.305+0000 7f737cf39640 1 -- 172.21.15.27:0/8077542 learned_addr learned my addr 172.21.15.27:0/8077542 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-11-29T08:56:45.307 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.305+0000 7f737d73a640 1 -- 172.21.15.27:0/8077542 >> v1:172.21.15.27:6789/0 conn(0x7f7378097d70 legacy=0x7f737812f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:45.307 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.305+0000 7f737d73a640 1 -- 172.21.15.27:0/8077542 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7378072800 con 0x7f7378097960 2023-11-29T08:56:45.308 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.305+0000 7f737d73a640 1 --2- 172.21.15.27:0/8077542 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7378097960 0x7f737812f240 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb74307c246886f6 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:45.308 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.305+0000 7f736ffff640 1 -- 172.21.15.27:0/8077542 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f737400ac70 con 0x7f7378097960 2023-11-29T08:56:45.308 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.305+0000 7f736ffff640 1 -- 172.21.15.27:0/8077542 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f737400add0 con 0x7f7378097960 2023-11-29T08:56:45.308 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.305+0000 7f736ffff640 1 -- 172.21.15.27:0/8077542 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f737400f470 con 0x7f7378097960 2023-11-29T08:56:45.309 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.306+0000 7f737f99e640 1 -- 172.21.15.27:0/8077542 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7378097960 msgr2=0x7f737812f240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:45.309 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.306+0000 7f737f99e640 1 --2- 172.21.15.27:0/8077542 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7378097960 0x7f737812f240 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:45.309 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.306+0000 7f737f99e640 1 -- 172.21.15.27:0/8077542 shutdown_connections 2023-11-29T08:56:45.309 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.306+0000 7f737f99e640 1 --2- 172.21.15.27:0/8077542 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7378097960 0x7f737812f240 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:45.309 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.306+0000 7f737f99e640 1 -- 172.21.15.27:0/8077542 >> 172.21.15.27:0/8077542 conn(0x7f737809dff0 msgr2=0x7f737809e400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T08:56:45.309 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.306+0000 7f737f99e640 1 -- 172.21.15.27:0/8077542 shutdown_connections 2023-11-29T08:56:45.309 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.306+0000 7f737f99e640 1 -- 172.21.15.27:0/8077542 wait complete. 2023-11-29T08:56:45.309 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.306+0000 7f737f99e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:56:45.309 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.307+0000 7f737f99e640 1 Processor -- start 2023-11-29T08:56:45.309 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.307+0000 7f737f99e640 1 -- start start 2023-11-29T08:56:45.311 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.308+0000 7f737f99e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7378097960 0x7f73781b8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:45.311 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.308+0000 7f737f99e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73781b9df0 con 0x7f7378097960 2023-11-29T08:56:45.312 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.308+0000 7f737d73a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7378097960 0x7f73781b8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:56:45.312 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.308+0000 7f737d73a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7378097960 0x7f73781b8180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40906/0 (socket says 172.21.15.27:40906) 2023-11-29T08:56:45.312 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.308+0000 7f737d73a640 1 -- 172.21.15.27:0/2991230469 learned_addr learned my addr 172.21.15.27:0/2991230469 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-11-29T08:56:45.312 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.308+0000 7f737d73a640 1 -- 172.21.15.27:0/2991230469 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73781b9510 con 0x7f7378097960 2023-11-29T08:56:45.312 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.308+0000 7f737d73a640 1 --2- 172.21.15.27:0/2991230469 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7378097960 0x7f73781b8180 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:45.312 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.308+0000 7f736dffb640 1 -- 172.21.15.27:0/2991230469 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f737400fe10 con 0x7f7378097960 2023-11-29T08:56:45.312 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.308+0000 7f736dffb640 1 -- 172.21.15.27:0/2991230469 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f7374012430 con 0x7f7378097960 2023-11-29T08:56:45.312 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.308+0000 7f737f99e640 1 -- 172.21.15.27:0/2991230469 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7378127440 con 0x7f7378097960 2023-11-29T08:56:45.312 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.308+0000 7f736dffb640 1 -- 172.21.15.27:0/2991230469 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f73740126d0 con 0x7f7378097960 2023-11-29T08:56:45.312 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.309+0000 7f737f99e640 1 -- 172.21.15.27:0/2991230469 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7378126a90 con 0x7f7378097960 2023-11-29T08:56:45.312 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.309+0000 7f736dffb640 1 -- 172.21.15.27:0/2991230469 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (crc 0 0 0) 0x7f7374012880 con 0x7f7378097960 2023-11-29T08:56:45.312 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.309+0000 7f736dffb640 1 --2- 172.21.15.27:0/2991230469 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f735c037810 0x7f735c039d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:45.312 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.309+0000 7f736dffb640 1 -- 172.21.15.27:0/2991230469 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2672+0+0 (crc 0 0 0) 0x7f7374018040 con 0x7f7378097960 2023-11-29T08:56:45.313 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.310+0000 7f737f99e640 1 -- 172.21.15.27:0/2991230469 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7378127220 con 0x7f7378097960 2023-11-29T08:56:45.313 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.310+0000 7f737cf39640 1 --2- 172.21.15.27:0/2991230469 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f735c037810 0x7f735c039d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:56:45.313 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.310+0000 7f737cf39640 1 --2- 172.21.15.27:0/2991230469 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f735c037810 0x7f735c039d20 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:45.316 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.314+0000 7f736dffb640 1 -- 172.21.15.27:0/2991230469 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (crc 0 0 0) 0x7f737400cad0 con 0x7f7378097960 2023-11-29T08:56:45.539 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.538+0000 7f737f99e640 1 -- 172.21.15.27:0/2991230469 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f73781b9c50 con 0x7f7378097960 2023-11-29T08:56:45.541 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.539+0000 7f736dffb640 1 -- 172.21.15.27:0/2991230469 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+86182 (crc 0 0 0) 0x7f73781b9c50 con 0x7f7378097960 2023-11-29T08:56:45.542 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:56:45.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.541+0000 7f737f99e640 1 -- 172.21.15.27:0/2991230469 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f735c037810 msgr2=0x7f735c039d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:45.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.541+0000 7f737f99e640 1 --2- 172.21.15.27:0/2991230469 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f735c037810 0x7f735c039d20 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:45.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.541+0000 7f737f99e640 1 -- 172.21.15.27:0/2991230469 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7378097960 msgr2=0x7f73781b8180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:45.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.541+0000 7f737f99e640 1 --2- 172.21.15.27:0/2991230469 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7378097960 0x7f73781b8180 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:45.544 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.541+0000 7f737f99e640 1 -- 172.21.15.27:0/2991230469 shutdown_connections 2023-11-29T08:56:45.544 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.541+0000 7f737f99e640 1 --2- 172.21.15.27:0/2991230469 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f735c037810 0x7f735c039d20 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:45.544 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.541+0000 7f737f99e640 1 --2- 172.21.15.27:0/2991230469 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7378097960 0x7f73781b8180 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:45.544 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.541+0000 7f737f99e640 1 -- 172.21.15.27:0/2991230469 >> 172.21.15.27:0/2991230469 conn(0x7f737809dff0 msgr2=0x7f737806df40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T08:56:45.544 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.541+0000 7f737f99e640 1 -- 172.21.15.27:0/2991230469 shutdown_connections 2023-11-29T08:56:45.544 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.541+0000 7f737f99e640 1 -- 172.21.15.27:0/2991230469 wait complete. 2023-11-29T08:56:45.553 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":5,"active_gid":4099,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":2461689012},{"type":"v1","addr":"172.21.15.139:6801","nonce":2461689012}]},"active_addr":"172.21.15.139:6801/2461689012","active_change":"2023-11-29T08:56:37.026305+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.139:0","nonce":1967201953}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.139:0","nonce":1385397058}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.139:0","nonce":2516083369}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.139:0","nonce":310207658}]}]} 2023-11-29T08:56:45.556 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-11-29T08:56:45.556 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-11-29T08:56:45.556 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T08:56:45.668 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.663+0000 7fe600c6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:56:45.668 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.667+0000 7fe600c6d640 1 Processor -- start 2023-11-29T08:56:45.668 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.667+0000 7fe600c6d640 1 -- start start 2023-11-29T08:56:45.670 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.667+0000 7fe600c6d640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fe5fc097d70 0x7fe5fc12f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:45.670 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.667+0000 7fe600c6d640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5fc098960 con 0x7fe5fc097960 2023-11-29T08:56:45.670 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.667+0000 7fe600c6d640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5fc09a2a0 con 0x7fe5fc097d70 2023-11-29T08:56:45.670 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.668+0000 7fe5f1d9b640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fe5fc097d70 0x7fe5fc12f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:56:45.670 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.668+0000 7fe5fa59c640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fe5fc097960 0x7fe5fc12f240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:54168/0 (socket says 172.21.15.27:54168) 2023-11-29T08:56:45.670 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.668+0000 7fe5fa59c640 1 -- 172.21.15.27:0/468022287 learned_addr learned my addr 172.21.15.27:0/468022287 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-11-29T08:56:45.670 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.668+0000 7fe5f1d9b640 1 -- 172.21.15.27:0/468022287 >> v1:172.21.15.27:6789/0 conn(0x7fe5fc097960 legacy=0x7fe5fc12f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:45.670 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.668+0000 7fe5f1d9b640 1 -- 172.21.15.27:0/468022287 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5fc072800 con 0x7fe5fc097d70 2023-11-29T08:56:45.670 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.668+0000 7fe5f1d9b640 1 --2- 172.21.15.27:0/468022287 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe5fc097d70 0x7fe5fc12f950 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf32b0b2b5157e0e server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:45.671 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.668+0000 7fe5f9d9b640 1 -- 172.21.15.27:0/468022287 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fe5e4009ce0 con 0x7fe5fc097d70 2023-11-29T08:56:45.671 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.668+0000 7fe5f9d9b640 1 -- 172.21.15.27:0/468022287 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fe5e4009e40 con 0x7fe5fc097d70 2023-11-29T08:56:45.671 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.668+0000 7fe5f9d9b640 1 -- 172.21.15.27:0/468022287 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fe5e400e360 con 0x7fe5fc097d70 2023-11-29T08:56:45.672 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.669+0000 7fe600c6d640 1 -- 172.21.15.27:0/468022287 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe5fc097d70 msgr2=0x7fe5fc12f950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:45.672 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.669+0000 7fe600c6d640 1 --2- 172.21.15.27:0/468022287 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe5fc097d70 0x7fe5fc12f950 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:45.672 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.669+0000 7fe600c6d640 1 -- 172.21.15.27:0/468022287 shutdown_connections 2023-11-29T08:56:45.672 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.669+0000 7fe600c6d640 1 --2- 172.21.15.27:0/468022287 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe5fc097d70 0x7fe5fc12f950 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:45.672 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.669+0000 7fe600c6d640 1 -- 172.21.15.27:0/468022287 >> 172.21.15.27:0/468022287 conn(0x7fe5fc09dff0 msgr2=0x7fe5fc09e400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T08:56:45.672 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.669+0000 7fe600c6d640 1 -- 172.21.15.27:0/468022287 shutdown_connections 2023-11-29T08:56:45.672 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.669+0000 7fe600c6d640 1 -- 172.21.15.27:0/468022287 wait complete. 2023-11-29T08:56:45.673 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.669+0000 7fe600c6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:56:45.673 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.670+0000 7fe600c6d640 1 Processor -- start 2023-11-29T08:56:45.673 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.670+0000 7fe600c6d640 1 -- start start 2023-11-29T08:56:45.675 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.671+0000 7fe600c6d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe5fc097960 0x7fe5fc126040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:45.675 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.671+0000 7fe600c6d640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5fc12cd60 con 0x7fe5fc097960 2023-11-29T08:56:45.675 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.671+0000 7fe5fa59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe5fc097960 0x7fe5fc126040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:56:45.675 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.671+0000 7fe5fa59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe5fc097960 0x7fe5fc126040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40918/0 (socket says 172.21.15.27:40918) 2023-11-29T08:56:45.675 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.671+0000 7fe5fa59c640 1 -- 172.21.15.27:0/2593056430 learned_addr learned my addr 172.21.15.27:0/2593056430 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-11-29T08:56:45.675 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.671+0000 7fe5fa59c640 1 -- 172.21.15.27:0/2593056430 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5fc12c9a0 con 0x7fe5fc097960 2023-11-29T08:56:45.675 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.671+0000 7fe5fa59c640 1 --2- 172.21.15.27:0/2593056430 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe5fc097960 0x7fe5fc126040 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:45.675 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.671+0000 7fe5f37fe640 1 -- 172.21.15.27:0/2593056430 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fe5ec0058a0 con 0x7fe5fc097960 2023-11-29T08:56:45.675 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.672+0000 7fe5f37fe640 1 -- 172.21.15.27:0/2593056430 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fe5ec005a00 con 0x7fe5fc097960 2023-11-29T08:56:45.676 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.672+0000 7fe600c6d640 1 -- 172.21.15.27:0/2593056430 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5fc127aa0 con 0x7fe5fc097960 2023-11-29T08:56:45.676 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.672+0000 7fe5f37fe640 1 -- 172.21.15.27:0/2593056430 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fe5ec005ca0 con 0x7fe5fc097960 2023-11-29T08:56:45.676 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.672+0000 7fe600c6d640 1 -- 172.21.15.27:0/2593056430 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5fc12e150 con 0x7fe5fc097960 2023-11-29T08:56:45.676 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.672+0000 7fe5f37fe640 1 -- 172.21.15.27:0/2593056430 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (crc 0 0 0) 0x7fe5ec0070b0 con 0x7fe5fc097960 2023-11-29T08:56:45.676 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.673+0000 7fe600c6d640 1 -- 172.21.15.27:0/2593056430 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5fc0a09a0 con 0x7fe5fc097960 2023-11-29T08:56:45.676 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.673+0000 7fe5f37fe640 1 --2- 172.21.15.27:0/2593056430 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7fe5dc0377c0 0x7fe5dc039cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:45.676 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.673+0000 7fe5f37fe640 1 -- 172.21.15.27:0/2593056430 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2672+0+0 (crc 0 0 0) 0x7fe5ec046c20 con 0x7fe5fc097960 2023-11-29T08:56:45.676 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.673+0000 7fe5f1d9b640 1 --2- 172.21.15.27:0/2593056430 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7fe5dc0377c0 0x7fe5dc039cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:56:45.676 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.674+0000 7fe5f1d9b640 1 --2- 172.21.15.27:0/2593056430 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7fe5dc0377c0 0x7fe5dc039cd0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:45.679 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.677+0000 7fe5f37fe640 1 -- 172.21.15.27:0/2593056430 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (crc 0 0 0) 0x7fe5ec00d980 con 0x7fe5fc097960 2023-11-29T08:56:45.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.860+0000 7fe600c6d640 1 -- 172.21.15.27:0/2593056430 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe5fc062350 con 0x7fe5fc097960 2023-11-29T08:56:45.862 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.861+0000 7fe5f37fe640 1 -- 172.21.15.27:0/2593056430 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+8656 (crc 0 0 0) 0x7fe5ec00d570 con 0x7fe5fc097960 2023-11-29T08:56:45.862 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:56:45.863 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":14,"fsid":"ae0bf9e4-fe2e-415c-890c-a9a3fac76480","created":"2023-11-29T08:56:32.841290+0000","modified":"2023-11-29T08:56:45.162196+0000","last_up_change":"2023-11-29T08:56:39.083412+0000","last_in_change":"2023-11-29T08:56:35.001193+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-29T08:56:41.091847+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-29T08:56:43.320614+0000","flags":294945,"flags_names":"hashpspool,nopgchange,creating,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c3a4fc31-c7e4-4b1e-b91a-00c2ee6a3d17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":601592489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6801","nonce":601592489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":601592489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6805","nonce":601592489}]},"public_addr":"172.21.15.27:6800/601592489","cluster_addr":"172.21.15.27:6801/601592489","heartbeat_back_addr":"172.21.15.27:6804/601592489","heartbeat_front_addr":"172.21.15.27:6805/601592489","state":["exists","up"]},{"osd":1,"uuid":"af3af16a-a1a1-44c4-bff0-ae118c84e89b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":441902163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6803","nonce":441902163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":441902163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6807","nonce":441902163}]},"public_addr":"172.21.15.27:6802/441902163","cluster_addr":"172.21.15.27:6803/441902163","heartbeat_back_addr":"172.21.15.27:6806/441902163","heartbeat_front_addr":"172.21.15.27:6807/441902163","state":["exists","up"]},{"osd":2,"uuid":"785f8fdd-8dc3-49b7-b1f9-97d50c7c5b2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6803","nonce":3090700196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":3090700196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":3090700196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6807","nonce":3090700196}]},"public_addr":"172.21.15.139:6803/3090700196","cluster_addr":"172.21.15.139:6802/3090700196","heartbeat_back_addr":"172.21.15.139:6806/3090700196","heartbeat_front_addr":"172.21.15.139:6807/3090700196","state":["exists","up"]},{"osd":3,"uuid":"b6f10cdd-088d-4969-858e-ba29f1b77cd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6805","nonce":1054546365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":1054546365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":1054546365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6809","nonce":1054546365}]},"public_addr":"172.21.15.139:6805/1054546365","cluster_addr":"172.21.15.139:6804/1054546365","heartbeat_back_addr":"172.21.15.139:6808/1054546365","heartbeat_front_addr":"172.21.15.139:6809/1054546365","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T08:56:45.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.862+0000 7fe600c6d640 1 -- 172.21.15.27:0/2593056430 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7fe5dc0377c0 msgr2=0x7fe5dc039cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:45.864 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.862+0000 7fe600c6d640 1 --2- 172.21.15.27:0/2593056430 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7fe5dc0377c0 0x7fe5dc039cd0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:45.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.862+0000 7fe600c6d640 1 -- 172.21.15.27:0/2593056430 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe5fc097960 msgr2=0x7fe5fc126040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:45.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.862+0000 7fe600c6d640 1 --2- 172.21.15.27:0/2593056430 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe5fc097960 0x7fe5fc126040 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:45.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.863+0000 7fe600c6d640 1 -- 172.21.15.27:0/2593056430 shutdown_connections 2023-11-29T08:56:45.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.863+0000 7fe600c6d640 1 --2- 172.21.15.27:0/2593056430 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7fe5dc0377c0 0x7fe5dc039cd0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:45.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.863+0000 7fe600c6d640 1 --2- 172.21.15.27:0/2593056430 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe5fc097960 0x7fe5fc126040 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:45.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.863+0000 7fe600c6d640 1 -- 172.21.15.27:0/2593056430 >> 172.21.15.27:0/2593056430 conn(0x7fe5fc09dff0 msgr2=0x7fe5fc1b7260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T08:56:45.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.863+0000 7fe600c6d640 1 -- 172.21.15.27:0/2593056430 shutdown_connections 2023-11-29T08:56:45.865 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.863+0000 7fe600c6d640 1 -- 172.21.15.27:0/2593056430 wait complete. 2023-11-29T08:56:45.875 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-11-29T08:56:45.875 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T08:56:45.986 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.982+0000 7f9ddac6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:56:45.987 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.986+0000 7f9ddac6d640 1 Processor -- start 2023-11-29T08:56:45.987 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.986+0000 7f9ddac6d640 1 -- start start 2023-11-29T08:56:45.989 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.986+0000 7f9ddac6d640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f9dd40a0bb0 0x7f9dd4132f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:45.989 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.986+0000 7f9ddac6d640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dd409deb0 con 0x7f9dd40a0fc0 2023-11-29T08:56:45.989 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.986+0000 7f9ddac6d640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dd409d2b0 con 0x7f9dd40a0bb0 2023-11-29T08:56:45.989 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.986+0000 7f9dd8a09640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f9dd40a0bb0 0x7f9dd4132f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:56:45.989 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.986+0000 7f9dd3fff640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f9dd40a0fc0 0x7f9dd4133450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:54180/0 (socket says 172.21.15.27:54180) 2023-11-29T08:56:45.989 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.986+0000 7f9dd3fff640 1 -- 172.21.15.27:0/1129472346 learned_addr learned my addr 172.21.15.27:0/1129472346 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-11-29T08:56:45.989 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.987+0000 7f9dd8a09640 1 -- 172.21.15.27:0/1129472346 >> v1:172.21.15.27:6789/0 conn(0x7f9dd40a0fc0 legacy=0x7f9dd4133450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:45.989 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.987+0000 7f9dd8a09640 1 -- 172.21.15.27:0/1129472346 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd41302d0 con 0x7f9dd40a0bb0 2023-11-29T08:56:45.989 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.987+0000 7f9dd8a09640 1 --2- 172.21.15.27:0/1129472346 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9dd40a0bb0 0x7f9dd4132f10 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=749ef6790e14e9d8 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:45.989 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.987+0000 7f9dd37fe640 1 -- 172.21.15.27:0/1129472346 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f9dc8009ce0 con 0x7f9dd40a0bb0 2023-11-29T08:56:45.989 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.987+0000 7f9dd37fe640 1 -- 172.21.15.27:0/1129472346 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f9dc8009e40 con 0x7f9dd40a0bb0 2023-11-29T08:56:45.989 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.987+0000 7f9dd37fe640 1 -- 172.21.15.27:0/1129472346 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f9dc800e360 con 0x7f9dd40a0bb0 2023-11-29T08:56:45.991 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.988+0000 7f9ddac6d640 1 -- 172.21.15.27:0/1129472346 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9dd40a0bb0 msgr2=0x7f9dd4132f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:45.991 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.988+0000 7f9ddac6d640 1 --2- 172.21.15.27:0/1129472346 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9dd40a0bb0 0x7f9dd4132f10 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:45.991 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.988+0000 7f9ddac6d640 1 -- 172.21.15.27:0/1129472346 shutdown_connections 2023-11-29T08:56:45.991 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.988+0000 7f9ddac6d640 1 --2- 172.21.15.27:0/1129472346 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9dd40a0bb0 0x7f9dd4132f10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:45.991 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.988+0000 7f9ddac6d640 1 -- 172.21.15.27:0/1129472346 >> 172.21.15.27:0/1129472346 conn(0x7f9dd406c9a0 msgr2=0x7f9dd406cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T08:56:45.991 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.988+0000 7f9ddac6d640 1 -- 172.21.15.27:0/1129472346 shutdown_connections 2023-11-29T08:56:45.991 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.988+0000 7f9ddac6d640 1 -- 172.21.15.27:0/1129472346 wait complete. 2023-11-29T08:56:45.991 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.988+0000 7f9ddac6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:56:45.991 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.989+0000 7f9ddac6d640 1 Processor -- start 2023-11-29T08:56:45.991 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.989+0000 7f9ddac6d640 1 -- start start 2023-11-29T08:56:45.993 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.990+0000 7f9ddac6d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9dd40a0bb0 0x7f9dd411b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:45.993 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.990+0000 7f9ddac6d640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd411d3a0 con 0x7f9dd40a0bb0 2023-11-29T08:56:45.993 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.990+0000 7f9dd8a09640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9dd40a0bb0 0x7f9dd411b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:56:45.993 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.990+0000 7f9dd8a09640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9dd40a0bb0 0x7f9dd411b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40930/0 (socket says 172.21.15.27:40930) 2023-11-29T08:56:45.994 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.990+0000 7f9dd8a09640 1 -- 172.21.15.27:0/2478421037 learned_addr learned my addr 172.21.15.27:0/2478421037 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-11-29T08:56:45.994 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.990+0000 7f9dd8a09640 1 -- 172.21.15.27:0/2478421037 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd411f100 con 0x7f9dd40a0bb0 2023-11-29T08:56:45.994 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.990+0000 7f9dd8a09640 1 --2- 172.21.15.27:0/2478421037 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9dd40a0bb0 0x7f9dd411b7f0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:45.994 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.990+0000 7f9dd17fa640 1 -- 172.21.15.27:0/2478421037 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f9dc8014620 con 0x7f9dd40a0bb0 2023-11-29T08:56:45.994 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.990+0000 7f9dd17fa640 1 -- 172.21.15.27:0/2478421037 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f9dc8014780 con 0x7f9dd40a0bb0 2023-11-29T08:56:45.994 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.990+0000 7f9ddac6d640 1 -- 172.21.15.27:0/2478421037 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dd406a960 con 0x7f9dd40a0bb0 2023-11-29T08:56:45.994 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.990+0000 7f9dd17fa640 1 -- 172.21.15.27:0/2478421037 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f9dc8014a20 con 0x7f9dd40a0bb0 2023-11-29T08:56:45.994 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.990+0000 7f9ddac6d640 1 -- 172.21.15.27:0/2478421037 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dd411cfd0 con 0x7f9dd40a0bb0 2023-11-29T08:56:45.994 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.991+0000 7f9dd17fa640 1 -- 172.21.15.27:0/2478421037 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (crc 0 0 0) 0x7f9dc8014bd0 con 0x7f9dd40a0bb0 2023-11-29T08:56:45.994 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.991+0000 7f9dd17fa640 1 --2- 172.21.15.27:0/2478421037 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f9db8037810 0x7f9db8039d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:45.994 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.991+0000 7f9dd17fa640 1 -- 172.21.15.27:0/2478421037 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2672+0+0 (crc 0 0 0) 0x7f9dc8019040 con 0x7f9dd40a0bb0 2023-11-29T08:56:45.994 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.991+0000 7f9ddac6d640 1 -- 172.21.15.27:0/2478421037 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dd406a960 con 0x7f9dd40a0bb0 2023-11-29T08:56:45.994 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.992+0000 7f9dd3fff640 1 --2- 172.21.15.27:0/2478421037 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f9db8037810 0x7f9db8039d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:56:45.995 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.992+0000 7f9dd3fff640 1 --2- 172.21.15.27:0/2478421037 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f9db8037810 0x7f9db8039d20 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:45.998 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:45.996+0000 7f9dd17fa640 1 -- 172.21.15.27:0/2478421037 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (crc 0 0 0) 0x7f9dd406a960 con 0x7f9dd40a0bb0 2023-11-29T08:56:46.181 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.179+0000 7f9ddac6d640 1 -- 172.21.15.27:0/2478421037 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9dd406a960 con 0x7f9dd40a0bb0 2023-11-29T08:56:46.182 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.180+0000 7f9dd17fa640 1 -- 172.21.15.27:0/2478421037 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+8647 (crc 0 0 0) 0x7f9dd406a960 con 0x7f9dd40a0bb0 2023-11-29T08:56:46.182 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:56:46.182 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":15,"fsid":"ae0bf9e4-fe2e-415c-890c-a9a3fac76480","created":"2023-11-29T08:56:32.841290+0000","modified":"2023-11-29T08:56:46.171770+0000","last_up_change":"2023-11-29T08:56:39.083412+0000","last_in_change":"2023-11-29T08:56:35.001193+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-29T08:56:41.091847+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-29T08:56:43.320614+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c3a4fc31-c7e4-4b1e-b91a-00c2ee6a3d17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":601592489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6801","nonce":601592489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":601592489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6805","nonce":601592489}]},"public_addr":"172.21.15.27:6800/601592489","cluster_addr":"172.21.15.27:6801/601592489","heartbeat_back_addr":"172.21.15.27:6804/601592489","heartbeat_front_addr":"172.21.15.27:6805/601592489","state":["exists","up"]},{"osd":1,"uuid":"af3af16a-a1a1-44c4-bff0-ae118c84e89b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":441902163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6803","nonce":441902163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":441902163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6807","nonce":441902163}]},"public_addr":"172.21.15.27:6802/441902163","cluster_addr":"172.21.15.27:6803/441902163","heartbeat_back_addr":"172.21.15.27:6806/441902163","heartbeat_front_addr":"172.21.15.27:6807/441902163","state":["exists","up"]},{"osd":2,"uuid":"785f8fdd-8dc3-49b7-b1f9-97d50c7c5b2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6803","nonce":3090700196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":3090700196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":3090700196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6807","nonce":3090700196}]},"public_addr":"172.21.15.139:6803/3090700196","cluster_addr":"172.21.15.139:6802/3090700196","heartbeat_back_addr":"172.21.15.139:6806/3090700196","heartbeat_front_addr":"172.21.15.139:6807/3090700196","state":["exists","up"]},{"osd":3,"uuid":"b6f10cdd-088d-4969-858e-ba29f1b77cd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6805","nonce":1054546365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":1054546365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":1054546365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6809","nonce":1054546365}]},"public_addr":"172.21.15.139:6805/1054546365","cluster_addr":"172.21.15.139:6804/1054546365","heartbeat_back_addr":"172.21.15.139:6808/1054546365","heartbeat_front_addr":"172.21.15.139:6809/1054546365","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T08:56:46.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.182+0000 7f9ddac6d640 1 -- 172.21.15.27:0/2478421037 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f9db8037810 msgr2=0x7f9db8039d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:46.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.182+0000 7f9ddac6d640 1 --2- 172.21.15.27:0/2478421037 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f9db8037810 0x7f9db8039d20 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:46.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.182+0000 7f9ddac6d640 1 -- 172.21.15.27:0/2478421037 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9dd40a0bb0 msgr2=0x7f9dd411b7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:46.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.182+0000 7f9ddac6d640 1 --2- 172.21.15.27:0/2478421037 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9dd40a0bb0 0x7f9dd411b7f0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:46.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.182+0000 7f9ddac6d640 1 -- 172.21.15.27:0/2478421037 shutdown_connections 2023-11-29T08:56:46.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.182+0000 7f9ddac6d640 1 --2- 172.21.15.27:0/2478421037 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f9db8037810 0x7f9db8039d20 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:46.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.182+0000 7f9ddac6d640 1 --2- 172.21.15.27:0/2478421037 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9dd40a0bb0 0x7f9dd411b7f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:46.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.182+0000 7f9ddac6d640 1 -- 172.21.15.27:0/2478421037 >> 172.21.15.27:0/2478421037 conn(0x7f9dd406c9a0 msgr2=0x7f9dd41bb330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T08:56:46.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.182+0000 7f9ddac6d640 1 -- 172.21.15.27:0/2478421037 shutdown_connections 2023-11-29T08:56:46.184 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.182+0000 7f9ddac6d640 1 -- 172.21.15.27:0/2478421037 wait complete. 2023-11-29T08:56:46.194 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-11-29T08:56:46.195 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-11-29T08:56:46.195 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-11-29T08:56:46.196 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-11-29T08:56:46.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.313+0000 7fd0e5b5e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:56:46.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.313+0000 7fab1a06d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:56:46.319 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.313+0000 7f8ff1f9e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:56:46.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.313+0000 7f861ef9e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:56:46.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.318+0000 7fab1a06d640 1 Processor -- start 2023-11-29T08:56:46.320 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.318+0000 7f8ff1f9e640 1 Processor -- start 2023-11-29T08:56:46.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.318+0000 7f861ef9e640 1 Processor -- start 2023-11-29T08:56:46.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.318+0000 7fd0e5b5e640 1 Processor -- start 2023-11-29T08:56:46.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.318+0000 7fab1a06d640 1 -- start start 2023-11-29T08:56:46.321 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.318+0000 7f8ff1f9e640 1 -- start start 2023-11-29T08:56:46.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.318+0000 7f861ef9e640 1 -- start start 2023-11-29T08:56:46.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.318+0000 7fd0e5b5e640 1 -- start start 2023-11-29T08:56:46.322 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.319+0000 7fab1a06d640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fab14132d70 0x7fab14135190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:46.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.319+0000 7f8ff1f9e640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f8fec097d70 0x7f8fec12f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:46.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.319+0000 7fab1a06d640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab1409af50 con 0x7fab1412ff00 2023-11-29T08:56:46.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.319+0000 7fab1a06d640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab1412fa00 con 0x7fab14132d70 2023-11-29T08:56:46.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.319+0000 7f861ef9e640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f8618132d70 0x7f8618135190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:46.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.319+0000 7f861ef9e640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f861809af50 con 0x7f861812ff00 2023-11-29T08:56:46.323 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.319+0000 7f861ef9e640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f861812fa00 con 0x7f8618132d70 2023-11-29T08:56:46.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.319+0000 7f8ff1f9e640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fec098960 con 0x7f8fec097960 2023-11-29T08:56:46.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.319+0000 7f8ff1f9e640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fec09a2a0 con 0x7f8fec097d70 2023-11-29T08:56:46.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.319+0000 7fd0e5b5e640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd0e00a0bb0 0x7fd0e0132f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:46.324 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.319+0000 7f8feb7fe640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f8fec097960 0x7f8fec12f240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:54194/0 (socket says 172.21.15.27:54194) 2023-11-29T08:56:46.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.319+0000 7fab137fe640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fab1412ff00 0x7fab14130310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:54192/0 (socket says 172.21.15.27:54192) 2023-11-29T08:56:46.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.319+0000 7fab137fe640 1 -- 172.21.15.27:0/1832515994 learned_addr learned my addr 172.21.15.27:0/1832515994 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-11-29T08:56:46.325 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.319+0000 7f8feb7fe640 1 -- 172.21.15.27:0/3306162416 learned_addr learned my addr 172.21.15.27:0/3306162416 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-11-29T08:56:46.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.319+0000 7fd0e5b5e640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0e009deb0 con 0x7fd0e00a0fc0 2023-11-29T08:56:46.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.319+0000 7f861cd3a640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f861812ff00 0x7f8618130310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:54196/0 (socket says 172.21.15.27:54196) 2023-11-29T08:56:46.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.319+0000 7f861cd3a640 1 -- 172.21.15.27:0/1237003365 learned_addr learned my addr 172.21.15.27:0/1237003365 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-11-29T08:56:46.326 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.319+0000 7fd0e5b5e640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0e009d2b0 con 0x7fd0e00a0bb0 2023-11-29T08:56:46.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.319+0000 7fab12ffd640 1 --2- 172.21.15.27:0/1832515994 >> v2:172.21.15.27:3300/0 conn(0x7fab14132d70 0x7fab14135190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:56:46.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.319+0000 7f8617fff640 1 --2- 172.21.15.27:0/1237003365 >> v2:172.21.15.27:3300/0 conn(0x7f8618132d70 0x7f8618135190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:56:46.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.319+0000 7fd0df7fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd0e00a0bb0 0x7fd0e0132f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:56:46.327 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.319+0000 7fd0deffd640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fd0e00a0fc0 0x7fd0e0133450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:54220/0 (socket says 172.21.15.27:54220) 2023-11-29T08:56:46.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.319+0000 7f8feaffd640 1 --2- 172.21.15.27:0/3306162416 >> v2:172.21.15.27:3300/0 conn(0x7f8fec097d70 0x7f8fec12f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:56:46.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.319+0000 7fd0deffd640 1 -- 172.21.15.27:0/314089771 learned_addr learned my addr 172.21.15.27:0/314089771 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-11-29T08:56:46.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.320+0000 7f8feaffd640 1 -- 172.21.15.27:0/3306162416 >> v1:172.21.15.27:6789/0 conn(0x7f8fec097960 legacy=0x7f8fec12f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:46.328 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.320+0000 7fab127fc640 1 -- 172.21.15.27:0/1832515994 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2598501269 0 0) 0x7fab1409af50 con 0x7fab1412ff00 2023-11-29T08:56:46.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.320+0000 7f8feaffd640 1 -- 172.21.15.27:0/3306162416 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fec072800 con 0x7f8fec097d70 2023-11-29T08:56:46.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.320+0000 7fab127fc640 1 -- 172.21.15.27:0/1832515994 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faafc0034f0 con 0x7fab1412ff00 2023-11-29T08:56:46.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.320+0000 7fab12ffd640 1 -- 172.21.15.27:0/1832515994 >> v1:172.21.15.27:6789/0 conn(0x7fab1412ff00 legacy=0x7fab14130310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:46.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.320+0000 7fab12ffd640 1 -- 172.21.15.27:0/1832515994 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab1406e220 con 0x7fab14132d70 2023-11-29T08:56:46.329 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.320+0000 7f8feaffd640 1 --2- 172.21.15.27:0/3306162416 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8fec097d70 0x7f8fec12f950 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64bc888a185fc577 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:46.330 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.320+0000 7fd0df7fe640 1 -- 172.21.15.27:0/314089771 >> v1:172.21.15.27:6789/0 conn(0x7fd0e00a0fc0 legacy=0x7fd0e0133450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:46.330 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.320+0000 7fd0df7fe640 1 -- 172.21.15.27:0/314089771 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0e01302d0 con 0x7fd0e00a0bb0 2023-11-29T08:56:46.330 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.320+0000 7f86177fe640 1 -- 172.21.15.27:0/1237003365 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4199359680 0 0) 0x7f861809af50 con 0x7f861812ff00 2023-11-29T08:56:46.330 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.320+0000 7f8617fff640 1 -- 172.21.15.27:0/1237003365 >> v1:172.21.15.27:6789/0 conn(0x7f861812ff00 legacy=0x7f8618130310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:46.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.320+0000 7f8617fff640 1 -- 172.21.15.27:0/1237003365 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f861806e220 con 0x7f8618132d70 2023-11-29T08:56:46.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.320+0000 7fab12ffd640 1 --2- 172.21.15.27:0/1832515994 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab14132d70 0x7fab14135190 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d12ab95e533857dc server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:46.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.320+0000 7f8fea7fc640 1 -- 172.21.15.27:0/3306162416 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f8fe0009ce0 con 0x7f8fec097d70 2023-11-29T08:56:46.331 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.320+0000 7fd0df7fe640 1 --2- 172.21.15.27:0/314089771 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd0e00a0bb0 0x7fd0e0132f10 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29e086477f9e156c server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:46.332 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.320+0000 7f8fea7fc640 1 -- 172.21.15.27:0/3306162416 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f8fe0009e40 con 0x7f8fec097d70 2023-11-29T08:56:46.332 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.320+0000 7f8fea7fc640 1 -- 172.21.15.27:0/3306162416 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f8fe000f470 con 0x7f8fec097d70 2023-11-29T08:56:46.332 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.320+0000 7fab127fc640 1 -- 172.21.15.27:0/1832515994 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fab08009ce0 con 0x7fab14132d70 2023-11-29T08:56:46.332 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.320+0000 7f8617fff640 1 --2- 172.21.15.27:0/1237003365 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8618132d70 0x7f8618135190 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1915e69cf5575bc4 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:46.333 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.321+0000 7fab127fc640 1 -- 172.21.15.27:0/1832515994 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fab08009e40 con 0x7fab14132d70 2023-11-29T08:56:46.333 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.321+0000 7fd0de7fc640 1 -- 172.21.15.27:0/314089771 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fd0d0009ce0 con 0x7fd0e00a0bb0 2023-11-29T08:56:46.333 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.321+0000 7fd0de7fc640 1 -- 172.21.15.27:0/314089771 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fd0d0009e40 con 0x7fd0e00a0bb0 2023-11-29T08:56:46.333 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.321+0000 7fd0de7fc640 1 -- 172.21.15.27:0/314089771 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fd0d000e360 con 0x7fd0e00a0bb0 2023-11-29T08:56:46.334 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.321+0000 7f86177fe640 1 -- 172.21.15.27:0/1237003365 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f8604009ce0 con 0x7f8618132d70 2023-11-29T08:56:46.334 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.321+0000 7f86177fe640 1 -- 172.21.15.27:0/1237003365 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f8604009e40 con 0x7f8618132d70 2023-11-29T08:56:46.334 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.321+0000 7f86177fe640 1 -- 172.21.15.27:0/1237003365 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f8604009ce0 con 0x7f8618132d70 2023-11-29T08:56:46.334 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.321+0000 7f8ff1f9e640 1 -- 172.21.15.27:0/3306162416 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8fec097d70 msgr2=0x7f8fec12f950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:46.334 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.321+0000 7f8ff1f9e640 1 --2- 172.21.15.27:0/3306162416 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8fec097d70 0x7f8fec12f950 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:46.335 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.321+0000 7fab127fc640 1 -- 172.21.15.27:0/1832515994 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fab08010570 con 0x7fab14132d70 2023-11-29T08:56:46.335 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.321+0000 7f8ff1f9e640 1 -- 172.21.15.27:0/3306162416 shutdown_connections 2023-11-29T08:56:46.335 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.322+0000 7f8ff1f9e640 1 --2- 172.21.15.27:0/3306162416 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8fec097d70 0x7f8fec12f950 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:46.335 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.322+0000 7f8ff1f9e640 1 -- 172.21.15.27:0/3306162416 >> 172.21.15.27:0/3306162416 conn(0x7f8fec09dff0 msgr2=0x7f8fec09e400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T08:56:46.335 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.322+0000 7f861ef9e640 1 -- 172.21.15.27:0/1237003365 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8618132d70 msgr2=0x7f8618135190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:46.335 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.322+0000 7f861ef9e640 1 --2- 172.21.15.27:0/1237003365 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8618132d70 0x7f8618135190 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:46.336 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.322+0000 7f8ff1f9e640 1 -- 172.21.15.27:0/3306162416 shutdown_connections 2023-11-29T08:56:46.336 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.322+0000 7f8ff1f9e640 1 -- 172.21.15.27:0/3306162416 wait complete. 2023-11-29T08:56:46.336 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.322+0000 7f861ef9e640 1 -- 172.21.15.27:0/1237003365 shutdown_connections 2023-11-29T08:56:46.336 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.322+0000 7f861ef9e640 1 --2- 172.21.15.27:0/1237003365 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8618132d70 0x7f8618135190 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:46.336 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.322+0000 7f861ef9e640 1 -- 172.21.15.27:0/1237003365 >> 172.21.15.27:0/1237003365 conn(0x7f861809dff0 msgr2=0x7f861809e400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T08:56:46.337 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.322+0000 7fd0e5b5e640 1 -- 172.21.15.27:0/314089771 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd0e00a0bb0 msgr2=0x7fd0e0132f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:46.337 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.322+0000 7fd0e5b5e640 1 --2- 172.21.15.27:0/314089771 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd0e00a0bb0 0x7fd0e0132f10 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:46.337 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.322+0000 7fab1a06d640 1 -- 172.21.15.27:0/1832515994 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab14132d70 msgr2=0x7fab14135190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:46.337 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.322+0000 7fab1a06d640 1 --2- 172.21.15.27:0/1832515994 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab14132d70 0x7fab14135190 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:46.337 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.322+0000 7f861ef9e640 1 -- 172.21.15.27:0/1237003365 shutdown_connections 2023-11-29T08:56:46.338 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.322+0000 7fd0e5b5e640 1 -- 172.21.15.27:0/314089771 shutdown_connections 2023-11-29T08:56:46.338 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.322+0000 7fd0e5b5e640 1 --2- 172.21.15.27:0/314089771 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd0e00a0bb0 0x7fd0e0132f10 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:46.338 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.322+0000 7fd0e5b5e640 1 -- 172.21.15.27:0/314089771 >> 172.21.15.27:0/314089771 conn(0x7fd0e006c9a0 msgr2=0x7fd0e006cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T08:56:46.338 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.322+0000 7fab1a06d640 1 -- 172.21.15.27:0/1832515994 shutdown_connections 2023-11-29T08:56:46.338 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.322+0000 7fab1a06d640 1 --2- 172.21.15.27:0/1832515994 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab14132d70 0x7fab14135190 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:46.338 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.322+0000 7fab1a06d640 1 -- 172.21.15.27:0/1832515994 >> 172.21.15.27:0/1832515994 conn(0x7fab1409dff0 msgr2=0x7fab1409e400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T08:56:46.339 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.322+0000 7f8ff1f9e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:56:46.339 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.322+0000 7fd0e5b5e640 1 -- 172.21.15.27:0/314089771 shutdown_connections 2023-11-29T08:56:46.339 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.322+0000 7fd0e5b5e640 1 -- 172.21.15.27:0/314089771 wait complete. 2023-11-29T08:56:46.339 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.322+0000 7fab1a06d640 1 -- 172.21.15.27:0/1832515994 shutdown_connections 2023-11-29T08:56:46.340 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.322+0000 7f861ef9e640 1 -- 172.21.15.27:0/1237003365 wait complete. 2023-11-29T08:56:46.340 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.322+0000 7f861ef9e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:56:46.340 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.322+0000 7fd0e5b5e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:56:46.340 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.322+0000 7fab1a06d640 1 -- 172.21.15.27:0/1832515994 wait complete. 2023-11-29T08:56:46.340 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.322+0000 7fab1a06d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:56:46.341 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.323+0000 7f861ef9e640 1 Processor -- start 2023-11-29T08:56:46.341 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.323+0000 7f861ef9e640 1 -- start start 2023-11-29T08:56:46.341 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.323+0000 7f8ff1f9e640 1 Processor -- start 2023-11-29T08:56:46.341 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.323+0000 7f8ff1f9e640 1 -- start start 2023-11-29T08:56:46.342 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.324+0000 7fd0e5b5e640 1 Processor -- start 2023-11-29T08:56:46.342 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.324+0000 7fab1a06d640 1 Processor -- start 2023-11-29T08:56:46.342 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.324+0000 7f861ef9e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f861812ff00 0x7f86181366e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:46.342 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.324+0000 7f861ef9e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86181378a0 con 0x7f861812ff00 2023-11-29T08:56:46.343 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.324+0000 7f8ff1f9e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8fec097960 0x7f8fec126040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:46.343 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.324+0000 7f8ff1f9e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fec12c9a0 con 0x7f8fec097960 2023-11-29T08:56:46.343 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.324+0000 7f861cd3a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f861812ff00 0x7f86181366e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:56:46.343 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.324+0000 7f8feb7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8fec097960 0x7f8fec126040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:56:46.344 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.324+0000 7fd0e5b5e640 1 -- start start 2023-11-29T08:56:46.344 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.324+0000 7f8feb7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8fec097960 0x7f8fec126040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40980/0 (socket says 172.21.15.27:40980) 2023-11-29T08:56:46.344 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.324+0000 7fab1a06d640 1 -- start start 2023-11-29T08:56:46.344 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.324+0000 7f8feb7fe640 1 -- 172.21.15.27:0/3228796678 learned_addr learned my addr 172.21.15.27:0/3228796678 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-11-29T08:56:46.345 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.324+0000 7f861cd3a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f861812ff00 0x7f86181366e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40968/0 (socket says 172.21.15.27:40968) 2023-11-29T08:56:46.345 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.324+0000 7f861cd3a640 1 -- 172.21.15.27:0/3936521050 learned_addr learned my addr 172.21.15.27:0/3936521050 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-11-29T08:56:46.345 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.325+0000 7f8feb7fe640 1 -- 172.21.15.27:0/3228796678 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fec12ccd0 con 0x7f8fec097960 2023-11-29T08:56:46.345 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.325+0000 7f8feb7fe640 1 --2- 172.21.15.27:0/3228796678 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8fec097960 0x7f8fec126040 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:46.346 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.325+0000 7f861cd3a640 1 -- 172.21.15.27:0/3936521050 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8618097cd0 con 0x7f861812ff00 2023-11-29T08:56:46.346 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.325+0000 7f8fd3fff640 1 -- 172.21.15.27:0/3228796678 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f8fdc0058a0 con 0x7f8fec097960 2023-11-29T08:56:46.346 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.325+0000 7f8ff1f9e640 1 -- 172.21.15.27:0/3228796678 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fec127aa0 con 0x7f8fec097960 2023-11-29T08:56:46.346 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.325+0000 7f8fd3fff640 1 -- 172.21.15.27:0/3228796678 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f8fdc005a00 con 0x7f8fec097960 2023-11-29T08:56:46.347 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.325+0000 7f8fd3fff640 1 -- 172.21.15.27:0/3228796678 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f8fdc005ca0 con 0x7f8fec097960 2023-11-29T08:56:46.347 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.325+0000 7f8ff1f9e640 1 -- 172.21.15.27:0/3228796678 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fec12e150 con 0x7f8fec097960 2023-11-29T08:56:46.347 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.325+0000 7f861cd3a640 1 --2- 172.21.15.27:0/3936521050 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f861812ff00 0x7f86181366e0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:46.347 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.325+0000 7fab1a06d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab1412ff00 0x7fab14127f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:46.348 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.325+0000 7f86157fa640 1 -- 172.21.15.27:0/3936521050 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f860c004af0 con 0x7f861812ff00 2023-11-29T08:56:46.348 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.325+0000 7f86157fa640 1 -- 172.21.15.27:0/3936521050 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f860c004c50 con 0x7f861812ff00 2023-11-29T08:56:46.348 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.326+0000 7fab137fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab1412ff00 0x7fab14127f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:56:46.348 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.326+0000 7fab137fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab1412ff00 0x7fab14127f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40994/0 (socket says 172.21.15.27:40994) 2023-11-29T08:56:46.348 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.326+0000 7fab137fe640 1 -- 172.21.15.27:0/1636947405 learned_addr learned my addr 172.21.15.27:0/1636947405 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-11-29T08:56:46.349 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.326+0000 7f8ff1f9e640 1 -- 172.21.15.27:0/3228796678 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8fec0a09a0 con 0x7f8fec097960 2023-11-29T08:56:46.349 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.326+0000 7fab1a06d640 1 -- 172.21.15.27:0/1636947405 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab14127b70 con 0x7fab1412ff00 2023-11-29T08:56:46.349 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.326+0000 7fd0e5b5e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd0e00a0bb0 0x7fd0e011b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:46.349 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.326+0000 7f86157fa640 1 -- 172.21.15.27:0/3936521050 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f860c007120 con 0x7f861812ff00 2023-11-29T08:56:46.350 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.326+0000 7fd0e5b5e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e011d4e0 con 0x7fd0e00a0bb0 2023-11-29T08:56:46.350 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.326+0000 7f861ef9e640 1 -- 172.21.15.27:0/3936521050 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f861812cc90 con 0x7f861812ff00 2023-11-29T08:56:46.350 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.326+0000 7f861ef9e640 1 -- 172.21.15.27:0/3936521050 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8618137d70 con 0x7f861812ff00 2023-11-29T08:56:46.350 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.326+0000 7f8fd3fff640 1 -- 172.21.15.27:0/3228796678 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (crc 0 0 0) 0x7f8fdc0070b0 con 0x7f8fec097960 2023-11-29T08:56:46.351 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.326+0000 7f8fd3fff640 1 --2- 172.21.15.27:0/3228796678 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f8fd80377c0 0x7f8fd8039cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:46.351 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.327+0000 7f8fd3fff640 1 -- 172.21.15.27:0/3228796678 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2672+0+0 (crc 0 0 0) 0x7f8fdc046ce0 con 0x7f8fec097960 2023-11-29T08:56:46.351 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.326+0000 7fab137fe640 1 -- 172.21.15.27:0/1636947405 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab14129ea0 con 0x7fab1412ff00 2023-11-29T08:56:46.351 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.326+0000 7fd0df7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd0e00a0bb0 0x7fd0e011b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:56:46.351 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.326+0000 7fd0df7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd0e00a0bb0 0x7fd0e011b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41004/0 (socket says 172.21.15.27:41004) 2023-11-29T08:56:46.351 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.326+0000 7fd0df7fe640 1 -- 172.21.15.27:0/1474346781 learned_addr learned my addr 172.21.15.27:0/1474346781 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-11-29T08:56:46.352 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.327+0000 7f8fd3fff640 1 --2- 172.21.15.27:0/3228796678 >> v2:172.21.15.139:6803/3090700196 conn(0x7f8fd803c760 0x7f8fd803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:46.352 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.327+0000 7f8fd3fff640 1 -- 172.21.15.27:0/3228796678 --> v2:172.21.15.139:6803/3090700196 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8fd803f280 con 0x7f8fd803c760 2023-11-29T08:56:46.352 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.327+0000 7f8fd3fff640 1 -- 172.21.15.27:0/3228796678 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (crc 0 0 0) 0x7f8fdc049190 con 0x7f8fec097960 2023-11-29T08:56:46.352 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.327+0000 7fab137fe640 1 --2- 172.21.15.27:0/1636947405 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab1412ff00 0x7fab14127f30 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:46.352 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.327+0000 7f8feaffd640 1 --2- 172.21.15.27:0/3228796678 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f8fd80377c0 0x7f8fd8039cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:56:46.353 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.327+0000 7fd0df7fe640 1 -- 172.21.15.27:0/1474346781 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0e011dd10 con 0x7fd0e00a0bb0 2023-11-29T08:56:46.353 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.327+0000 7fd0df7fe640 1 --2- 172.21.15.27:0/1474346781 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd0e00a0bb0 0x7fd0e011b7f0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:46.353 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.327+0000 7faafbfff640 1 -- 172.21.15.27:0/1636947405 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fab040059d0 con 0x7fab1412ff00 2023-11-29T08:56:46.353 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.327+0000 7fab1a06d640 1 -- 172.21.15.27:0/1636947405 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab1406fdc0 con 0x7fab1412ff00 2023-11-29T08:56:46.354 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.327+0000 7f861ef9e640 1 -- 172.21.15.27:0/3936521050 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f861806d840 con 0x7f861812ff00 2023-11-29T08:56:46.354 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.327+0000 7fab1a06d640 1 -- 172.21.15.27:0/1636947405 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab1406f920 con 0x7fab1412ff00 2023-11-29T08:56:46.354 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.327+0000 7faafbfff640 1 -- 172.21.15.27:0/1636947405 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fab04005b30 con 0x7fab1412ff00 2023-11-29T08:56:46.354 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.327+0000 7faafbfff640 1 -- 172.21.15.27:0/1636947405 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fab04005dd0 con 0x7fab1412ff00 2023-11-29T08:56:46.354 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.327+0000 7f8febfff640 1 --2- 172.21.15.27:0/3228796678 >> v2:172.21.15.139:6803/3090700196 conn(0x7f8fd803c760 0x7f8fd803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-29T08:56:46.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.328+0000 7f8feaffd640 1 --2- 172.21.15.27:0/3228796678 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f8fd80377c0 0x7f8fd8039cd0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:46.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.328+0000 7fd0c7fff640 1 -- 172.21.15.27:0/1474346781 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fd0d0014620 con 0x7fd0e00a0bb0 2023-11-29T08:56:46.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.328+0000 7fd0c7fff640 1 -- 172.21.15.27:0/1474346781 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fd0d0014780 con 0x7fd0e00a0bb0 2023-11-29T08:56:46.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.328+0000 7fd0e5b5e640 1 -- 172.21.15.27:0/1474346781 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0e012f540 con 0x7fd0e00a0bb0 2023-11-29T08:56:46.355 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.328+0000 7fd0c7fff640 1 -- 172.21.15.27:0/1474346781 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fd0d0014a20 con 0x7fd0e00a0bb0 2023-11-29T08:56:46.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.328+0000 7f86157fa640 1 -- 172.21.15.27:0/3936521050 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (crc 0 0 0) 0x7f860c007280 con 0x7f861812ff00 2023-11-29T08:56:46.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.328+0000 7f86157fa640 1 --2- 172.21.15.27:0/3936521050 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f85fc0378b0 0x7f85fc039dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:46.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.328+0000 7f86157fa640 1 -- 172.21.15.27:0/3936521050 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2672+0+0 (crc 0 0 0) 0x7f860c047160 con 0x7f861812ff00 2023-11-29T08:56:46.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.328+0000 7fab1a06d640 1 -- 172.21.15.27:0/1636947405 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faaf4000f10 con 0x7fab1412ff00 2023-11-29T08:56:46.356 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.328+0000 7faafbfff640 1 -- 172.21.15.27:0/1636947405 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (crc 0 0 0) 0x7fab040070b0 con 0x7fab1412ff00 2023-11-29T08:56:46.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.328+0000 7fd0e5b5e640 1 -- 172.21.15.27:0/1474346781 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0e011ea20 con 0x7fd0e00a0bb0 2023-11-29T08:56:46.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.329+0000 7f86157fa640 1 --2- 172.21.15.27:0/3936521050 >> v2:172.21.15.27:6802/441902163 conn(0x7f85fc03c8d0 0x7f85fc03ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:46.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.329+0000 7f8617fff640 1 --2- 172.21.15.27:0/3936521050 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f85fc0378b0 0x7f85fc039dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:56:46.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.329+0000 7f86157fa640 1 -- 172.21.15.27:0/3936521050 --> v2:172.21.15.27:6802/441902163 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f85fc03f3f0 con 0x7f85fc03c8d0 2023-11-29T08:56:46.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.329+0000 7f86157fa640 1 -- 172.21.15.27:0/3936521050 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (crc 0 0 0) 0x7f860c047470 con 0x7f861812ff00 2023-11-29T08:56:46.357 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.329+0000 7f8617fff640 1 --2- 172.21.15.27:0/3936521050 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f85fc0378b0 0x7f85fc039dc0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:46.358 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.329+0000 7faafbfff640 1 --2- 172.21.15.27:0/1636947405 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7fab00037860 0x7fab00039d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:46.358 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.329+0000 7faafbfff640 1 -- 172.21.15.27:0/1636947405 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2672+0+0 (crc 0 0 0) 0x7fab04046ca0 con 0x7fab1412ff00 2023-11-29T08:56:46.358 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.329+0000 7fab12ffd640 1 --2- 172.21.15.27:0/1636947405 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7fab00037860 0x7fab00039d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:56:46.358 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.329+0000 7faafbfff640 1 --2- 172.21.15.27:0/1636947405 >> v2:172.21.15.27:6800/601592489 conn(0x7fab0003c800 0x7fab0003ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:46.358 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.329+0000 7faafbfff640 1 -- 172.21.15.27:0/1636947405 --> v2:172.21.15.27:6800/601592489 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fab0003f320 con 0x7fab0003c800 2023-11-29T08:56:46.358 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.329+0000 7fd0c7fff640 1 -- 172.21.15.27:0/1474346781 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (crc 0 0 0) 0x7fd0d0014b80 con 0x7fd0e00a0bb0 2023-11-29T08:56:46.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.329+0000 7f861d53b640 1 --2- 172.21.15.27:0/3936521050 >> v2:172.21.15.27:6802/441902163 conn(0x7f85fc03c8d0 0x7f85fc03ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-29T08:56:46.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.329+0000 7faafbfff640 1 -- 172.21.15.27:0/1636947405 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (crc 0 0 0) 0x7fab0400d980 con 0x7fab1412ff00 2023-11-29T08:56:46.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.330+0000 7fd0c7fff640 1 --2- 172.21.15.27:0/1474346781 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7fd0cc037810 0x7fd0cc039d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:46.359 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.330+0000 7fab12ffd640 1 --2- 172.21.15.27:0/1636947405 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7fab00037860 0x7fab00039d70 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:46.360 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.330+0000 7fd0c7fff640 1 -- 172.21.15.27:0/1474346781 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2672+0+0 (crc 0 0 0) 0x7fd0d0019040 con 0x7fd0e00a0bb0 2023-11-29T08:56:46.360 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.330+0000 7fd0deffd640 1 --2- 172.21.15.27:0/1474346781 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7fd0cc037810 0x7fd0cc039d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:56:46.360 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.330+0000 7fd0e5b5e640 1 --2- 172.21.15.27:0/1474346781 >> v2:172.21.15.139:6805/1054546365 conn(0x7fd0e00a0fc0 0x7fd0e011bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:46.360 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.330+0000 7fd0e5b5e640 1 -- 172.21.15.27:0/1474346781 --> v2:172.21.15.139:6805/1054546365 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd0e009f570 con 0x7fd0e00a0fc0 2023-11-29T08:56:46.360 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.330+0000 7f8febfff640 1 --2- 172.21.15.27:0/3228796678 >> v2:172.21.15.139:6803/3090700196 conn(0x7f8fd803c760 0x7f8fd803ebf0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:46.361 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.330+0000 7fd0deffd640 1 --2- 172.21.15.27:0/1474346781 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7fd0cc037810 0x7fd0cc039d20 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:46.361 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.331+0000 7fd0dffff640 1 --2- 172.21.15.27:0/1474346781 >> v2:172.21.15.139:6805/1054546365 conn(0x7fd0e00a0fc0 0x7fd0e011bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-29T08:56:46.361 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.332+0000 7f861d53b640 1 --2- 172.21.15.27:0/3936521050 >> v2:172.21.15.27:6802/441902163 conn(0x7f85fc03c8d0 0x7f85fc03ed60 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:46.361 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.333+0000 7f86157fa640 1 -- 172.21.15.27:0/3936521050 <== osd.1 v2:172.21.15.27:6802/441902163 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+4964 (crc 0 0 0) 0x7f85fc03f3f0 con 0x7f85fc03c8d0 2023-11-29T08:56:46.361 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.333+0000 7fd0dffff640 1 --2- 172.21.15.27:0/1474346781 >> v2:172.21.15.139:6805/1054546365 conn(0x7fd0e00a0fc0 0x7fd0e011bd30 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:46.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.333+0000 7fab13fff640 1 --2- 172.21.15.27:0/1636947405 >> v2:172.21.15.27:6800/601592489 conn(0x7fab0003c800 0x7fab0003ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-29T08:56:46.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.334+0000 7fd0c7fff640 1 -- 172.21.15.27:0/1474346781 <== osd.3 v2:172.21.15.139:6805/1054546365 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+4964 (crc 0 0 0) 0x7fd0d800a820 con 0x7fd0e00a0fc0 2023-11-29T08:56:46.362 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.335+0000 7fab13fff640 1 --2- 172.21.15.27:0/1636947405 >> v2:172.21.15.27:6800/601592489 conn(0x7fab0003c800 0x7fab0003ec90 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:46.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.335+0000 7f8fd3fff640 1 -- 172.21.15.27:0/3228796678 <== osd.2 v2:172.21.15.139:6803/3090700196 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+4964 (crc 0 0 0) 0x7f8fd803f280 con 0x7f8fd803c760 2023-11-29T08:56:46.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.336+0000 7faafbfff640 1 -- 172.21.15.27:0/1636947405 <== osd.0 v2:172.21.15.27:6800/601592489 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+4964 (crc 0 0 0) 0x7fab0003f320 con 0x7fab0003c800 2023-11-29T08:56:46.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.338+0000 7f861ef9e640 1 -- 172.21.15.27:0/3936521050 --> v2:172.21.15.27:6802/441902163 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f861812fbf0 con 0x7f85fc03c8d0 2023-11-29T08:56:46.363 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.339+0000 7f8ff1f9e640 1 -- 172.21.15.27:0/3228796678 --> v2:172.21.15.139:6803/3090700196 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8fec09af20 con 0x7f8fd803c760 2023-11-29T08:56:46.364 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.339+0000 7f86157fa640 1 -- 172.21.15.27:0/3936521050 <== osd.1 v2:172.21.15.27:6802/441902163 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f861000a820 con 0x7f85fc03c8d0 2023-11-29T08:56:46.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.339+0000 7f861ef9e640 1 -- 172.21.15.27:0/3936521050 >> v2:172.21.15.27:6802/441902163 conn(0x7f85fc03c8d0 msgr2=0x7f85fc03ed60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:46.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.339+0000 7f861ef9e640 1 --2- 172.21.15.27:0/3936521050 >> v2:172.21.15.27:6802/441902163 conn(0x7f85fc03c8d0 0x7f85fc03ed60 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:46.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.339+0000 7f861ef9e640 1 -- 172.21.15.27:0/3936521050 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f85fc0378b0 msgr2=0x7f85fc039dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:46.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.339+0000 7f861ef9e640 1 --2- 172.21.15.27:0/3936521050 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f85fc0378b0 0x7f85fc039dc0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:46.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.339+0000 7f861ef9e640 1 -- 172.21.15.27:0/3936521050 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f861812ff00 msgr2=0x7f86181366e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:46.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.339+0000 7f861ef9e640 1 --2- 172.21.15.27:0/3936521050 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f861812ff00 0x7f86181366e0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:46.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.339+0000 7f861ef9e640 1 -- 172.21.15.27:0/3936521050 shutdown_connections 2023-11-29T08:56:46.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.339+0000 7f861ef9e640 1 --2- 172.21.15.27:0/3936521050 >> v2:172.21.15.27:6802/441902163 conn(0x7f85fc03c8d0 0x7f85fc03ed60 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:46.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.339+0000 7f861ef9e640 1 --2- 172.21.15.27:0/3936521050 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f85fc0378b0 0x7f85fc039dc0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:46.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.339+0000 7f861ef9e640 1 --2- 172.21.15.27:0/3936521050 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f861812ff00 0x7f86181366e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:46.365 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.340+0000 7f861ef9e640 1 -- 172.21.15.27:0/3936521050 >> 172.21.15.27:0/3936521050 conn(0x7f861809dff0 msgr2=0x7f8618130d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T08:56:46.366 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.340+0000 7fab1a06d640 1 -- 172.21.15.27:0/1636947405 --> v2:172.21.15.27:6800/601592489 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7faaf4002b20 con 0x7fab0003c800 2023-11-29T08:56:46.366 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.340+0000 7f8fd3fff640 1 -- 172.21.15.27:0/3228796678 <== osd.2 v2:172.21.15.139:6803/3090700196 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8fe400a820 con 0x7f8fd803c760 2023-11-29T08:56:46.366 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.340+0000 7fd0e5b5e640 1 -- 172.21.15.27:0/1474346781 --> v2:172.21.15.139:6805/1054546365 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd0e012ffc0 con 0x7fd0e00a0fc0 2023-11-29T08:56:46.367 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.340+0000 7f861ef9e640 1 -- 172.21.15.27:0/3936521050 shutdown_connections 2023-11-29T08:56:46.367 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.340+0000 7f861ef9e640 1 -- 172.21.15.27:0/3936521050 wait complete. 2023-11-29T08:56:46.367 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.340+0000 7f8ff1f9e640 1 -- 172.21.15.27:0/3228796678 >> v2:172.21.15.139:6803/3090700196 conn(0x7f8fd803c760 msgr2=0x7f8fd803ebf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:46.368 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.340+0000 7f8ff1f9e640 1 --2- 172.21.15.27:0/3228796678 >> v2:172.21.15.139:6803/3090700196 conn(0x7f8fd803c760 0x7f8fd803ebf0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:46.368 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.340+0000 7f8ff1f9e640 1 -- 172.21.15.27:0/3228796678 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f8fd80377c0 msgr2=0x7f8fd8039cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:46.368 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.340+0000 7f8ff1f9e640 1 --2- 172.21.15.27:0/3228796678 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f8fd80377c0 0x7f8fd8039cd0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:46.368 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.340+0000 7f8ff1f9e640 1 -- 172.21.15.27:0/3228796678 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8fec097960 msgr2=0x7f8fec126040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:46.368 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.340+0000 7f8ff1f9e640 1 --2- 172.21.15.27:0/3228796678 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8fec097960 0x7f8fec126040 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:46.368 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.340+0000 7f8ff1f9e640 1 -- 172.21.15.27:0/3228796678 shutdown_connections 2023-11-29T08:56:46.368 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.340+0000 7f8ff1f9e640 1 --2- 172.21.15.27:0/3228796678 >> v2:172.21.15.139:6803/3090700196 conn(0x7f8fd803c760 0x7f8fd803ebf0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:46.368 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.340+0000 7f8ff1f9e640 1 --2- 172.21.15.27:0/3228796678 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f8fd80377c0 0x7f8fd8039cd0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:46.368 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.340+0000 7f8ff1f9e640 1 --2- 172.21.15.27:0/3228796678 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8fec097960 0x7f8fec126040 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:46.368 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.340+0000 7f8ff1f9e640 1 -- 172.21.15.27:0/3228796678 >> 172.21.15.27:0/3228796678 conn(0x7f8fec09dff0 msgr2=0x7f8fec1b7260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T08:56:46.368 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.340+0000 7fd0c7fff640 1 -- 172.21.15.27:0/1474346781 <== osd.3 v2:172.21.15.139:6805/1054546365 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd0d800ad10 con 0x7fd0e00a0fc0 2023-11-29T08:56:46.369 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.340+0000 7f8ff1f9e640 1 -- 172.21.15.27:0/3228796678 shutdown_connections 2023-11-29T08:56:46.369 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.341+0000 7f8ff1f9e640 1 -- 172.21.15.27:0/3228796678 wait complete. 2023-11-29T08:56:46.369 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.341+0000 7fd0e5b5e640 1 -- 172.21.15.27:0/1474346781 >> v2:172.21.15.139:6805/1054546365 conn(0x7fd0e00a0fc0 msgr2=0x7fd0e011bd30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:46.369 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.341+0000 7fd0e5b5e640 1 --2- 172.21.15.27:0/1474346781 >> v2:172.21.15.139:6805/1054546365 conn(0x7fd0e00a0fc0 0x7fd0e011bd30 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:46.370 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.341+0000 7faafbfff640 1 -- 172.21.15.27:0/1636947405 <== osd.0 v2:172.21.15.27:6800/601592489 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7faaf4002b20 con 0x7fab0003c800 2023-11-29T08:56:46.370 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.341+0000 7fd0e5b5e640 1 -- 172.21.15.27:0/1474346781 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7fd0cc037810 msgr2=0x7fd0cc039d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:46.370 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.341+0000 7fd0e5b5e640 1 --2- 172.21.15.27:0/1474346781 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7fd0cc037810 0x7fd0cc039d20 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:46.370 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.341+0000 7fd0e5b5e640 1 -- 172.21.15.27:0/1474346781 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd0e00a0bb0 msgr2=0x7fd0e011b7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:46.370 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.341+0000 7fab1a06d640 1 -- 172.21.15.27:0/1636947405 >> v2:172.21.15.27:6800/601592489 conn(0x7fab0003c800 msgr2=0x7fab0003ec90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:46.371 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.341+0000 7fd0e5b5e640 1 --2- 172.21.15.27:0/1474346781 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd0e00a0bb0 0x7fd0e011b7f0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:46.371 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.341+0000 7fab1a06d640 1 --2- 172.21.15.27:0/1636947405 >> v2:172.21.15.27:6800/601592489 conn(0x7fab0003c800 0x7fab0003ec90 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:46.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.341+0000 7fd0e5b5e640 1 -- 172.21.15.27:0/1474346781 shutdown_connections 2023-11-29T08:56:46.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.341+0000 7fd0e5b5e640 1 --2- 172.21.15.27:0/1474346781 >> v2:172.21.15.139:6805/1054546365 conn(0x7fd0e00a0fc0 0x7fd0e011bd30 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:46.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.341+0000 7fd0e5b5e640 1 --2- 172.21.15.27:0/1474346781 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7fd0cc037810 0x7fd0cc039d20 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:46.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.341+0000 7fd0e5b5e640 1 --2- 172.21.15.27:0/1474346781 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd0e00a0bb0 0x7fd0e011b7f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:46.372 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.341+0000 7fd0e5b5e640 1 -- 172.21.15.27:0/1474346781 >> 172.21.15.27:0/1474346781 conn(0x7fd0e006c9a0 msgr2=0x7fd0e009e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T08:56:46.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.341+0000 7fab1a06d640 1 -- 172.21.15.27:0/1636947405 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7fab00037860 msgr2=0x7fab00039d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:46.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.341+0000 7fab1a06d640 1 --2- 172.21.15.27:0/1636947405 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7fab00037860 0x7fab00039d70 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:46.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.341+0000 7fab1a06d640 1 -- 172.21.15.27:0/1636947405 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab1412ff00 msgr2=0x7fab14127f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:46.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.341+0000 7fab1a06d640 1 --2- 172.21.15.27:0/1636947405 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab1412ff00 0x7fab14127f30 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:46.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.342+0000 7fab1a06d640 1 -- 172.21.15.27:0/1636947405 shutdown_connections 2023-11-29T08:56:46.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.342+0000 7fab1a06d640 1 --2- 172.21.15.27:0/1636947405 >> v2:172.21.15.27:6800/601592489 conn(0x7fab0003c800 0x7fab0003ec90 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:46.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.342+0000 7fab1a06d640 1 --2- 172.21.15.27:0/1636947405 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7fab00037860 0x7fab00039d70 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:46.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.342+0000 7fab1a06d640 1 --2- 172.21.15.27:0/1636947405 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab1412ff00 0x7fab14127f30 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:46.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.342+0000 7fab1a06d640 1 -- 172.21.15.27:0/1636947405 >> 172.21.15.27:0/1636947405 conn(0x7fab1409dff0 msgr2=0x7fab14097660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T08:56:46.373 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.342+0000 7fd0e5b5e640 1 -- 172.21.15.27:0/1474346781 shutdown_connections 2023-11-29T08:56:46.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.342+0000 7fd0e5b5e640 1 -- 172.21.15.27:0/1474346781 wait complete. 2023-11-29T08:56:46.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.342+0000 7fab1a06d640 1 -- 172.21.15.27:0/1636947405 shutdown_connections 2023-11-29T08:56:46.374 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.342+0000 7fab1a06d640 1 -- 172.21.15.27:0/1636947405 wait complete. 2023-11-29T08:56:46.375 INFO:teuthology.orchestra.run.smithi027.stdout:38654705671 2023-11-29T08:56:46.375 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-29T08:56:46.376 INFO:teuthology.orchestra.run.smithi027.stdout:38654705671 2023-11-29T08:56:46.376 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-29T08:56:46.377 INFO:teuthology.orchestra.run.smithi027.stdout:38654705671 2023-11-29T08:56:46.377 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-29T08:56:46.378 INFO:teuthology.orchestra.run.smithi027.stdout:38654705671 2023-11-29T08:56:46.378 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-29T08:56:46.539 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.533+0000 7fa61f91e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:56:46.540 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.533+0000 7f896cb1e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:56:46.540 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.533+0000 7f9a6b91e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:56:46.540 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.533+0000 7f049562d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:56:46.541 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.538+0000 7fa61f91e640 1 Processor -- start 2023-11-29T08:56:46.541 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.538+0000 7f9a6b91e640 1 Processor -- start 2023-11-29T08:56:46.541 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.538+0000 7f049562d640 1 Processor -- start 2023-11-29T08:56:46.541 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.538+0000 7f049562d640 1 -- start start 2023-11-29T08:56:46.542 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.539+0000 7f896cb1e640 1 Processor -- start 2023-11-29T08:56:46.542 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.539+0000 7f9a6b91e640 1 -- start start 2023-11-29T08:56:46.542 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.539+0000 7fa61f91e640 1 -- start start 2023-11-29T08:56:46.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.539+0000 7f896cb1e640 1 -- start start 2023-11-29T08:56:46.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.539+0000 7f049562d640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0490131690 0x7f049009ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:46.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.539+0000 7f9a6b91e640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f9a64097960 0x7f9a6412f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:46.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.539+0000 7f049562d640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f049009d580 con 0x7f049009efd0 2023-11-29T08:56:46.543 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.539+0000 7f049562d640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f049009aa30 con 0x7f0490131690 2023-11-29T08:56:46.544 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.539+0000 7fa61f91e640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa6180723e0 0x7fa61809ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:46.544 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.539+0000 7f896cb1e640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f8968097d70 0x7f896812f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:46.544 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.539+0000 7f896cb1e640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8968098960 con 0x7f8968097960 2023-11-29T08:56:46.545 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.539+0000 7fa61f91e640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa618071130 con 0x7fa6180727f0 2023-11-29T08:56:46.545 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.540+0000 7f896cb1e640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f896809a2a0 con 0x7f8968097d70 2023-11-29T08:56:46.545 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.539+0000 7fa61f91e640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa618131b00 con 0x7fa6180723e0 2023-11-29T08:56:46.545 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.540+0000 7fa61d6ba640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa6180723e0 0x7fa61809ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:56:46.546 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.540+0000 7fa61d6ba640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa6180723e0 0x7fa61809ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41042/0 (socket says 172.21.15.27:41042) 2023-11-29T08:56:46.546 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.540+0000 7fa61d6ba640 1 -- 172.21.15.27:0/3684155187 learned_addr learned my addr 172.21.15.27:0/3684155187 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-11-29T08:56:46.546 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.540+0000 7f048e7fc640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f049009efd0 0x7f049009f3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:54224/0 (socket says 172.21.15.27:54224) 2023-11-29T08:56:46.546 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.540+0000 7f048e7fc640 1 -- 172.21.15.27:0/467570951 learned_addr learned my addr 172.21.15.27:0/467570951 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-11-29T08:56:46.546 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.540+0000 7f048effd640 1 --2- 172.21.15.27:0/467570951 >> v2:172.21.15.27:3300/0 conn(0x7f0490131690 0x7f049009ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:56:46.547 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.540+0000 7f895ffff640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f8968097d70 0x7f896812f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:56:46.547 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.540+0000 7f895ffff640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f8968097d70 0x7f896812f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41050/0 (socket says 172.21.15.27:41050) 2023-11-29T08:56:46.547 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.539+0000 7f9a696ba640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f9a64097960 0x7f9a6412f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:56:46.547 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.540+0000 7f9a696ba640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f9a64097960 0x7f9a6412f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41026/0 (socket says 172.21.15.27:41026) 2023-11-29T08:56:46.547 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.540+0000 7f9a696ba640 1 -- 172.21.15.27:0/2588457303 learned_addr learned my addr 172.21.15.27:0/2588457303 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-11-29T08:56:46.547 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.540+0000 7f9a6b91e640 1 -- 172.21.15.27:0/2588457303 --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a64098960 con 0x7f9a64097d70 2023-11-29T08:56:46.548 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.540+0000 7fa61d6ba640 1 -- 172.21.15.27:0/3684155187 >> v1:172.21.15.27:6789/0 conn(0x7fa6180727f0 legacy=0x7fa61809efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T08:56:46.548 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.540+0000 7fa61d6ba640 1 -- 172.21.15.27:0/3684155187 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6181312c0 con 0x7fa6180723e0 2023-11-29T08:56:46.548 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.540+0000 7f895ffff640 1 -- 172.21.15.27:0/2885969152 learned_addr learned my addr 172.21.15.27:0/2885969152 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-11-29T08:56:46.548 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.540+0000 7f9a6b91e640 1 -- 172.21.15.27:0/2588457303 --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a6409a2a0 con 0x7f9a64097960 2023-11-29T08:56:46.549 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.540+0000 7f048effd640 1 -- 172.21.15.27:0/467570951 >> v1:172.21.15.27:6789/0 conn(0x7f049009efd0 legacy=0x7f049009f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:46.549 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.540+0000 7f048effd640 1 -- 172.21.15.27:0/467570951 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0490099d10 con 0x7f0490131690 2023-11-29T08:56:46.549 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.540+0000 7f8965d9b640 1 -- 172.21.15.27:0/2885969152 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2873643071 0 0) 0x7f8968098960 con 0x7f8968097960 2023-11-29T08:56:46.549 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.540+0000 7f8965d9b640 1 -- 172.21.15.27:0/2885969152 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89540034f0 con 0x7f8968097960 2023-11-29T08:56:46.549 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.540+0000 7fa61d6ba640 1 --2- 172.21.15.27:0/3684155187 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa6180723e0 0x7fa61809ea90 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebd4bce088293e6f server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:46.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.540+0000 7f895ffff640 1 -- 172.21.15.27:0/2885969152 >> v1:172.21.15.27:6789/0 conn(0x7f8968097960 legacy=0x7f896812f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:46.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.540+0000 7f895ffff640 1 -- 172.21.15.27:0/2885969152 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8968072800 con 0x7f8968097d70 2023-11-29T08:56:46.550 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.540+0000 7f9a696ba640 1 -- 172.21.15.27:0/2588457303 >> v1:172.21.15.27:6789/0 conn(0x7f9a64097d70 legacy=0x7f9a6412f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:46.551 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.540+0000 7f9a696ba640 1 -- 172.21.15.27:0/2588457303 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a64072800 con 0x7f9a64097960 2023-11-29T08:56:46.551 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.541+0000 7f048effd640 1 --2- 172.21.15.27:0/467570951 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0490131690 0x7f049009ea90 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=658ec976ec5fd1d1 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:46.551 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.541+0000 7f895ffff640 1 --2- 172.21.15.27:0/2885969152 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8968097d70 0x7f896812f950 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cfda5bb2d2240af server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:46.551 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.541+0000 7f9a696ba640 1 --2- 172.21.15.27:0/2588457303 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9a64097960 0x7f9a6412f240 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=693a7798d61b4fc3 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:46.552 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.541+0000 7f048dffb640 1 -- 172.21.15.27:0/467570951 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f0480009ce0 con 0x7f0490131690 2023-11-29T08:56:46.552 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.541+0000 7f048dffb640 1 -- 172.21.15.27:0/467570951 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f0480009e40 con 0x7f0490131690 2023-11-29T08:56:46.552 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.541+0000 7f048dffb640 1 -- 172.21.15.27:0/467570951 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f048000e360 con 0x7f0490131690 2023-11-29T08:56:46.552 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.541+0000 7f8965d9b640 1 -- 172.21.15.27:0/2885969152 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f895000d450 con 0x7f8968097d70 2023-11-29T08:56:46.552 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.541+0000 7f9a5bfff640 1 -- 172.21.15.27:0/2588457303 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f9a60009dd0 con 0x7f9a64097960 2023-11-29T08:56:46.553 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.541+0000 7f8965d9b640 1 -- 172.21.15.27:0/2885969152 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f895000d5b0 con 0x7f8968097d70 2023-11-29T08:56:46.553 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.541+0000 7f8965d9b640 1 -- 172.21.15.27:0/2885969152 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f895000d850 con 0x7f8968097d70 2023-11-29T08:56:46.553 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.541+0000 7fa60ffff640 1 -- 172.21.15.27:0/3684155187 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fa614009d10 con 0x7fa6180723e0 2023-11-29T08:56:46.553 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.541+0000 7fa60ffff640 1 -- 172.21.15.27:0/3684155187 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fa614009e70 con 0x7fa6180723e0 2023-11-29T08:56:46.553 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.541+0000 7fa60ffff640 1 -- 172.21.15.27:0/3684155187 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fa61400e360 con 0x7fa6180723e0 2023-11-29T08:56:46.554 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.541+0000 7f9a5bfff640 1 -- 172.21.15.27:0/2588457303 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f9a6000f340 con 0x7f9a64097960 2023-11-29T08:56:46.554 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.541+0000 7f9a5bfff640 1 -- 172.21.15.27:0/2588457303 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f9a6000f5e0 con 0x7f9a64097960 2023-11-29T08:56:46.554 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.542+0000 7f896cb1e640 1 -- 172.21.15.27:0/2885969152 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8968097d70 msgr2=0x7f896812f950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:46.554 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.542+0000 7f896cb1e640 1 --2- 172.21.15.27:0/2885969152 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8968097d70 0x7f896812f950 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:46.555 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.542+0000 7f9a6b91e640 1 -- 172.21.15.27:0/2588457303 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9a64097960 msgr2=0x7f9a6412f240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:46.555 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.542+0000 7f9a6b91e640 1 --2- 172.21.15.27:0/2588457303 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9a64097960 0x7f9a6412f240 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:46.555 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.542+0000 7f896cb1e640 1 -- 172.21.15.27:0/2885969152 shutdown_connections 2023-11-29T08:56:46.555 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.542+0000 7f896cb1e640 1 --2- 172.21.15.27:0/2885969152 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8968097d70 0x7f896812f950 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:46.555 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.542+0000 7f896cb1e640 1 -- 172.21.15.27:0/2885969152 >> 172.21.15.27:0/2885969152 conn(0x7f896809dff0 msgr2=0x7f896809e400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T08:56:46.556 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.542+0000 7f049562d640 1 -- 172.21.15.27:0/467570951 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0490131690 msgr2=0x7f049009ea90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:46.556 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.542+0000 7f049562d640 1 --2- 172.21.15.27:0/467570951 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0490131690 0x7f049009ea90 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:46.556 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.542+0000 7f896cb1e640 1 -- 172.21.15.27:0/2885969152 shutdown_connections 2023-11-29T08:56:46.556 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.542+0000 7f9a6b91e640 1 -- 172.21.15.27:0/2588457303 shutdown_connections 2023-11-29T08:56:46.556 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.542+0000 7f9a6b91e640 1 --2- 172.21.15.27:0/2588457303 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9a64097960 0x7f9a6412f240 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:46.557 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.542+0000 7f049562d640 1 -- 172.21.15.27:0/467570951 shutdown_connections 2023-11-29T08:56:46.557 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.542+0000 7f9a6b91e640 1 -- 172.21.15.27:0/2588457303 >> 172.21.15.27:0/2588457303 conn(0x7f9a6409dff0 msgr2=0x7f9a6409e400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T08:56:46.557 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.542+0000 7f049562d640 1 --2- 172.21.15.27:0/467570951 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0490131690 0x7f049009ea90 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:46.557 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.542+0000 7f049562d640 1 -- 172.21.15.27:0/467570951 >> 172.21.15.27:0/467570951 conn(0x7f0490098a20 msgr2=0x7f0490098e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T08:56:46.558 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.542+0000 7fa61f91e640 1 -- 172.21.15.27:0/3684155187 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa6180723e0 msgr2=0x7fa61809ea90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:46.558 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.542+0000 7f049562d640 1 -- 172.21.15.27:0/467570951 shutdown_connections 2023-11-29T08:56:46.558 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.542+0000 7f896cb1e640 1 -- 172.21.15.27:0/2885969152 wait complete. 2023-11-29T08:56:46.558 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.542+0000 7f9a6b91e640 1 -- 172.21.15.27:0/2588457303 shutdown_connections 2023-11-29T08:56:46.559 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.542+0000 7fa61f91e640 1 --2- 172.21.15.27:0/3684155187 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa6180723e0 0x7fa61809ea90 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:46.559 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.542+0000 7fa61f91e640 1 -- 172.21.15.27:0/3684155187 shutdown_connections 2023-11-29T08:56:46.559 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.542+0000 7fa61f91e640 1 --2- 172.21.15.27:0/3684155187 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa6180723e0 0x7fa61809ea90 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:46.559 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.542+0000 7fa61f91e640 1 -- 172.21.15.27:0/3684155187 >> 172.21.15.27:0/3684155187 conn(0x7fa618098a20 msgr2=0x7fa618098e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T08:56:46.559 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.542+0000 7f049562d640 1 -- 172.21.15.27:0/467570951 wait complete. 2023-11-29T08:56:46.559 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.542+0000 7fa61f91e640 1 -- 172.21.15.27:0/3684155187 shutdown_connections 2023-11-29T08:56:46.560 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.542+0000 7f9a6b91e640 1 -- 172.21.15.27:0/2588457303 wait complete. 2023-11-29T08:56:46.560 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.542+0000 7fa61f91e640 1 -- 172.21.15.27:0/3684155187 wait complete. 2023-11-29T08:56:46.560 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.543+0000 7f896cb1e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:56:46.561 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.543+0000 7f049562d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:56:46.561 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.543+0000 7f9a6b91e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:56:46.561 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.543+0000 7fa61f91e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:56:46.562 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.544+0000 7f896cb1e640 1 Processor -- start 2023-11-29T08:56:46.562 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.544+0000 7f896cb1e640 1 -- start start 2023-11-29T08:56:46.562 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.544+0000 7f9a6b91e640 1 Processor -- start 2023-11-29T08:56:46.562 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.544+0000 7f9a6b91e640 1 -- start start 2023-11-29T08:56:46.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.544+0000 7fa61f91e640 1 Processor -- start 2023-11-29T08:56:46.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.544+0000 7fa61f91e640 1 -- start start 2023-11-29T08:56:46.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.545+0000 7f896cb1e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8968097960 0x7f89681c8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:46.563 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.545+0000 7f049562d640 1 Processor -- start 2023-11-29T08:56:46.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.545+0000 7f896cb1e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f896808aab0 con 0x7f8968097960 2023-11-29T08:56:46.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.545+0000 7f049562d640 1 -- start start 2023-11-29T08:56:46.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.545+0000 7f896659c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8968097960 0x7f89681c8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:56:46.564 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.545+0000 7f896659c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8968097960 0x7f89681c8380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41056/0 (socket says 172.21.15.27:41056) 2023-11-29T08:56:46.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.545+0000 7f896659c640 1 -- 172.21.15.27:0/3452739227 learned_addr learned my addr 172.21.15.27:0/3452739227 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-11-29T08:56:46.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.545+0000 7f9a6b91e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9a64097960 0x7f9a64094650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:46.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.545+0000 7f9a6b91e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6412f910 con 0x7f9a64097960 2023-11-29T08:56:46.565 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.545+0000 7f896659c640 1 -- 172.21.15.27:0/3452739227 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f896812f050 con 0x7f8968097960 2023-11-29T08:56:46.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.545+0000 7f9a696ba640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9a64097960 0x7f9a64094650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:56:46.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.545+0000 7f9a696ba640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9a64097960 0x7f9a64094650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41058/0 (socket says 172.21.15.27:41058) 2023-11-29T08:56:46.566 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.545+0000 7f9a696ba640 1 -- 172.21.15.27:0/887189430 learned_addr learned my addr 172.21.15.27:0/887189430 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-11-29T08:56:46.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.545+0000 7f896659c640 1 --2- 172.21.15.27:0/3452739227 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8968097960 0x7f89681c8380 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:46.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.545+0000 7f895effd640 1 -- 172.21.15.27:0/3452739227 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f89580051e0 con 0x7f8968097960 2023-11-29T08:56:46.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.545+0000 7f895effd640 1 -- 172.21.15.27:0/3452739227 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f8958005340 con 0x7f8968097960 2023-11-29T08:56:46.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.545+0000 7f895effd640 1 -- 172.21.15.27:0/3452739227 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f895800c780 con 0x7f8968097960 2023-11-29T08:56:46.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.545+0000 7fa61f91e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa6180723e0 0x7fa61806b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:46.567 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.545+0000 7f896cb1e640 1 -- 172.21.15.27:0/3452739227 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f896808ace0 con 0x7f8968097960 2023-11-29T08:56:46.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.545+0000 7fa61f91e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa61806cc10 con 0x7fa6180723e0 2023-11-29T08:56:46.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.546+0000 7fa61d6ba640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa6180723e0 0x7fa61806b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:56:46.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.546+0000 7fa61d6ba640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa6180723e0 0x7fa61806b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41068/0 (socket says 172.21.15.27:41068) 2023-11-29T08:56:46.568 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.546+0000 7f896cb1e640 1 -- 172.21.15.27:0/3452739227 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8968094f70 con 0x7f8968097960 2023-11-29T08:56:46.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.546+0000 7fa61d6ba640 1 -- 172.21.15.27:0/3546414396 learned_addr learned my addr 172.21.15.27:0/3546414396 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-11-29T08:56:46.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.546+0000 7f9a696ba640 1 -- 172.21.15.27:0/887189430 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a64129ea0 con 0x7f9a64097960 2023-11-29T08:56:46.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.546+0000 7f9a696ba640 1 --2- 172.21.15.27:0/887189430 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9a64097960 0x7f9a64094650 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:46.569 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.546+0000 7fa61d6ba640 1 -- 172.21.15.27:0/3546414396 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa61812d080 con 0x7fa6180723e0 2023-11-29T08:56:46.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.546+0000 7f049562d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f049009efd0 0x7f049011cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:46.570 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.546+0000 7f049562d640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f049011dea0 con 0x7f049009efd0 2023-11-29T08:56:46.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.546+0000 7f9a59ffb640 1 -- 172.21.15.27:0/887189430 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f9a60012560 con 0x7f9a64097960 2023-11-29T08:56:46.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.546+0000 7f9a59ffb640 1 -- 172.21.15.27:0/887189430 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f9a600126c0 con 0x7f9a64097960 2023-11-29T08:56:46.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.546+0000 7f9a59ffb640 1 -- 172.21.15.27:0/887189430 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f9a60012960 con 0x7f9a64097960 2023-11-29T08:56:46.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.546+0000 7f9a6b91e640 1 -- 172.21.15.27:0/887189430 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a6412df00 con 0x7f9a64097960 2023-11-29T08:56:46.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.546+0000 7fa61d6ba640 1 --2- 172.21.15.27:0/3546414396 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa6180723e0 0x7fa61806b850 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:46.571 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.546+0000 7f9a6b91e640 1 -- 172.21.15.27:0/887189430 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a6412b9a0 con 0x7f9a64097960 2023-11-29T08:56:46.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.547+0000 7f048effd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f049009efd0 0x7f049011cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:56:46.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.547+0000 7f048effd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f049009efd0 0x7f049011cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41076/0 (socket says 172.21.15.27:41076) 2023-11-29T08:56:46.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.547+0000 7f048effd640 1 -- 172.21.15.27:0/2698364545 learned_addr learned my addr 172.21.15.27:0/2698364545 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-11-29T08:56:46.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.547+0000 7fa60dffb640 1 -- 172.21.15.27:0/3546414396 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fa614014620 con 0x7fa6180723e0 2023-11-29T08:56:46.572 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.547+0000 7f896cb1e640 1 -- 172.21.15.27:0/3452739227 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8968062350 con 0x7f8968097960 2023-11-29T08:56:46.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.547+0000 7fa60dffb640 1 -- 172.21.15.27:0/3546414396 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fa614014780 con 0x7fa6180723e0 2023-11-29T08:56:46.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.547+0000 7f895effd640 1 -- 172.21.15.27:0/3452739227 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (crc 0 0 0) 0x7f895800c970 con 0x7f8968097960 2023-11-29T08:56:46.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.547+0000 7fa60dffb640 1 -- 172.21.15.27:0/3546414396 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fa614014a20 con 0x7fa6180723e0 2023-11-29T08:56:46.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.547+0000 7fa61f91e640 1 -- 172.21.15.27:0/3546414396 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa61806c900 con 0x7fa6180723e0 2023-11-29T08:56:46.573 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.547+0000 7fa61f91e640 1 -- 172.21.15.27:0/3546414396 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa61811fd90 con 0x7fa6180723e0 2023-11-29T08:56:46.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.547+0000 7f895effd640 1 --2- 172.21.15.27:0/3452739227 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f8948037860 0x7f8948039d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:46.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.547+0000 7f895effd640 1 -- 172.21.15.27:0/3452739227 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2672+0+0 (crc 0 0 0) 0x7f8958046d90 con 0x7f8968097960 2023-11-29T08:56:46.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.548+0000 7f9a59ffb640 1 -- 172.21.15.27:0/887189430 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (crc 0 0 0) 0x7f9a60012b10 con 0x7f9a64097960 2023-11-29T08:56:46.574 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.548+0000 7f048effd640 1 -- 172.21.15.27:0/2698364545 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f049011e650 con 0x7f049009efd0 2023-11-29T08:56:46.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.548+0000 7f9a59ffb640 1 --2- 172.21.15.27:0/887189430 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f9a48037860 0x7f9a48039d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:46.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.548+0000 7fa60dffb640 1 -- 172.21.15.27:0/3546414396 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (crc 0 0 0) 0x7fa614014b80 con 0x7fa6180723e0 2023-11-29T08:56:46.575 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.548+0000 7f9a59ffb640 1 -- 172.21.15.27:0/887189430 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2672+0+0 (crc 0 0 0) 0x7f9a60018040 con 0x7f9a64097960 2023-11-29T08:56:46.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.548+0000 7f048effd640 1 --2- 172.21.15.27:0/2698364545 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f049009efd0 0x7f049011cae0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:46.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.548+0000 7f895ffff640 1 --2- 172.21.15.27:0/3452739227 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f8948037860 0x7f8948039d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:56:46.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.548+0000 7fa60dffb640 1 --2- 172.21.15.27:0/3546414396 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7fa5fc037860 0x7fa5fc039d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:46.576 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.548+0000 7f9a6b91e640 1 -- 172.21.15.27:0/887189430 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a6412f710 con 0x7f9a64097960 2023-11-29T08:56:46.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.548+0000 7f9a68eb9640 1 --2- 172.21.15.27:0/887189430 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f9a48037860 0x7f9a48039d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:56:46.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.548+0000 7fa61ceb9640 1 --2- 172.21.15.27:0/3546414396 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7fa5fc037860 0x7fa5fc039d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:56:46.577 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.548+0000 7f895ffff640 1 --2- 172.21.15.27:0/3452739227 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f8948037860 0x7f8948039d70 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:46.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.549+0000 7fa61f91e640 1 -- 172.21.15.27:0/3546414396 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa618062350 con 0x7fa6180723e0 2023-11-29T08:56:46.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.549+0000 7f9a68eb9640 1 --2- 172.21.15.27:0/887189430 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f9a48037860 0x7f9a48039d70 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:46.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.549+0000 7fa61ceb9640 1 --2- 172.21.15.27:0/3546414396 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7fa5fc037860 0x7fa5fc039d70 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:46.578 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.552+0000 7fa60dffb640 1 -- 172.21.15.27:0/3546414396 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2672+0+0 (crc 0 0 0) 0x7fa614019040 con 0x7fa6180723e0 2023-11-29T08:56:46.579 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.552+0000 7f04777fe640 1 -- 172.21.15.27:0/2698364545 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f0480014620 con 0x7f049009efd0 2023-11-29T08:56:46.579 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.552+0000 7f895effd640 1 -- 172.21.15.27:0/3452739227 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (crc 0 0 0) 0x7f895800d190 con 0x7f8968097960 2023-11-29T08:56:46.579 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.553+0000 7f049562d640 1 -- 172.21.15.27:0/2698364545 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f049011db90 con 0x7f049009efd0 2023-11-29T08:56:46.579 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.553+0000 7f049562d640 1 -- 172.21.15.27:0/2698364545 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04901207f0 con 0x7f049009efd0 2023-11-29T08:56:46.580 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.554+0000 7f049562d640 1 -- 172.21.15.27:0/2698364545 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0490062350 con 0x7f049009efd0 2023-11-29T08:56:46.580 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.557+0000 7f9a59ffb640 1 -- 172.21.15.27:0/887189430 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (crc 0 0 0) 0x7f9a6000d9e0 con 0x7f9a64097960 2023-11-29T08:56:46.580 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.566+0000 7fa60dffb640 1 -- 172.21.15.27:0/3546414396 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (crc 0 0 0) 0x7fa614010310 con 0x7fa6180723e0 2023-11-29T08:56:46.581 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.566+0000 7f04777fe640 1 -- 172.21.15.27:0/2698364545 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f0480014780 con 0x7f049009efd0 2023-11-29T08:56:46.581 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.567+0000 7f04777fe640 1 -- 172.21.15.27:0/2698364545 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f0480014a20 con 0x7f049009efd0 2023-11-29T08:56:46.581 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.567+0000 7f04777fe640 1 -- 172.21.15.27:0/2698364545 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (crc 0 0 0) 0x7f0480014b80 con 0x7f049009efd0 2023-11-29T08:56:46.581 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.567+0000 7f04777fe640 1 --2- 172.21.15.27:0/2698364545 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f047c037820 0x7f047c039d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:46.581 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.567+0000 7f04777fe640 1 -- 172.21.15.27:0/2698364545 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2672+0+0 (crc 0 0 0) 0x7f0480019040 con 0x7f049009efd0 2023-11-29T08:56:46.581 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.568+0000 7f048e7fc640 1 --2- 172.21.15.27:0/2698364545 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f047c037820 0x7f047c039d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:56:46.581 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.568+0000 7f048e7fc640 1 --2- 172.21.15.27:0/2698364545 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f047c037820 0x7f047c039d30 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:46.582 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.576+0000 7f04777fe640 1 -- 172.21.15.27:0/2698364545 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (crc 0 0 0) 0x7f0480019e00 con 0x7f049009efd0 2023-11-29T08:56:46.752 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.751+0000 7f896cb1e640 1 -- 172.21.15.27:0/3452739227 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f89680670b0 con 0x7f8968097960 2023-11-29T08:56:46.753 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.751+0000 7f895effd640 1 -- 172.21.15.27:0/3452739227 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (crc 0 0 0) 0x7f895800d190 con 0x7f8968097960 2023-11-29T08:56:46.753 INFO:teuthology.orchestra.run.smithi027.stdout:38654705671 2023-11-29T08:56:46.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.753+0000 7f896cb1e640 1 -- 172.21.15.27:0/3452739227 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f8948037860 msgr2=0x7f8948039d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:46.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.753+0000 7f896cb1e640 1 --2- 172.21.15.27:0/3452739227 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f8948037860 0x7f8948039d70 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:46.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.753+0000 7f896cb1e640 1 -- 172.21.15.27:0/3452739227 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8968097960 msgr2=0x7f89681c8380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:46.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.753+0000 7f896cb1e640 1 --2- 172.21.15.27:0/3452739227 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8968097960 0x7f89681c8380 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:46.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.753+0000 7f896cb1e640 1 -- 172.21.15.27:0/3452739227 shutdown_connections 2023-11-29T08:56:46.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.753+0000 7f896cb1e640 1 --2- 172.21.15.27:0/3452739227 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f8948037860 0x7f8948039d70 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:46.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.753+0000 7f896cb1e640 1 --2- 172.21.15.27:0/3452739227 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8968097960 0x7f89681c8380 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:46.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.753+0000 7f896cb1e640 1 -- 172.21.15.27:0/3452739227 >> 172.21.15.27:0/3452739227 conn(0x7f896809dff0 msgr2=0x7f896809f130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T08:56:46.755 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.753+0000 7f896cb1e640 1 -- 172.21.15.27:0/3452739227 shutdown_connections 2023-11-29T08:56:46.756 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.753+0000 7f896cb1e640 1 -- 172.21.15.27:0/3452739227 wait complete. 2023-11-29T08:56:46.766 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.3 2023-11-29T08:56:46.767 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.764+0000 7fa61f91e640 1 -- 172.21.15.27:0/3546414396 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa618066f90 con 0x7fa6180723e0 2023-11-29T08:56:46.767 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.764+0000 7fa60dffb640 1 -- 172.21.15.27:0/3546414396 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (crc 0 0 0) 0x7fa61400e230 con 0x7fa6180723e0 2023-11-29T08:56:46.767 DEBUG:teuthology.parallel:result is None 2023-11-29T08:56:46.767 INFO:teuthology.orchestra.run.smithi027.stdout:38654705671 2023-11-29T08:56:46.768 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.766+0000 7fa61f91e640 1 -- 172.21.15.27:0/3546414396 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7fa5fc037860 msgr2=0x7fa5fc039d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:46.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.766+0000 7fa61f91e640 1 --2- 172.21.15.27:0/3546414396 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7fa5fc037860 0x7fa5fc039d70 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:46.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.766+0000 7fa61f91e640 1 -- 172.21.15.27:0/3546414396 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa6180723e0 msgr2=0x7fa61806b850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:46.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.766+0000 7fa61f91e640 1 --2- 172.21.15.27:0/3546414396 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa6180723e0 0x7fa61806b850 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:46.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.767+0000 7fa61f91e640 1 -- 172.21.15.27:0/3546414396 shutdown_connections 2023-11-29T08:56:46.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.767+0000 7fa61f91e640 1 --2- 172.21.15.27:0/3546414396 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7fa5fc037860 0x7fa5fc039d70 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:46.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.767+0000 7fa61f91e640 1 --2- 172.21.15.27:0/3546414396 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa6180723e0 0x7fa61806b850 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:46.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.767+0000 7fa61f91e640 1 -- 172.21.15.27:0/3546414396 >> 172.21.15.27:0/3546414396 conn(0x7fa618098a20 msgr2=0x7fa61812dc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T08:56:46.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.767+0000 7fa61f91e640 1 -- 172.21.15.27:0/3546414396 shutdown_connections 2023-11-29T08:56:46.769 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.767+0000 7fa61f91e640 1 -- 172.21.15.27:0/3546414396 wait complete. 2023-11-29T08:56:46.778 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.1 2023-11-29T08:56:46.779 DEBUG:teuthology.parallel:result is None 2023-11-29T08:56:46.790 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.789+0000 7f9a6b91e640 1 -- 172.21.15.27:0/887189430 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9a6409ef20 con 0x7f9a64097960 2023-11-29T08:56:46.791 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.789+0000 7f9a59ffb640 1 -- 172.21.15.27:0/887189430 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (crc 0 0 0) 0x7f9a6000d9e0 con 0x7f9a64097960 2023-11-29T08:56:46.791 INFO:teuthology.orchestra.run.smithi027.stdout:38654705671 2023-11-29T08:56:46.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.791+0000 7f9a6b91e640 1 -- 172.21.15.27:0/887189430 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f9a48037860 msgr2=0x7f9a48039d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:46.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.791+0000 7f9a6b91e640 1 --2- 172.21.15.27:0/887189430 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f9a48037860 0x7f9a48039d70 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:46.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.791+0000 7f9a6b91e640 1 -- 172.21.15.27:0/887189430 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9a64097960 msgr2=0x7f9a64094650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:46.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.791+0000 7f9a6b91e640 1 --2- 172.21.15.27:0/887189430 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9a64097960 0x7f9a64094650 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:46.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.791+0000 7f9a6b91e640 1 -- 172.21.15.27:0/887189430 shutdown_connections 2023-11-29T08:56:46.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.791+0000 7f9a6b91e640 1 --2- 172.21.15.27:0/887189430 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f9a48037860 0x7f9a48039d70 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:46.793 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.791+0000 7f9a6b91e640 1 --2- 172.21.15.27:0/887189430 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9a64097960 0x7f9a64094650 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:46.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.791+0000 7f9a6b91e640 1 -- 172.21.15.27:0/887189430 >> 172.21.15.27:0/887189430 conn(0x7f9a6409dff0 msgr2=0x7f9a6409f130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T08:56:46.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.791+0000 7f9a6b91e640 1 -- 172.21.15.27:0/887189430 shutdown_connections 2023-11-29T08:56:46.794 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.791+0000 7f9a6b91e640 1 -- 172.21.15.27:0/887189430 wait complete. 2023-11-29T08:56:46.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.797+0000 7f049562d640 1 -- 172.21.15.27:0/2698364545 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0490066eb0 con 0x7f049009efd0 2023-11-29T08:56:46.798 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.797+0000 7f04777fe640 1 -- 172.21.15.27:0/2698364545 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (crc 0 0 0) 0x7f04800199f0 con 0x7f049009efd0 2023-11-29T08:56:46.799 INFO:teuthology.orchestra.run.smithi027.stdout:38654705671 2023-11-29T08:56:46.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.799+0000 7f049562d640 1 -- 172.21.15.27:0/2698364545 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f047c037820 msgr2=0x7f047c039d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:46.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.799+0000 7f049562d640 1 --2- 172.21.15.27:0/2698364545 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f047c037820 0x7f047c039d30 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:46.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.799+0000 7f049562d640 1 -- 172.21.15.27:0/2698364545 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f049009efd0 msgr2=0x7f049011cae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:46.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.799+0000 7f049562d640 1 --2- 172.21.15.27:0/2698364545 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f049009efd0 0x7f049011cae0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:46.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.799+0000 7f049562d640 1 -- 172.21.15.27:0/2698364545 shutdown_connections 2023-11-29T08:56:46.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.799+0000 7f049562d640 1 --2- 172.21.15.27:0/2698364545 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f047c037820 0x7f047c039d30 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:46.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.799+0000 7f049562d640 1 --2- 172.21.15.27:0/2698364545 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f049009efd0 0x7f049011cae0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:46.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.799+0000 7f049562d640 1 -- 172.21.15.27:0/2698364545 >> 172.21.15.27:0/2698364545 conn(0x7f0490098a20 msgr2=0x7f049012e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T08:56:46.801 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.799+0000 7f049562d640 1 -- 172.21.15.27:0/2698364545 shutdown_connections 2023-11-29T08:56:46.802 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.799+0000 7f049562d640 1 -- 172.21.15.27:0/2698364545 wait complete. 2023-11-29T08:56:46.803 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.0 2023-11-29T08:56:46.803 DEBUG:teuthology.parallel:result is None 2023-11-29T08:56:46.811 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.2 2023-11-29T08:56:46.811 DEBUG:teuthology.parallel:result is None 2023-11-29T08:56:46.811 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-29T08:56:46.811 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-29T08:56:46.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.960+0000 7f6882b5e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:56:46.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.964+0000 7f6882b5e640 1 Processor -- start 2023-11-29T08:56:46.965 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.964+0000 7f6882b5e640 1 -- start start 2023-11-29T08:56:46.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.965+0000 7f6882b5e640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f687c12ff00 0x7f687c130310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:46.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.965+0000 7f6882b5e640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f687c09af50 con 0x7f687c12c500 2023-11-29T08:56:46.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.965+0000 7f6882b5e640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f687c12fa00 con 0x7f687c12ff00 2023-11-29T08:56:46.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.965+0000 7f68808fa640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f687c12ff00 0x7f687c130310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:56:46.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.965+0000 7f6873fff640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f687c12c500 0x7f687c12c910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:54266/0 (socket says 172.21.15.27:54266) 2023-11-29T08:56:46.967 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.965+0000 7f6873fff640 1 -- 172.21.15.27:0/213280460 learned_addr learned my addr 172.21.15.27:0/213280460 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-11-29T08:56:46.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.965+0000 7f68808fa640 1 -- 172.21.15.27:0/213280460 >> v1:172.21.15.27:6789/0 conn(0x7f687c12c500 legacy=0x7f687c12c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:46.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.965+0000 7f68808fa640 1 -- 172.21.15.27:0/213280460 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f687c06e220 con 0x7f687c12ff00 2023-11-29T08:56:46.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.965+0000 7f68808fa640 1 --2- 172.21.15.27:0/213280460 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f687c12ff00 0x7f687c130310 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b1be6b8fd22b01e server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:46.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.965+0000 7f68737fe640 1 -- 172.21.15.27:0/213280460 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f6878009ce0 con 0x7f687c12ff00 2023-11-29T08:56:46.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.965+0000 7f68737fe640 1 -- 172.21.15.27:0/213280460 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f6878009e40 con 0x7f687c12ff00 2023-11-29T08:56:46.968 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.965+0000 7f68737fe640 1 -- 172.21.15.27:0/213280460 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f687800e360 con 0x7f687c12ff00 2023-11-29T08:56:46.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.966+0000 7f6882b5e640 1 -- 172.21.15.27:0/213280460 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f687c12ff00 msgr2=0x7f687c130310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:46.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.966+0000 7f6882b5e640 1 --2- 172.21.15.27:0/213280460 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f687c12ff00 0x7f687c130310 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:46.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.966+0000 7f6882b5e640 1 -- 172.21.15.27:0/213280460 shutdown_connections 2023-11-29T08:56:46.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.966+0000 7f6882b5e640 1 --2- 172.21.15.27:0/213280460 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f687c12ff00 0x7f687c130310 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:46.969 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.966+0000 7f6882b5e640 1 -- 172.21.15.27:0/213280460 >> 172.21.15.27:0/213280460 conn(0x7f687c09dff0 msgr2=0x7f687c09e400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T08:56:46.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.966+0000 7f6882b5e640 1 -- 172.21.15.27:0/213280460 shutdown_connections 2023-11-29T08:56:46.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.966+0000 7f6882b5e640 1 -- 172.21.15.27:0/213280460 wait complete. 2023-11-29T08:56:46.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.966+0000 7f6882b5e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:56:46.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.967+0000 7f6882b5e640 1 Processor -- start 2023-11-29T08:56:46.970 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.967+0000 7f6882b5e640 1 -- start start 2023-11-29T08:56:46.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.968+0000 7f6882b5e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f687c12c500 0x7f687c070c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:46.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.968+0000 7f6882b5e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f687c070870 con 0x7f687c12c500 2023-11-29T08:56:46.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.968+0000 7f68808fa640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f687c12c500 0x7f687c070c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:56:46.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.968+0000 7f68808fa640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f687c12c500 0x7f687c070c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41094/0 (socket says 172.21.15.27:41094) 2023-11-29T08:56:46.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.968+0000 7f68808fa640 1 -- 172.21.15.27:0/4167405855 learned_addr learned my addr 172.21.15.27:0/4167405855 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-11-29T08:56:46.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.968+0000 7f68808fa640 1 -- 172.21.15.27:0/4167405855 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f687c071c20 con 0x7f687c12c500 2023-11-29T08:56:46.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.969+0000 7f68808fa640 1 --2- 172.21.15.27:0/4167405855 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f687c12c500 0x7f687c070c30 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:46.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.969+0000 7f68717fa640 1 -- 172.21.15.27:0/4167405855 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f6878014620 con 0x7f687c12c500 2023-11-29T08:56:46.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.969+0000 7f68717fa640 1 -- 172.21.15.27:0/4167405855 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f6878014780 con 0x7f687c12c500 2023-11-29T08:56:46.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.969+0000 7f68717fa640 1 -- 172.21.15.27:0/4167405855 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f6878014a20 con 0x7f687c12c500 2023-11-29T08:56:46.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.969+0000 7f6882b5e640 1 -- 172.21.15.27:0/4167405855 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f687c070230 con 0x7f687c12c500 2023-11-29T08:56:46.972 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.969+0000 7f6882b5e640 1 -- 172.21.15.27:0/4167405855 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f687c08b8a0 con 0x7f687c12c500 2023-11-29T08:56:46.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.970+0000 7f68717fa640 1 -- 172.21.15.27:0/4167405855 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (crc 0 0 0) 0x7f6878014bd0 con 0x7f687c12c500 2023-11-29T08:56:46.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.970+0000 7f6882b5e640 1 -- 172.21.15.27:0/4167405855 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f687c070670 con 0x7f687c12c500 2023-11-29T08:56:46.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.970+0000 7f68717fa640 1 --2- 172.21.15.27:0/4167405855 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f6868037810 0x7f6868039d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:46.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.970+0000 7f68717fa640 1 -- 172.21.15.27:0/4167405855 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2672+0+0 (crc 0 0 0) 0x7f6878019040 con 0x7f687c12c500 2023-11-29T08:56:46.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.970+0000 7f6873fff640 1 --2- 172.21.15.27:0/4167405855 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f6868037810 0x7f6868039d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:56:46.973 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.971+0000 7f6873fff640 1 --2- 172.21.15.27:0/4167405855 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f6868037810 0x7f6868039d20 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:46.976 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:46.975+0000 7f68717fa640 1 -- 172.21.15.27:0/4167405855 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (crc 0 0 0) 0x7f687800ee30 con 0x7f687c12c500 2023-11-29T08:56:47.149 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.147+0000 7f6882b5e640 1 -- 172.21.15.27:0/4167405855 --> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f687c12c190 con 0x7f6868037810 2023-11-29T08:56:47.150 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.149+0000 7f68717fa640 1 -- 172.21.15.27:0/4167405855 <== mgr.4099 v2:172.21.15.139:6800/2461689012 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+30047 (crc 0 0 0) 0x7f687c12c190 con 0x7f6868037810 2023-11-29T08:56:47.151 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:56:47.151 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-11-29T08:56:47.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.151+0000 7f6882b5e640 1 -- 172.21.15.27:0/4167405855 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f6868037810 msgr2=0x7f6868039d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:47.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.151+0000 7f6882b5e640 1 --2- 172.21.15.27:0/4167405855 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f6868037810 0x7f6868039d20 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:47.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.151+0000 7f6882b5e640 1 -- 172.21.15.27:0/4167405855 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f687c12c500 msgr2=0x7f687c070c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:47.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.151+0000 7f6882b5e640 1 --2- 172.21.15.27:0/4167405855 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f687c12c500 0x7f687c070c30 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:47.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.151+0000 7f6882b5e640 1 -- 172.21.15.27:0/4167405855 shutdown_connections 2023-11-29T08:56:47.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.151+0000 7f6882b5e640 1 --2- 172.21.15.27:0/4167405855 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f6868037810 0x7f6868039d20 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:47.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.151+0000 7f6882b5e640 1 --2- 172.21.15.27:0/4167405855 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f687c12c500 0x7f687c070c30 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:47.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.151+0000 7f6882b5e640 1 -- 172.21.15.27:0/4167405855 >> 172.21.15.27:0/4167405855 conn(0x7f687c09dff0 msgr2=0x7f687c099590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T08:56:47.153 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.151+0000 7f6882b5e640 1 -- 172.21.15.27:0/4167405855 shutdown_connections 2023-11-29T08:56:47.154 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.151+0000 7f6882b5e640 1 -- 172.21.15.27:0/4167405855 wait complete. 2023-11-29T08:56:47.163 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":12,"stamp":"2023-11-29T08:56:47.034102+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":419430400,"kb_used":109584,"kb_used_data":1400,"kb_used_omap":0,"kb_used_meta":107776,"kb_avail":419320816,"statfs":{"total":429496729600,"available":429384515584,"internally_reserved":0,"allocated":1433600,"data_stored":1268108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":110362624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.690335"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-11-29T08:56:45.243101+0000","last_change":"2023-11-29T08:56:45.243589+0000","last_active":"2023-11-29T08:56:45.243101+0000","last_peered":"2023-11-29T08:56:45.243101+0000","last_clean":"2023-11-29T08:56:44.152872+0000","last_became_active":"2023-11-29T08:56:45.232329+0000","last_became_peered":"2023-11-29T08:56:45.232329+0000","last_unstale":"2023-11-29T08:56:45.243101+0000","last_undegraded":"2023-11-29T08:56:45.243101+0000","last_fullsized":"2023-11-29T08:56:45.243101+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T08:56:44.152872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T08:56:44.152872+0000","last_clean_scrub_stamp":"2023-11-29T08:56:44.152872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-11-29T08:56:46.182165+0000","last_change":"2023-11-29T08:56:45.231912+0000","last_active":"2023-11-29T08:56:46.182165+0000","last_peered":"2023-11-29T08:56:46.182165+0000","last_clean":"2023-11-29T08:56:46.182165+0000","last_became_active":"2023-11-29T08:56:45.228821+0000","last_became_peered":"2023-11-29T08:56:45.228821+0000","last_unstale":"2023-11-29T08:56:46.182165+0000","last_undegraded":"2023-11-29T08:56:46.182165+0000","last_fullsized":"2023-11-29T08:56:46.182165+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T08:56:44.152872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T08:56:44.152872+0000","last_clean_scrub_stamp":"2023-11-29T08:56:44.152872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-11-29T08:56:45.226836+0000","last_change":"2023-11-29T08:56:45.227207+0000","last_active":"2023-11-29T08:56:45.226836+0000","last_peered":"2023-11-29T08:56:45.226836+0000","last_clean":"2023-11-29T08:56:44.152872+0000","last_became_active":"2023-11-29T08:56:45.224395+0000","last_became_peered":"2023-11-29T08:56:45.224395+0000","last_unstale":"2023-11-29T08:56:45.226836+0000","last_undegraded":"2023-11-29T08:56:45.226836+0000","last_fullsized":"2023-11-29T08:56:45.226836+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T08:56:44.152872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T08:56:44.152872+0000","last_clean_scrub_stamp":"2023-11-29T08:56:44.152872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-11-29T08:56:46.183427+0000","last_change":"2023-11-29T08:56:45.226196+0000","last_active":"2023-11-29T08:56:46.183427+0000","last_peered":"2023-11-29T08:56:46.183427+0000","last_clean":"2023-11-29T08:56:46.183427+0000","last_became_active":"2023-11-29T08:56:45.214418+0000","last_became_peered":"2023-11-29T08:56:45.214418+0000","last_unstale":"2023-11-29T08:56:46.183427+0000","last_undegraded":"2023-11-29T08:56:46.183427+0000","last_fullsized":"2023-11-29T08:56:46.183427+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T08:56:44.152872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T08:56:44.152872+0000","last_clean_scrub_stamp":"2023-11-29T08:56:44.152872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-11-29T08:56:45.232796+0000","last_change":"2023-11-29T08:56:45.233167+0000","last_active":"2023-11-29T08:56:45.232796+0000","last_peered":"2023-11-29T08:56:45.232796+0000","last_clean":"2023-11-29T08:56:44.152872+0000","last_became_active":"2023-11-29T08:56:45.230265+0000","last_became_peered":"2023-11-29T08:56:45.230265+0000","last_unstale":"2023-11-29T08:56:45.232796+0000","last_undegraded":"2023-11-29T08:56:45.232796+0000","last_fullsized":"2023-11-29T08:56:45.232796+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T08:56:44.152872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T08:56:44.152872+0000","last_clean_scrub_stamp":"2023-11-29T08:56:44.152872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-11-29T08:56:45.220537+0000","last_change":"2023-11-29T08:56:45.221147+0000","last_active":"2023-11-29T08:56:45.220537+0000","last_peered":"2023-11-29T08:56:45.220537+0000","last_clean":"2023-11-29T08:56:44.152872+0000","last_became_active":"2023-11-29T08:56:45.217358+0000","last_became_peered":"2023-11-29T08:56:45.217358+0000","last_unstale":"2023-11-29T08:56:45.220537+0000","last_undegraded":"2023-11-29T08:56:45.220537+0000","last_fullsized":"2023-11-29T08:56:45.220537+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T08:56:44.152872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T08:56:44.152872+0000","last_clean_scrub_stamp":"2023-11-29T08:56:44.152872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-11-29T08:56:45.229296+0000","last_change":"2023-11-29T08:56:45.229697+0000","last_active":"2023-11-29T08:56:45.229296+0000","last_peered":"2023-11-29T08:56:45.229296+0000","last_clean":"2023-11-29T08:56:44.152872+0000","last_became_active":"2023-11-29T08:56:45.226265+0000","last_became_peered":"2023-11-29T08:56:45.226265+0000","last_unstale":"2023-11-29T08:56:45.229296+0000","last_undegraded":"2023-11-29T08:56:45.229296+0000","last_fullsized":"2023-11-29T08:56:45.229296+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T08:56:44.152872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T08:56:44.152872+0000","last_clean_scrub_stamp":"2023-11-29T08:56:44.152872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-11-29T08:56:45.250744+0000","last_change":"2023-11-29T08:56:45.251131+0000","last_active":"2023-11-29T08:56:45.250744+0000","last_peered":"2023-11-29T08:56:45.250744+0000","last_clean":"2023-11-29T08:56:44.152872+0000","last_became_active":"2023-11-29T08:56:45.248194+0000","last_became_peered":"2023-11-29T08:56:45.248194+0000","last_unstale":"2023-11-29T08:56:45.250744+0000","last_undegraded":"2023-11-29T08:56:45.250744+0000","last_fullsized":"2023-11-29T08:56:45.250744+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T08:56:44.152872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T08:56:44.152872+0000","last_clean_scrub_stamp":"2023-11-29T08:56:44.152872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":141,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-11-29T08:56:45.171538+0000","last_change":"2023-11-29T08:56:42.178844+0000","last_active":"2023-11-29T08:56:45.171538+0000","last_peered":"2023-11-29T08:56:45.171538+0000","last_clean":"2023-11-29T08:56:45.171538+0000","last_became_active":"2023-11-29T08:56:42.175282+0000","last_became_peered":"2023-11-29T08:56:42.175282+0000","last_unstale":"2023-11-29T08:56:45.171538+0000","last_undegraded":"2023-11-29T08:56:45.171538+0000","last_fullsized":"2023-11-29T08:56:45.171538+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T08:56:41.142076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T08:56:41.142076+0000","last_clean_scrub_stamp":"2023-11-29T08:56:41.142076+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27780,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104829820,"statfs":{"total":107374182400,"available":107345735680,"internally_reserved":0,"allocated":655360,"data_stored":612211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27012,"kb_used_data":60,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104830588,"statfs":{"total":107374182400,"available":107346522112,"internally_reserved":0,"allocated":61440,"data_stored":21843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":1,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27012,"kb_used_data":60,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104830588,"statfs":{"total":107374182400,"available":107346522112,"internally_reserved":0,"allocated":61440,"data_stored":21843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27780,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104829820,"statfs":{"total":107374182400,"available":107345735680,"internally_reserved":0,"allocated":655360,"data_stored":612211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]}],"pool_statfs":[]}} 2023-11-29T08:56:47.164 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-29T08:56:47.276 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.271+0000 7f0a664ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:56:47.276 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.275+0000 7f0a664ad640 1 Processor -- start 2023-11-29T08:56:47.276 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.275+0000 7f0a664ad640 1 -- start start 2023-11-29T08:56:47.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.276+0000 7f0a664ad640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0a60132d70 0x7f0a60135190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:47.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.276+0000 7f0a664ad640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a6009af50 con 0x7f0a6012ff00 2023-11-29T08:56:47.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.276+0000 7f0a664ad640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a6012fa00 con 0x7f0a60132d70 2023-11-29T08:56:47.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.276+0000 7f0a5f7fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0a60132d70 0x7f0a60135190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:56:47.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.276+0000 7f0a5ffff640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f0a6012ff00 0x7f0a60130310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:54268/0 (socket says 172.21.15.27:54268) 2023-11-29T08:56:47.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.276+0000 7f0a5ffff640 1 -- 172.21.15.27:0/3045800991 learned_addr learned my addr 172.21.15.27:0/3045800991 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-11-29T08:56:47.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.276+0000 7f0a5f7fe640 1 -- 172.21.15.27:0/3045800991 >> v1:172.21.15.27:6789/0 conn(0x7f0a6012ff00 legacy=0x7f0a60130310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:47.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.276+0000 7f0a5f7fe640 1 -- 172.21.15.27:0/3045800991 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a6006e220 con 0x7f0a60132d70 2023-11-29T08:56:47.279 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.276+0000 7f0a5f7fe640 1 --2- 172.21.15.27:0/3045800991 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0a60132d70 0x7f0a60135190 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=229285f478e77cf0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:47.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.276+0000 7f0a5effd640 1 -- 172.21.15.27:0/3045800991 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f0a50009ce0 con 0x7f0a60132d70 2023-11-29T08:56:47.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.276+0000 7f0a5effd640 1 -- 172.21.15.27:0/3045800991 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f0a50009e40 con 0x7f0a60132d70 2023-11-29T08:56:47.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.276+0000 7f0a5effd640 1 -- 172.21.15.27:0/3045800991 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f0a5000e360 con 0x7f0a60132d70 2023-11-29T08:56:47.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.277+0000 7f0a664ad640 1 -- 172.21.15.27:0/3045800991 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0a60132d70 msgr2=0x7f0a60135190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:47.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.277+0000 7f0a664ad640 1 --2- 172.21.15.27:0/3045800991 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0a60132d70 0x7f0a60135190 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:47.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.277+0000 7f0a664ad640 1 -- 172.21.15.27:0/3045800991 shutdown_connections 2023-11-29T08:56:47.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.277+0000 7f0a664ad640 1 --2- 172.21.15.27:0/3045800991 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0a60132d70 0x7f0a60135190 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:47.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.277+0000 7f0a664ad640 1 -- 172.21.15.27:0/3045800991 >> 172.21.15.27:0/3045800991 conn(0x7f0a6009dff0 msgr2=0x7f0a6009e400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T08:56:47.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.277+0000 7f0a664ad640 1 -- 172.21.15.27:0/3045800991 shutdown_connections 2023-11-29T08:56:47.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.277+0000 7f0a664ad640 1 -- 172.21.15.27:0/3045800991 wait complete. 2023-11-29T08:56:47.280 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.277+0000 7f0a664ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:56:47.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.278+0000 7f0a664ad640 1 Processor -- start 2023-11-29T08:56:47.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.278+0000 7f0a664ad640 1 -- start start 2023-11-29T08:56:47.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.279+0000 7f0a664ad640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0a6012ff00 0x7f0a601c1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:47.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.279+0000 7f0a664ad640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a60129570 con 0x7f0a6012ff00 2023-11-29T08:56:47.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.279+0000 7f0a5ffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0a6012ff00 0x7f0a601c1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:56:47.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.279+0000 7f0a5ffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0a6012ff00 0x7f0a601c1be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41112/0 (socket says 172.21.15.27:41112) 2023-11-29T08:56:47.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.279+0000 7f0a5ffff640 1 -- 172.21.15.27:0/3940305992 learned_addr learned my addr 172.21.15.27:0/3940305992 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-11-29T08:56:47.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.279+0000 7f0a5ffff640 1 -- 172.21.15.27:0/3940305992 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a60129850 con 0x7f0a6012ff00 2023-11-29T08:56:47.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.280+0000 7f0a5ffff640 1 --2- 172.21.15.27:0/3940305992 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0a6012ff00 0x7f0a601c1be0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:47.282 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.280+0000 7f0a5cff9640 1 -- 172.21.15.27:0/3940305992 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f0a48005be0 con 0x7f0a6012ff00 2023-11-29T08:56:47.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.280+0000 7f0a5cff9640 1 -- 172.21.15.27:0/3940305992 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f0a48005d40 con 0x7f0a6012ff00 2023-11-29T08:56:47.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.280+0000 7f0a664ad640 1 -- 172.21.15.27:0/3940305992 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a6006f330 con 0x7f0a6012ff00 2023-11-29T08:56:47.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.280+0000 7f0a5cff9640 1 -- 172.21.15.27:0/3940305992 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f0a4800e850 con 0x7f0a6012ff00 2023-11-29T08:56:47.283 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.280+0000 7f0a664ad640 1 -- 172.21.15.27:0/3940305992 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a6006e930 con 0x7f0a6012ff00 2023-11-29T08:56:47.284 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.281+0000 7f0a5cff9640 1 -- 172.21.15.27:0/3940305992 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (crc 0 0 0) 0x7f0a4800ea40 con 0x7f0a6012ff00 2023-11-29T08:56:47.284 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.281+0000 7f0a664ad640 1 -- 172.21.15.27:0/3940305992 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a601299e0 con 0x7f0a6012ff00 2023-11-29T08:56:47.284 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.281+0000 7f0a5cff9640 1 --2- 172.21.15.27:0/3940305992 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f0a40037810 0x7f0a40039d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:47.284 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.281+0000 7f0a5cff9640 1 -- 172.21.15.27:0/3940305992 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2672+0+0 (crc 0 0 0) 0x7f0a48049530 con 0x7f0a6012ff00 2023-11-29T08:56:47.284 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.281+0000 7f0a5f7fe640 1 --2- 172.21.15.27:0/3940305992 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f0a40037810 0x7f0a40039d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:56:47.284 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.282+0000 7f0a5f7fe640 1 --2- 172.21.15.27:0/3940305992 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f0a40037810 0x7f0a40039d20 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:47.287 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.285+0000 7f0a5cff9640 1 -- 172.21.15.27:0/3940305992 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (crc 0 0 0) 0x7f0a48001060 con 0x7f0a6012ff00 2023-11-29T08:56:47.461 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.459+0000 7f0a664ad640 1 -- 172.21.15.27:0/3940305992 --> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0a6006d840 con 0x7f0a40037810 2023-11-29T08:56:47.463 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.462+0000 7f0a5cff9640 1 -- 172.21.15.27:0/3940305992 <== mgr.4099 v2:172.21.15.139:6800/2461689012 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+30047 (crc 0 0 0) 0x7f0a50009bb0 con 0x7f0a40037810 2023-11-29T08:56:47.463 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:56:47.463 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2023-11-29T08:56:47.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.463+0000 7f0a664ad640 1 -- 172.21.15.27:0/3940305992 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f0a40037810 msgr2=0x7f0a40039d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:47.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.463+0000 7f0a664ad640 1 --2- 172.21.15.27:0/3940305992 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f0a40037810 0x7f0a40039d20 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:47.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.463+0000 7f0a664ad640 1 -- 172.21.15.27:0/3940305992 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0a6012ff00 msgr2=0x7f0a601c1be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:47.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.463+0000 7f0a664ad640 1 --2- 172.21.15.27:0/3940305992 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0a6012ff00 0x7f0a601c1be0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:47.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.463+0000 7f0a664ad640 1 -- 172.21.15.27:0/3940305992 shutdown_connections 2023-11-29T08:56:47.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.463+0000 7f0a664ad640 1 --2- 172.21.15.27:0/3940305992 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f0a40037810 0x7f0a40039d20 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:47.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.463+0000 7f0a664ad640 1 --2- 172.21.15.27:0/3940305992 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0a6012ff00 0x7f0a601c1be0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:47.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.463+0000 7f0a664ad640 1 -- 172.21.15.27:0/3940305992 >> 172.21.15.27:0/3940305992 conn(0x7f0a6009dff0 msgr2=0x7f0a60130d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T08:56:47.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.463+0000 7f0a664ad640 1 -- 172.21.15.27:0/3940305992 shutdown_connections 2023-11-29T08:56:47.465 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.463+0000 7f0a664ad640 1 -- 172.21.15.27:0/3940305992 wait complete. 2023-11-29T08:56:47.475 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":12,"stamp":"2023-11-29T08:56:47.034102+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":419430400,"kb_used":109584,"kb_used_data":1400,"kb_used_omap":0,"kb_used_meta":107776,"kb_avail":419320816,"statfs":{"total":429496729600,"available":429384515584,"internally_reserved":0,"allocated":1433600,"data_stored":1268108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":110362624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.690335"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-11-29T08:56:45.243101+0000","last_change":"2023-11-29T08:56:45.243589+0000","last_active":"2023-11-29T08:56:45.243101+0000","last_peered":"2023-11-29T08:56:45.243101+0000","last_clean":"2023-11-29T08:56:44.152872+0000","last_became_active":"2023-11-29T08:56:45.232329+0000","last_became_peered":"2023-11-29T08:56:45.232329+0000","last_unstale":"2023-11-29T08:56:45.243101+0000","last_undegraded":"2023-11-29T08:56:45.243101+0000","last_fullsized":"2023-11-29T08:56:45.243101+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T08:56:44.152872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T08:56:44.152872+0000","last_clean_scrub_stamp":"2023-11-29T08:56:44.152872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-11-29T08:56:46.182165+0000","last_change":"2023-11-29T08:56:45.231912+0000","last_active":"2023-11-29T08:56:46.182165+0000","last_peered":"2023-11-29T08:56:46.182165+0000","last_clean":"2023-11-29T08:56:46.182165+0000","last_became_active":"2023-11-29T08:56:45.228821+0000","last_became_peered":"2023-11-29T08:56:45.228821+0000","last_unstale":"2023-11-29T08:56:46.182165+0000","last_undegraded":"2023-11-29T08:56:46.182165+0000","last_fullsized":"2023-11-29T08:56:46.182165+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T08:56:44.152872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T08:56:44.152872+0000","last_clean_scrub_stamp":"2023-11-29T08:56:44.152872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-11-29T08:56:45.226836+0000","last_change":"2023-11-29T08:56:45.227207+0000","last_active":"2023-11-29T08:56:45.226836+0000","last_peered":"2023-11-29T08:56:45.226836+0000","last_clean":"2023-11-29T08:56:44.152872+0000","last_became_active":"2023-11-29T08:56:45.224395+0000","last_became_peered":"2023-11-29T08:56:45.224395+0000","last_unstale":"2023-11-29T08:56:45.226836+0000","last_undegraded":"2023-11-29T08:56:45.226836+0000","last_fullsized":"2023-11-29T08:56:45.226836+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T08:56:44.152872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T08:56:44.152872+0000","last_clean_scrub_stamp":"2023-11-29T08:56:44.152872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-11-29T08:56:46.183427+0000","last_change":"2023-11-29T08:56:45.226196+0000","last_active":"2023-11-29T08:56:46.183427+0000","last_peered":"2023-11-29T08:56:46.183427+0000","last_clean":"2023-11-29T08:56:46.183427+0000","last_became_active":"2023-11-29T08:56:45.214418+0000","last_became_peered":"2023-11-29T08:56:45.214418+0000","last_unstale":"2023-11-29T08:56:46.183427+0000","last_undegraded":"2023-11-29T08:56:46.183427+0000","last_fullsized":"2023-11-29T08:56:46.183427+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T08:56:44.152872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T08:56:44.152872+0000","last_clean_scrub_stamp":"2023-11-29T08:56:44.152872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-11-29T08:56:45.232796+0000","last_change":"2023-11-29T08:56:45.233167+0000","last_active":"2023-11-29T08:56:45.232796+0000","last_peered":"2023-11-29T08:56:45.232796+0000","last_clean":"2023-11-29T08:56:44.152872+0000","last_became_active":"2023-11-29T08:56:45.230265+0000","last_became_peered":"2023-11-29T08:56:45.230265+0000","last_unstale":"2023-11-29T08:56:45.232796+0000","last_undegraded":"2023-11-29T08:56:45.232796+0000","last_fullsized":"2023-11-29T08:56:45.232796+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T08:56:44.152872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T08:56:44.152872+0000","last_clean_scrub_stamp":"2023-11-29T08:56:44.152872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-11-29T08:56:45.220537+0000","last_change":"2023-11-29T08:56:45.221147+0000","last_active":"2023-11-29T08:56:45.220537+0000","last_peered":"2023-11-29T08:56:45.220537+0000","last_clean":"2023-11-29T08:56:44.152872+0000","last_became_active":"2023-11-29T08:56:45.217358+0000","last_became_peered":"2023-11-29T08:56:45.217358+0000","last_unstale":"2023-11-29T08:56:45.220537+0000","last_undegraded":"2023-11-29T08:56:45.220537+0000","last_fullsized":"2023-11-29T08:56:45.220537+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T08:56:44.152872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T08:56:44.152872+0000","last_clean_scrub_stamp":"2023-11-29T08:56:44.152872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-11-29T08:56:45.229296+0000","last_change":"2023-11-29T08:56:45.229697+0000","last_active":"2023-11-29T08:56:45.229296+0000","last_peered":"2023-11-29T08:56:45.229296+0000","last_clean":"2023-11-29T08:56:44.152872+0000","last_became_active":"2023-11-29T08:56:45.226265+0000","last_became_peered":"2023-11-29T08:56:45.226265+0000","last_unstale":"2023-11-29T08:56:45.229296+0000","last_undegraded":"2023-11-29T08:56:45.229296+0000","last_fullsized":"2023-11-29T08:56:45.229296+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T08:56:44.152872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T08:56:44.152872+0000","last_clean_scrub_stamp":"2023-11-29T08:56:44.152872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-11-29T08:56:45.250744+0000","last_change":"2023-11-29T08:56:45.251131+0000","last_active":"2023-11-29T08:56:45.250744+0000","last_peered":"2023-11-29T08:56:45.250744+0000","last_clean":"2023-11-29T08:56:44.152872+0000","last_became_active":"2023-11-29T08:56:45.248194+0000","last_became_peered":"2023-11-29T08:56:45.248194+0000","last_unstale":"2023-11-29T08:56:45.250744+0000","last_undegraded":"2023-11-29T08:56:45.250744+0000","last_fullsized":"2023-11-29T08:56:45.250744+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T08:56:44.152872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T08:56:44.152872+0000","last_clean_scrub_stamp":"2023-11-29T08:56:44.152872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":141,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-11-29T08:56:45.171538+0000","last_change":"2023-11-29T08:56:42.178844+0000","last_active":"2023-11-29T08:56:45.171538+0000","last_peered":"2023-11-29T08:56:45.171538+0000","last_clean":"2023-11-29T08:56:45.171538+0000","last_became_active":"2023-11-29T08:56:42.175282+0000","last_became_peered":"2023-11-29T08:56:42.175282+0000","last_unstale":"2023-11-29T08:56:45.171538+0000","last_undegraded":"2023-11-29T08:56:45.171538+0000","last_fullsized":"2023-11-29T08:56:45.171538+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T08:56:41.142076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T08:56:41.142076+0000","last_clean_scrub_stamp":"2023-11-29T08:56:41.142076+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27780,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104829820,"statfs":{"total":107374182400,"available":107345735680,"internally_reserved":0,"allocated":655360,"data_stored":612211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27012,"kb_used_data":60,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104830588,"statfs":{"total":107374182400,"available":107346522112,"internally_reserved":0,"allocated":61440,"data_stored":21843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":1,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27012,"kb_used_data":60,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104830588,"statfs":{"total":107374182400,"available":107346522112,"internally_reserved":0,"allocated":61440,"data_stored":21843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27780,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104829820,"statfs":{"total":107374182400,"available":107345735680,"internally_reserved":0,"allocated":655360,"data_stored":612211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]}],"pool_statfs":[]}} 2023-11-29T08:56:47.475 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-29T08:56:47.475 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-11-29T08:56:47.476 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-11-29T08:56:47.476 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-29T08:56:47.586 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.582+0000 7f0f4255e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:56:47.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.585+0000 7f0f4255e640 1 Processor -- start 2023-11-29T08:56:47.587 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.585+0000 7f0f4255e640 1 -- start start 2023-11-29T08:56:47.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.586+0000 7f0f4255e640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0f3c132d70 0x7f0f3c135190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:47.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.586+0000 7f0f4255e640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f3c09af50 con 0x7f0f3c12ff00 2023-11-29T08:56:47.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.586+0000 7f0f4255e640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f3c12fa00 con 0x7f0f3c132d70 2023-11-29T08:56:47.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.586+0000 7f0f3b7fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0f3c132d70 0x7f0f3c135190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:56:47.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.586+0000 7f0f3bfff640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f0f3c12ff00 0x7f0f3c130310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:54284/0 (socket says 172.21.15.27:54284) 2023-11-29T08:56:47.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.586+0000 7f0f3bfff640 1 -- 172.21.15.27:0/3529752398 learned_addr learned my addr 172.21.15.27:0/3529752398 (peer_addr_for_me v1:172.21.15.27:0/0) 2023-11-29T08:56:47.588 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.586+0000 7f0f3b7fe640 1 -- 172.21.15.27:0/3529752398 >> v1:172.21.15.27:6789/0 conn(0x7f0f3c12ff00 legacy=0x7f0f3c130310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:47.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.586+0000 7f0f3b7fe640 1 -- 172.21.15.27:0/3529752398 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f3c06e220 con 0x7f0f3c132d70 2023-11-29T08:56:47.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.586+0000 7f0f3b7fe640 1 --2- 172.21.15.27:0/3529752398 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f3c132d70 0x7f0f3c135190 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2490a1da94a24177 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:47.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.586+0000 7f0f3affd640 1 -- 172.21.15.27:0/3529752398 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f0f24009ce0 con 0x7f0f3c132d70 2023-11-29T08:56:47.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.586+0000 7f0f3affd640 1 -- 172.21.15.27:0/3529752398 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f0f24009e40 con 0x7f0f3c132d70 2023-11-29T08:56:47.589 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.586+0000 7f0f3affd640 1 -- 172.21.15.27:0/3529752398 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f0f2400e360 con 0x7f0f3c132d70 2023-11-29T08:56:47.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.587+0000 7f0f4255e640 1 -- 172.21.15.27:0/3529752398 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f3c132d70 msgr2=0x7f0f3c135190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:47.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.587+0000 7f0f4255e640 1 --2- 172.21.15.27:0/3529752398 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f3c132d70 0x7f0f3c135190 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:47.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.587+0000 7f0f4255e640 1 -- 172.21.15.27:0/3529752398 shutdown_connections 2023-11-29T08:56:47.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.587+0000 7f0f4255e640 1 --2- 172.21.15.27:0/3529752398 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f3c132d70 0x7f0f3c135190 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:47.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.587+0000 7f0f4255e640 1 -- 172.21.15.27:0/3529752398 >> 172.21.15.27:0/3529752398 conn(0x7f0f3c09dff0 msgr2=0x7f0f3c09e400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T08:56:47.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.587+0000 7f0f4255e640 1 -- 172.21.15.27:0/3529752398 shutdown_connections 2023-11-29T08:56:47.590 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.587+0000 7f0f4255e640 1 -- 172.21.15.27:0/3529752398 wait complete. 2023-11-29T08:56:47.591 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.587+0000 7f0f4255e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:56:47.591 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.588+0000 7f0f4255e640 1 Processor -- start 2023-11-29T08:56:47.591 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.589+0000 7f0f4255e640 1 -- start start 2023-11-29T08:56:47.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.589+0000 7f0f4255e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f3c12ff00 0x7f0f3c126e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:47.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.589+0000 7f0f4255e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3c097cd0 con 0x7f0f3c12ff00 2023-11-29T08:56:47.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.589+0000 7f0f3bfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f3c12ff00 0x7f0f3c126e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:56:47.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.589+0000 7f0f3bfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f3c12ff00 0x7f0f3c126e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41124/0 (socket says 172.21.15.27:41124) 2023-11-29T08:56:47.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.589+0000 7f0f3bfff640 1 -- 172.21.15.27:0/3490522779 learned_addr learned my addr 172.21.15.27:0/3490522779 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-11-29T08:56:47.592 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.590+0000 7f0f3bfff640 1 -- 172.21.15.27:0/3490522779 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f3c097f50 con 0x7f0f3c12ff00 2023-11-29T08:56:47.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.590+0000 7f0f3bfff640 1 --2- 172.21.15.27:0/3490522779 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f3c12ff00 0x7f0f3c126e90 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:47.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.590+0000 7f0f38ff9640 1 -- 172.21.15.27:0/3490522779 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f0f2c0059d0 con 0x7f0f3c12ff00 2023-11-29T08:56:47.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.590+0000 7f0f38ff9640 1 -- 172.21.15.27:0/3490522779 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f0f2c005b30 con 0x7f0f3c12ff00 2023-11-29T08:56:47.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.590+0000 7f0f4255e640 1 -- 172.21.15.27:0/3490522779 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f3c129ce0 con 0x7f0f3c12ff00 2023-11-29T08:56:47.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.590+0000 7f0f38ff9640 1 -- 172.21.15.27:0/3490522779 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f0f2c005dd0 con 0x7f0f3c12ff00 2023-11-29T08:56:47.593 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.590+0000 7f0f4255e640 1 -- 172.21.15.27:0/3490522779 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f3c128630 con 0x7f0f3c12ff00 2023-11-29T08:56:47.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.591+0000 7f0f38ff9640 1 -- 172.21.15.27:0/3490522779 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (crc 0 0 0) 0x7f0f2c0070b0 con 0x7f0f3c12ff00 2023-11-29T08:56:47.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.591+0000 7f0f4255e640 1 -- 172.21.15.27:0/3490522779 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f3c098d70 con 0x7f0f3c12ff00 2023-11-29T08:56:47.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.591+0000 7f0f38ff9640 1 --2- 172.21.15.27:0/3490522779 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f0f1c037810 0x7f0f1c039d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:56:47.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.591+0000 7f0f38ff9640 1 -- 172.21.15.27:0/3490522779 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2672+0+0 (crc 0 0 0) 0x7f0f2c046b90 con 0x7f0f3c12ff00 2023-11-29T08:56:47.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.591+0000 7f0f3b7fe640 1 --2- 172.21.15.27:0/3490522779 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f0f1c037810 0x7f0f1c039d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:56:47.594 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.592+0000 7f0f3b7fe640 1 --2- 172.21.15.27:0/3490522779 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f0f1c037810 0x7f0f1c039d20 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:56:47.597 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.596+0000 7f0f38ff9640 1 -- 172.21.15.27:0/3490522779 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (crc 0 0 0) 0x7f0f2c00d330 con 0x7f0f3c12ff00 2023-11-29T08:56:47.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.807+0000 7f0f4255e640 1 -- 172.21.15.27:0/3490522779 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f0f3c062350 con 0x7f0f3c12ff00 2023-11-29T08:56:47.809 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.807+0000 7f0f38ff9640 1 -- 172.21.15.27:0/3490522779 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (crc 0 0 0) 0x7f0f2c00d150 con 0x7f0f3c12ff00 2023-11-29T08:56:47.809 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-11-29T08:56:47.809 INFO:teuthology.orchestra.run.smithi027.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-11-29T08:56:47.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.810+0000 7f0f4255e640 1 -- 172.21.15.27:0/3490522779 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f0f1c037810 msgr2=0x7f0f1c039d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:47.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.810+0000 7f0f4255e640 1 --2- 172.21.15.27:0/3490522779 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f0f1c037810 0x7f0f1c039d20 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:47.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.810+0000 7f0f4255e640 1 -- 172.21.15.27:0/3490522779 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f3c12ff00 msgr2=0x7f0f3c126e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:56:47.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.810+0000 7f0f4255e640 1 --2- 172.21.15.27:0/3490522779 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f3c12ff00 0x7f0f3c126e90 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:47.812 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.810+0000 7f0f4255e640 1 -- 172.21.15.27:0/3490522779 shutdown_connections 2023-11-29T08:56:47.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.810+0000 7f0f4255e640 1 --2- 172.21.15.27:0/3490522779 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7f0f1c037810 0x7f0f1c039d20 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:47.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.810+0000 7f0f4255e640 1 --2- 172.21.15.27:0/3490522779 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f3c12ff00 0x7f0f3c126e90 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:56:47.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.810+0000 7f0f4255e640 1 -- 172.21.15.27:0/3490522779 >> 172.21.15.27:0/3490522779 conn(0x7f0f3c09dff0 msgr2=0x7f0f3c130d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T08:56:47.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.810+0000 7f0f4255e640 1 -- 172.21.15.27:0/3490522779 shutdown_connections 2023-11-29T08:56:47.813 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T08:56:47.810+0000 7f0f4255e640 1 -- 172.21.15.27:0/3490522779 wait complete. 2023-11-29T08:56:47.822 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-11-29T08:56:47.822 INFO:teuthology.run_tasks:Running task workunit... 2023-11-29T08:56:47.835 INFO:tasks.workunit:Pulling workunits from ref 3d760f113bd9f3a2e513474d34227633cd06f1ea 2023-11-29T08:56:47.835 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-11-29T08:56:47.836 DEBUG:teuthology.orchestra.run.smithi027:> stat -- /home/ubuntu/cephtest/mnt.0 2023-11-29T08:56:47.850 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-29T08:56:47.851 INFO:teuthology.orchestra.run.smithi027.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-11-29T08:56:47.851 DEBUG:teuthology.orchestra.run.smithi027:> mkdir -- /home/ubuntu/cephtest/mnt.0 2023-11-29T08:56:47.906 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2023-11-29T08:56:47.906 DEBUG:teuthology.orchestra.run.smithi027:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2023-11-29T08:56:47.961 INFO:tasks.workunit:timeout=3h 2023-11-29T08:56:47.961 INFO:tasks.workunit:cleanup=True 2023-11-29T08:56:47.961 DEBUG:teuthology.orchestra.run.smithi027:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 3d760f113bd9f3a2e513474d34227633cd06f1ea 2023-11-29T08:56:48.017 INFO:tasks.workunit.client.0.smithi027.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-11-29T08:57:29.189 INFO:tasks.workunit.client.0.smithi027.stderr:Note: switching to '3d760f113bd9f3a2e513474d34227633cd06f1ea'. 2023-11-29T08:57:29.189 INFO:tasks.workunit.client.0.smithi027.stderr: 2023-11-29T08:57:29.189 INFO:tasks.workunit.client.0.smithi027.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-11-29T08:57:29.189 INFO:tasks.workunit.client.0.smithi027.stderr:changes and commit them, and you can discard any commits you make in this 2023-11-29T08:57:29.189 INFO:tasks.workunit.client.0.smithi027.stderr:state without impacting any branches by switching back to a branch. 2023-11-29T08:57:29.189 INFO:tasks.workunit.client.0.smithi027.stderr: 2023-11-29T08:57:29.189 INFO:tasks.workunit.client.0.smithi027.stderr:If you want to create a new branch to retain commits you create, you may 2023-11-29T08:57:29.189 INFO:tasks.workunit.client.0.smithi027.stderr:do so (now or later) by using -c with the switch command. Example: 2023-11-29T08:57:29.190 INFO:tasks.workunit.client.0.smithi027.stderr: 2023-11-29T08:57:29.190 INFO:tasks.workunit.client.0.smithi027.stderr: git switch -c 2023-11-29T08:57:29.190 INFO:tasks.workunit.client.0.smithi027.stderr: 2023-11-29T08:57:29.190 INFO:tasks.workunit.client.0.smithi027.stderr:Or undo this operation with: 2023-11-29T08:57:29.190 INFO:tasks.workunit.client.0.smithi027.stderr: 2023-11-29T08:57:29.190 INFO:tasks.workunit.client.0.smithi027.stderr: git switch - 2023-11-29T08:57:29.190 INFO:tasks.workunit.client.0.smithi027.stderr: 2023-11-29T08:57:29.190 INFO:tasks.workunit.client.0.smithi027.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-11-29T08:57:29.190 INFO:tasks.workunit.client.0.smithi027.stderr: 2023-11-29T08:57:29.190 INFO:tasks.workunit.client.0.smithi027.stderr:HEAD is now at 3d760f113bd Merge pull request #54287 from Matan-B/wip-matanb-crimson-do_osd_ops_execute-v3 2023-11-29T08:57:29.191 DEBUG:teuthology.orchestra.run.smithi027:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-11-29T08:57:29.316 INFO:tasks.workunit.client.0.smithi027.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-11-29T08:57:29.318 INFO:tasks.workunit.client.0.smithi027.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-11-29T08:57:29.318 INFO:tasks.workunit.client.0.smithi027.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-11-29T08:57:30.096 INFO:tasks.workunit.client.0.smithi027.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-11-29T08:57:30.176 INFO:tasks.workunit.client.0.smithi027.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-11-29T08:57:30.219 INFO:tasks.workunit.client.0.smithi027.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-11-29T08:57:30.221 INFO:tasks.workunit.client.0.smithi027.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-11-29T08:57:30.221 INFO:tasks.workunit.client.0.smithi027.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-11-29T08:57:30.262 INFO:tasks.workunit.client.0.smithi027.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-11-29T08:57:30.265 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-11-29T08:57:30.265 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-11-29T08:57:30.281 INFO:tasks.workunit:Running workunits matching rados/test.sh on client.0... 2023-11-29T08:57:30.282 INFO:tasks.workunit:Running workunit rados/test.sh... 2023-11-29T08:57:30.283 DEBUG:teuthology.orchestra.run.smithi027:workunit test rados/test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3d760f113bd9f3a2e513474d34227633cd06f1ea TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh 2023-11-29T08:57:30.342 INFO:tasks.workunit.client.0.smithi027.stderr:+ parallel=1 2023-11-29T08:57:30.342 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' '' = --serial ']' 2023-11-29T08:57:30.342 INFO:tasks.workunit.client.0.smithi027.stderr:+ color= 2023-11-29T08:57:30.342 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' -t 1 ']' 2023-11-29T08:57:30.342 INFO:tasks.workunit.client.0.smithi027.stderr:+ trap cleanup EXIT ERR HUP INT QUIT 2023-11-29T08:57:30.342 INFO:tasks.workunit.client.0.smithi027.stderr:+ GTEST_OUTPUT=xml:/home/ubuntu/cephtest/archive/gtest_xml_report 2023-11-29T08:57:30.342 INFO:tasks.workunit.client.0.smithi027.stderr:+ declare -A pids 2023-11-29T08:57:30.342 INFO:tasks.workunit.client.0.smithi027.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-29T08:57:30.342 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' 1 -eq 1 ']' 2023-11-29T08:57:30.342 INFO:tasks.workunit.client.0.smithi027.stderr:++ printf %25s api_aio 2023-11-29T08:57:30.342 INFO:tasks.workunit.client.0.smithi027.stderr:+ r=' api_aio' 2023-11-29T08:57:30.343 INFO:tasks.workunit.client.0.smithi027.stderr:++ echo api_aio 2023-11-29T08:57:30.343 INFO:tasks.workunit.client.0.smithi027.stderr:++ awk '{print $1}' 2023-11-29T08:57:30.343 INFO:tasks.workunit.client.0.smithi027.stderr:+ ff=api_aio 2023-11-29T08:57:30.343 INFO:tasks.workunit.client.0.smithi027.stderr:+ pid=84286 2023-11-29T08:57:30.343 INFO:tasks.workunit.client.0.smithi027.stderr:+ echo 'test api_aio on pid 84286' 2023-11-29T08:57:30.344 INFO:tasks.workunit.client.0.smithi027.stdout:test api_aio on pid 84286 2023-11-29T08:57:30.347 INFO:tasks.workunit.client.0.smithi027.stderr:+ pids[$f]=84286 2023-11-29T08:57:30.347 INFO:tasks.workunit.client.0.smithi027.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_aio.xml 2>&1 | tee ceph_test_rados_api_aio.log | sed "s/^/ api_aio: /"' 2023-11-29T08:57:30.347 INFO:tasks.workunit.client.0.smithi027.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-29T08:57:30.347 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' 1 -eq 1 ']' 2023-11-29T08:57:30.347 INFO:tasks.workunit.client.0.smithi027.stderr:++ printf %25s api_aio_pp 2023-11-29T08:57:30.347 INFO:tasks.workunit.client.0.smithi027.stderr:+ r=' api_aio_pp' 2023-11-29T08:57:30.347 INFO:tasks.workunit.client.0.smithi027.stderr:++ echo api_aio_pp 2023-11-29T08:57:30.347 INFO:tasks.workunit.client.0.smithi027.stderr:++ awk '{print $1}' 2023-11-29T08:57:30.347 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' -f /etc/bashrc ']' 2023-11-29T08:57:30.347 INFO:tasks.workunit.client.0.smithi027.stderr:+ . /etc/bashrc 2023-11-29T08:57:30.347 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -z '' ']' 2023-11-29T08:57:30.347 INFO:tasks.workunit.client.0.smithi027.stderr:++ BASHRCSOURCED=Y 2023-11-29T08:57:30.348 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.348 INFO:tasks.workunit.client.0.smithi027.stderr:++ shopt -q login_shell 2023-11-29T08:57:30.348 INFO:tasks.workunit.client.0.smithi027.stderr:+++ umask 2023-11-29T08:57:30.348 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' 0022 -eq 0 ']' 2023-11-29T08:57:30.348 INFO:tasks.workunit.client.0.smithi027.stderr:++ SHELL=/bin/bash 2023-11-29T08:57:30.348 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.348 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-29T08:57:30.348 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.348 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-29T08:57:30.348 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-29T08:57:30.348 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.348 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-29T08:57:30.348 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.348 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-29T08:57:30.348 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-29T08:57:30.349 INFO:tasks.workunit.client.0.smithi027.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-29T08:57:30.349 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.349 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-29T08:57:30.349 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.349 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-29T08:57:30.349 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.349 INFO:tasks.workunit.client.0.smithi027.stderr:+ ff=api_aio_pp 2023-11-29T08:57:30.349 INFO:tasks.workunit.client.0.smithi027.stderr:+ pid=84293 2023-11-29T08:57:30.349 INFO:tasks.workunit.client.0.smithi027.stderr:+ echo 'test api_aio_pp on pid 84293' 2023-11-29T08:57:30.349 INFO:tasks.workunit.client.0.smithi027.stdout:test api_aio_pp on pid 84293 2023-11-29T08:57:30.353 INFO:tasks.workunit.client.0.smithi027.stderr:+ pids[$f]=84293 2023-11-29T08:57:30.353 INFO:tasks.workunit.client.0.smithi027.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-29T08:57:30.353 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' 1 -eq 1 ']' 2023-11-29T08:57:30.354 INFO:tasks.workunit.client.0.smithi027.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_aio_pp.xml 2>&1 | tee ceph_test_rados_api_aio_pp.log | sed "s/^/ api_aio_pp: /"' 2023-11-29T08:57:30.354 INFO:tasks.workunit.client.0.smithi027.stderr:++ printf %25s api_io 2023-11-29T08:57:30.354 INFO:tasks.workunit.client.0.smithi027.stderr:+ r=' api_io' 2023-11-29T08:57:30.354 INFO:tasks.workunit.client.0.smithi027.stderr:++ echo api_io 2023-11-29T08:57:30.354 INFO:tasks.workunit.client.0.smithi027.stderr:++ awk '{print $1}' 2023-11-29T08:57:30.354 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' -f /etc/bashrc ']' 2023-11-29T08:57:30.354 INFO:tasks.workunit.client.0.smithi027.stderr:+ . /etc/bashrc 2023-11-29T08:57:30.354 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -z '' ']' 2023-11-29T08:57:30.354 INFO:tasks.workunit.client.0.smithi027.stderr:++ BASHRCSOURCED=Y 2023-11-29T08:57:30.354 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.354 INFO:tasks.workunit.client.0.smithi027.stderr:++ shopt -q login_shell 2023-11-29T08:57:30.354 INFO:tasks.workunit.client.0.smithi027.stderr:+++ umask 2023-11-29T08:57:30.354 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'grep=grep --color=auto' 2023-11-29T08:57:30.355 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-29T08:57:30.355 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-29T08:57:30.355 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' 0022 -eq 0 ']' 2023-11-29T08:57:30.355 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.355 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-29T08:57:30.355 INFO:tasks.workunit.client.0.smithi027.stderr:++ SHELL=/bin/bash 2023-11-29T08:57:30.355 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.355 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorls.sh 2023-11-29T08:57:30.355 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' '!' -t 0 ']' 2023-11-29T08:57:30.355 INFO:tasks.workunit.client.0.smithi027.stderr:+++ return 2023-11-29T08:57:30.355 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.355 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-29T08:57:30.355 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.355 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.355 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-29T08:57:30.356 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-29T08:57:30.356 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.356 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export S_COLORS=auto 2023-11-29T08:57:30.356 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-29T08:57:30.356 INFO:tasks.workunit.client.0.smithi027.stderr:+++ S_COLORS=auto 2023-11-29T08:57:30.356 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.356 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-29T08:57:30.356 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.356 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-29T08:57:30.356 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.356 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-29T08:57:30.356 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.356 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-29T08:57:30.356 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.356 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-29T08:57:30.357 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-29T08:57:30.357 INFO:tasks.workunit.client.0.smithi027.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-29T08:57:30.357 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.357 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-29T08:57:30.357 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.357 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-29T08:57:30.357 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.357 INFO:tasks.workunit.client.0.smithi027.stderr:+ ff=api_io 2023-11-29T08:57:30.357 INFO:tasks.workunit.client.0.smithi027.stderr:+ pid=84302 2023-11-29T08:57:30.357 INFO:tasks.workunit.client.0.smithi027.stdout:test api_io on pid 84302 2023-11-29T08:57:30.362 INFO:tasks.workunit.client.0.smithi027.stderr:+ echo 'test api_io on pid 84302' 2023-11-29T08:57:30.362 INFO:tasks.workunit.client.0.smithi027.stderr:+ pids[$f]=84302 2023-11-29T08:57:30.362 INFO:tasks.workunit.client.0.smithi027.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-29T08:57:30.362 INFO:tasks.workunit.client.0.smithi027.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_io.xml 2>&1 | tee ceph_test_rados_api_io.log | sed "s/^/ api_io: /"' 2023-11-29T08:57:30.362 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' 1 -eq 1 ']' 2023-11-29T08:57:30.362 INFO:tasks.workunit.client.0.smithi027.stderr:++ printf %25s api_io_pp 2023-11-29T08:57:30.362 INFO:tasks.workunit.client.0.smithi027.stderr:+ r=' api_io_pp' 2023-11-29T08:57:30.363 INFO:tasks.workunit.client.0.smithi027.stderr:++ echo api_io_pp 2023-11-29T08:57:30.363 INFO:tasks.workunit.client.0.smithi027.stderr:++ awk '{print $1}' 2023-11-29T08:57:30.363 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' -f /etc/bashrc ']' 2023-11-29T08:57:30.363 INFO:tasks.workunit.client.0.smithi027.stderr:+ . /etc/bashrc 2023-11-29T08:57:30.363 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -z '' ']' 2023-11-29T08:57:30.363 INFO:tasks.workunit.client.0.smithi027.stderr:++ BASHRCSOURCED=Y 2023-11-29T08:57:30.363 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.363 INFO:tasks.workunit.client.0.smithi027.stderr:++ shopt -q login_shell 2023-11-29T08:57:30.363 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'grep=grep --color=auto' 2023-11-29T08:57:30.363 INFO:tasks.workunit.client.0.smithi027.stderr:+++ umask 2023-11-29T08:57:30.363 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-29T08:57:30.363 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-29T08:57:30.363 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.363 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-29T08:57:30.363 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-29T08:57:30.364 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.364 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorls.sh 2023-11-29T08:57:30.364 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-29T08:57:30.364 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' '!' -t 0 ']' 2023-11-29T08:57:30.364 INFO:tasks.workunit.client.0.smithi027.stderr:+++ return 2023-11-29T08:57:30.364 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.364 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-29T08:57:30.364 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-29T08:57:30.364 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.364 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-29T08:57:30.364 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.364 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-29T08:57:30.364 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export S_COLORS=auto 2023-11-29T08:57:30.364 INFO:tasks.workunit.client.0.smithi027.stderr:+++ S_COLORS=auto 2023-11-29T08:57:30.364 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.365 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' 0022 -eq 0 ']' 2023-11-29T08:57:30.365 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-29T08:57:30.365 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.365 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-29T08:57:30.365 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.365 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-29T08:57:30.365 INFO:tasks.workunit.client.0.smithi027.stderr:++ SHELL=/bin/bash 2023-11-29T08:57:30.365 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-29T08:57:30.365 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.365 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.365 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.365 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-29T08:57:30.365 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.365 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-29T08:57:30.366 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-29T08:57:30.366 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.366 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-29T08:57:30.366 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.366 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-29T08:57:30.366 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-29T08:57:30.366 INFO:tasks.workunit.client.0.smithi027.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-29T08:57:30.366 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.366 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-29T08:57:30.366 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.366 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-29T08:57:30.366 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.366 INFO:tasks.workunit.client.0.smithi027.stderr:+ ff=api_io_pp 2023-11-29T08:57:30.366 INFO:tasks.workunit.client.0.smithi027.stderr:+ pid=84313 2023-11-29T08:57:30.366 INFO:tasks.workunit.client.0.smithi027.stderr:+ echo 'test api_io_pp on pid 84313' 2023-11-29T08:57:30.367 INFO:tasks.workunit.client.0.smithi027.stdout:test api_io_pp on pid 84313 2023-11-29T08:57:30.373 INFO:tasks.workunit.client.0.smithi027.stderr:+ pids[$f]=84313 2023-11-29T08:57:30.373 INFO:tasks.workunit.client.0.smithi027.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-29T08:57:30.373 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' 1 -eq 1 ']' 2023-11-29T08:57:30.373 INFO:tasks.workunit.client.0.smithi027.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_io_pp.xml 2>&1 | tee ceph_test_rados_api_io_pp.log | sed "s/^/ api_io_pp: /"' 2023-11-29T08:57:30.373 INFO:tasks.workunit.client.0.smithi027.stderr:++ printf %25s api_asio 2023-11-29T08:57:30.374 INFO:tasks.workunit.client.0.smithi027.stderr:+ r=' api_asio' 2023-11-29T08:57:30.374 INFO:tasks.workunit.client.0.smithi027.stderr:++ echo api_asio 2023-11-29T08:57:30.374 INFO:tasks.workunit.client.0.smithi027.stderr:++ awk '{print $1}' 2023-11-29T08:57:30.374 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-29T08:57:30.374 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-29T08:57:30.374 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-29T08:57:30.374 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.374 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-29T08:57:30.374 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-29T08:57:30.374 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.374 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-29T08:57:30.374 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-29T08:57:30.374 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-29T08:57:30.374 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.375 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-29T08:57:30.375 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-29T08:57:30.375 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.375 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/gawk.sh 2023-11-29T08:57:30.375 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.375 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' -f /etc/bashrc ']' 2023-11-29T08:57:30.375 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-29T08:57:30.375 INFO:tasks.workunit.client.0.smithi027.stderr:+ . /etc/bashrc 2023-11-29T08:57:30.375 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.375 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-29T08:57:30.375 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.375 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-29T08:57:30.375 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-29T08:57:30.375 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.375 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/lang.sh 2023-11-29T08:57:30.376 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.376 INFO:tasks.workunit.client.0.smithi027.stderr:+++ unset LANG_backup 2023-11-29T08:57:30.376 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -z '' ']' 2023-11-29T08:57:30.376 INFO:tasks.workunit.client.0.smithi027.stderr:++ BASHRCSOURCED=Y 2023-11-29T08:57:30.376 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.376 INFO:tasks.workunit.client.0.smithi027.stderr:++ shopt -q login_shell 2023-11-29T08:57:30.376 INFO:tasks.workunit.client.0.smithi027.stderr:++++ /usr/bin/locale 2023-11-29T08:57:30.376 INFO:tasks.workunit.client.0.smithi027.stderr:+++ umask 2023-11-29T08:57:30.376 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'grep=grep --color=auto' 2023-11-29T08:57:30.376 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-29T08:57:30.376 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' 0022 -eq 0 ']' 2023-11-29T08:57:30.376 INFO:tasks.workunit.client.0.smithi027.stderr:++ SHELL=/bin/bash 2023-11-29T08:57:30.376 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-29T08:57:30.376 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.377 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-29T08:57:30.377 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.377 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorls.sh 2023-11-29T08:57:30.377 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.377 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-29T08:57:30.377 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.377 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' '!' -t 0 ']' 2023-11-29T08:57:30.377 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-29T08:57:30.377 INFO:tasks.workunit.client.0.smithi027.stderr:+++ return 2023-11-29T08:57:30.377 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.377 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-29T08:57:30.377 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.377 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-29T08:57:30.377 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export S_COLORS=auto 2023-11-29T08:57:30.377 INFO:tasks.workunit.client.0.smithi027.stderr:+++ S_COLORS=auto 2023-11-29T08:57:30.378 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.378 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-29T08:57:30.378 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-29T08:57:30.378 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.378 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-29T08:57:30.378 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.378 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-29T08:57:30.378 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.378 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.378 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-29T08:57:30.378 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-29T08:57:30.378 INFO:tasks.workunit.client.0.smithi027.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-29T08:57:30.378 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.378 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-29T08:57:30.378 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.379 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-29T08:57:30.379 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.379 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n '' ']' 2023-11-29T08:57:30.379 INFO:tasks.workunit.client.0.smithi027.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-29T08:57:30.379 INFO:tasks.workunit.client.0.smithi027.stderr:+ ff=api_asio 2023-11-29T08:57:30.379 INFO:tasks.workunit.client.0.smithi027.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-29T08:57:30.379 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-29T08:57:30.379 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-29T08:57:30.379 INFO:tasks.workunit.client.0.smithi027.stderr:+ pid=84328 2023-11-29T08:57:30.379 INFO:tasks.workunit.client.0.smithi027.stderr:+ echo 'test api_asio on pid 84328' 2023-11-29T08:57:30.379 INFO:tasks.workunit.client.0.smithi027.stdout:test api_asio on pid 84328 2023-11-29T08:57:30.386 INFO:tasks.workunit.client.0.smithi027.stderr:+ pids[$f]=84328 2023-11-29T08:57:30.386 INFO:tasks.workunit.client.0.smithi027.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-29T08:57:30.386 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' 1 -eq 1 ']' 2023-11-29T08:57:30.386 INFO:tasks.workunit.client.0.smithi027.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_asio --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_asio.xml 2>&1 | tee ceph_test_rados_api_asio.log | sed "s/^/ api_asio: /"' 2023-11-29T08:57:30.386 INFO:tasks.workunit.client.0.smithi027.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-29T08:57:30.387 INFO:tasks.workunit.client.0.smithi027.stderr:++ printf %25s api_list 2023-11-29T08:57:30.387 INFO:tasks.workunit.client.0.smithi027.stderr:+ r=' api_list' 2023-11-29T08:57:30.387 INFO:tasks.workunit.client.0.smithi027.stderr:++ echo api_list 2023-11-29T08:57:30.387 INFO:tasks.workunit.client.0.smithi027.stderr:++ awk '{print $1}' 2023-11-29T08:57:30.387 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-29T08:57:30.387 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-29T08:57:30.387 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-29T08:57:30.387 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.387 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-29T08:57:30.387 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.387 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-29T08:57:30.387 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-29T08:57:30.387 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.387 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-29T08:57:30.388 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.388 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' -f /etc/bashrc ']' 2023-11-29T08:57:30.388 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/gawk.sh 2023-11-29T08:57:30.388 INFO:tasks.workunit.client.0.smithi027.stderr:+ . /etc/bashrc 2023-11-29T08:57:30.388 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -z '' ']' 2023-11-29T08:57:30.388 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.388 INFO:tasks.workunit.client.0.smithi027.stderr:++ BASHRCSOURCED=Y 2023-11-29T08:57:30.388 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-29T08:57:30.388 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.388 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.388 INFO:tasks.workunit.client.0.smithi027.stderr:++ shopt -q login_shell 2023-11-29T08:57:30.388 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/lang.sh 2023-11-29T08:57:30.388 INFO:tasks.workunit.client.0.smithi027.stderr:+++ unset LANG_backup 2023-11-29T08:57:30.388 INFO:tasks.workunit.client.0.smithi027.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-29T08:57:30.388 INFO:tasks.workunit.client.0.smithi027.stderr:++++ export LANG=en_US.UTF-8 2023-11-29T08:57:30.389 INFO:tasks.workunit.client.0.smithi027.stderr:++++ LANG=en_US.UTF-8 2023-11-29T08:57:30.389 INFO:tasks.workunit.client.0.smithi027.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-29T08:57:30.389 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-29T08:57:30.389 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-29T08:57:30.389 INFO:tasks.workunit.client.0.smithi027.stderr:+++ LANG=en_US.UTF-8 2023-11-29T08:57:30.389 INFO:tasks.workunit.client.0.smithi027.stderr:+++ unset LANG_backup config 2023-11-29T08:57:30.389 INFO:tasks.workunit.client.0.smithi027.stderr:+++ umask 2023-11-29T08:57:30.389 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n '' ']' 2023-11-29T08:57:30.389 INFO:tasks.workunit.client.0.smithi027.stderr:++++ /usr/bin/locale 2023-11-29T08:57:30.389 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-29T08:57:30.389 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' dumb = linux ']' 2023-11-29T08:57:30.389 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.389 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-29T08:57:30.389 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' 0022 -eq 0 ']' 2023-11-29T08:57:30.390 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.390 INFO:tasks.workunit.client.0.smithi027.stderr:++ SHELL=/bin/bash 2023-11-29T08:57:30.390 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/less.sh 2023-11-29T08:57:30.390 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-29T08:57:30.390 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.390 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-29T08:57:30.390 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.390 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.390 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-29T08:57:30.390 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/which2.sh 2023-11-29T08:57:30.390 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.390 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-29T08:57:30.390 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-29T08:57:30.390 INFO:tasks.workunit.client.0.smithi027.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-29T08:57:30.391 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-29T08:57:30.391 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'grep=grep --color=auto' 2023-11-29T08:57:30.391 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-29T08:57:30.391 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-29T08:57:30.391 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-29T08:57:30.391 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.391 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-29T08:57:30.391 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.391 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.391 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-29T08:57:30.391 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-29T08:57:30.391 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-29T08:57:30.391 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.391 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-29T08:57:30.391 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-29T08:57:30.391 INFO:tasks.workunit.client.0.smithi027.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-29T08:57:30.392 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.392 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.392 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-29T08:57:30.392 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.392 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-29T08:57:30.392 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-29T08:57:30.392 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-29T08:57:30.392 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.392 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.392 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorls.sh 2023-11-29T08:57:30.392 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.392 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' '!' -t 0 ']' 2023-11-29T08:57:30.392 INFO:tasks.workunit.client.0.smithi027.stderr:+++ return 2023-11-29T08:57:30.392 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.392 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-29T08:57:30.393 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.393 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-29T08:57:30.393 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export S_COLORS=auto 2023-11-29T08:57:30.393 INFO:tasks.workunit.client.0.smithi027.stderr:+++ S_COLORS=auto 2023-11-29T08:57:30.393 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.393 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-29T08:57:30.393 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.393 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-29T08:57:30.393 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.393 INFO:tasks.workunit.client.0.smithi027.stderr:+++++ readlink /proc/84286/exe 2023-11-29T08:57:30.393 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n '' ']' 2023-11-29T08:57:30.393 INFO:tasks.workunit.client.0.smithi027.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-29T08:57:30.393 INFO:tasks.workunit.client.0.smithi027.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-29T08:57:30.393 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-29T08:57:30.393 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-29T08:57:30.393 INFO:tasks.workunit.client.0.smithi027.stderr:+ ff=api_list 2023-11-29T08:57:30.394 INFO:tasks.workunit.client.0.smithi027.stderr:+ pid=84345 2023-11-29T08:57:30.394 INFO:tasks.workunit.client.0.smithi027.stdout:test api_list on pid 84345 2023-11-29T08:57:30.400 INFO:tasks.workunit.client.0.smithi027.stderr:+ echo 'test api_list on pid 84345' 2023-11-29T08:57:30.400 INFO:tasks.workunit.client.0.smithi027.stderr:+ pids[$f]=84345 2023-11-29T08:57:30.401 INFO:tasks.workunit.client.0.smithi027.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-29T08:57:30.401 INFO:tasks.workunit.client.0.smithi027.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-29T08:57:30.401 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' 1 -eq 1 ']' 2023-11-29T08:57:30.401 INFO:tasks.workunit.client.0.smithi027.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_list --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_list.xml 2>&1 | tee ceph_test_rados_api_list.log | sed "s/^/ api_list: /"' 2023-11-29T08:57:30.401 INFO:tasks.workunit.client.0.smithi027.stderr:++ printf %25s api_lock 2023-11-29T08:57:30.401 INFO:tasks.workunit.client.0.smithi027.stderr:++++ basename /usr/bin/bash 2023-11-29T08:57:30.401 INFO:tasks.workunit.client.0.smithi027.stderr:+ r=' api_lock' 2023-11-29T08:57:30.401 INFO:tasks.workunit.client.0.smithi027.stderr:++ echo api_lock 2023-11-29T08:57:30.401 INFO:tasks.workunit.client.0.smithi027.stderr:++ awk '{print $1}' 2023-11-29T08:57:30.401 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' -f /etc/bashrc ']' 2023-11-29T08:57:30.401 INFO:tasks.workunit.client.0.smithi027.stderr:+ . /etc/bashrc 2023-11-29T08:57:30.401 INFO:tasks.workunit.client.0.smithi027.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-29T08:57:30.401 INFO:tasks.workunit.client.0.smithi027.stderr:+++ which_declare='declare -f' 2023-11-29T08:57:30.402 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -z '' ']' 2023-11-29T08:57:30.402 INFO:tasks.workunit.client.0.smithi027.stderr:+++ which_opt=-f 2023-11-29T08:57:30.402 INFO:tasks.workunit.client.0.smithi027.stderr:++ BASHRCSOURCED=Y 2023-11-29T08:57:30.402 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.402 INFO:tasks.workunit.client.0.smithi027.stderr:++ shopt -q login_shell 2023-11-29T08:57:30.402 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export which_declare 2023-11-29T08:57:30.402 INFO:tasks.workunit.client.0.smithi027.stderr:++++ export LANG=en_US.UTF-8 2023-11-29T08:57:30.402 INFO:tasks.workunit.client.0.smithi027.stderr:++++ LANG=en_US.UTF-8 2023-11-29T08:57:30.402 INFO:tasks.workunit.client.0.smithi027.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-29T08:57:30.402 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export -f which 2023-11-29T08:57:30.402 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-29T08:57:30.402 INFO:tasks.workunit.client.0.smithi027.stderr:++ unset i 2023-11-29T08:57:30.402 INFO:tasks.workunit.client.0.smithi027.stderr:++ unset -f pathmunge 2023-11-29T08:57:30.403 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-29T08:57:30.403 INFO:tasks.workunit.client.0.smithi027.stderr:+++ LANG=en_US.UTF-8 2023-11-29T08:57:30.403 INFO:tasks.workunit.client.0.smithi027.stderr:+++ unset LANG_backup config 2023-11-29T08:57:30.403 INFO:tasks.workunit.client.0.smithi027.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-29T08:57:30.403 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n '' ']' 2023-11-29T08:57:30.403 INFO:tasks.workunit.client.0.smithi027.stderr:+++ umask 2023-11-29T08:57:30.403 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-29T08:57:30.403 INFO:tasks.workunit.client.0.smithi027.stderr:+ export PATH 2023-11-29T08:57:30.403 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-29T08:57:30.403 INFO:tasks.workunit.client.0.smithi027.stderr:+ unset rc 2023-11-29T08:57:30.403 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' dumb = linux ']' 2023-11-29T08:57:30.403 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' 0022 -eq 0 ']' 2023-11-29T08:57:30.403 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.403 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-29T08:57:30.404 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.404 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'grep=grep --color=auto' 2023-11-29T08:57:30.404 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/less.sh 2023-11-29T08:57:30.404 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-29T08:57:30.404 INFO:tasks.workunit.client.0.smithi027.stderr:++ SHELL=/bin/bash 2023-11-29T08:57:30.404 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-29T08:57:30.404 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.404 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-29T08:57:30.404 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.404 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/which2.sh 2023-11-29T08:57:30.404 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-29T08:57:30.404 INFO:tasks.workunit.client.0.smithi027.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-29T08:57:30.404 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-29T08:57:30.404 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.405 INFO:tasks.workunit.client.0.smithi027.stderr:+ ceph_test_rados_api_aio --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_aio.xml 2023-11-29T08:57:30.405 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-29T08:57:30.405 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-29T08:57:30.405 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-29T08:57:30.405 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.405 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-29T08:57:30.405 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.405 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.405 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-29T08:57:30.405 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-29T08:57:30.405 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.405 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.405 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-29T08:57:30.405 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorls.sh 2023-11-29T08:57:30.406 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' '!' -t 0 ']' 2023-11-29T08:57:30.406 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-29T08:57:30.406 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-29T08:57:30.406 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.406 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-29T08:57:30.406 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-29T08:57:30.406 INFO:tasks.workunit.client.0.smithi027.stderr:+ tee ceph_test_rados_api_aio.log 2023-11-29T08:57:30.406 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.406 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.406 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-29T08:57:30.406 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-29T08:57:30.406 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.406 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-29T08:57:30.406 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/gawk.sh 2023-11-29T08:57:30.406 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-29T08:57:30.407 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-29T08:57:30.407 INFO:tasks.workunit.client.0.smithi027.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-29T08:57:30.407 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.407 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.407 INFO:tasks.workunit.client.0.smithi027.stderr:+ sed 's/^/ api_aio: /' 2023-11-29T08:57:30.407 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-29T08:57:30.407 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-29T08:57:30.407 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.407 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.407 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-29T08:57:30.407 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-29T08:57:30.407 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-29T08:57:30.407 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.407 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.407 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-29T08:57:30.407 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.408 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.408 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/lang.sh 2023-11-29T08:57:30.408 INFO:tasks.workunit.client.0.smithi027.stderr:+++ return 2023-11-29T08:57:30.408 INFO:tasks.workunit.client.0.smithi027.stderr:+++ unset LANG_backup 2023-11-29T08:57:30.408 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.408 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-29T08:57:30.408 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.408 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-29T08:57:30.408 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export S_COLORS=auto 2023-11-29T08:57:30.408 INFO:tasks.workunit.client.0.smithi027.stderr:+++ S_COLORS=auto 2023-11-29T08:57:30.408 INFO:tasks.workunit.client.0.smithi027.stderr:++++ /usr/bin/locale 2023-11-29T08:57:30.408 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.408 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-29T08:57:30.408 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.408 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-29T08:57:30.408 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.409 INFO:tasks.workunit.client.0.smithi027.stderr:+ ff=api_lock 2023-11-29T08:57:30.409 INFO:tasks.workunit.client.0.smithi027.stderr:+ pid=84364 2023-11-29T08:57:30.409 INFO:tasks.workunit.client.0.smithi027.stderr:+ echo 'test api_lock on pid 84364' 2023-11-29T08:57:30.409 INFO:tasks.workunit.client.0.smithi027.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_lock.xml 2>&1 | tee ceph_test_rados_api_lock.log | sed "s/^/ api_lock: /"' 2023-11-29T08:57:30.409 INFO:tasks.workunit.client.0.smithi027.stderr:+++++ readlink /proc/84293/exe 2023-11-29T08:57:30.409 INFO:tasks.workunit.client.0.smithi027.stdout:test api_lock on pid 84364 2023-11-29T08:57:30.417 INFO:tasks.workunit.client.0.smithi027.stderr:+ pids[$f]=84364 2023-11-29T08:57:30.417 INFO:tasks.workunit.client.0.smithi027.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-29T08:57:30.417 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' 1 -eq 1 ']' 2023-11-29T08:57:30.417 INFO:tasks.workunit.client.0.smithi027.stderr:++ printf %25s api_lock_pp 2023-11-29T08:57:30.417 INFO:tasks.workunit.client.0.smithi027.stderr:+ r=' api_lock_pp' 2023-11-29T08:57:30.417 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n '' ']' 2023-11-29T08:57:30.417 INFO:tasks.workunit.client.0.smithi027.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-29T08:57:30.417 INFO:tasks.workunit.client.0.smithi027.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-29T08:57:30.417 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-29T08:57:30.417 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-29T08:57:30.418 INFO:tasks.workunit.client.0.smithi027.stderr:++++ basename /usr/bin/bash 2023-11-29T08:57:30.418 INFO:tasks.workunit.client.0.smithi027.stderr:++ echo api_lock_pp 2023-11-29T08:57:30.418 INFO:tasks.workunit.client.0.smithi027.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-29T08:57:30.418 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' -f /etc/bashrc ']' 2023-11-29T08:57:30.418 INFO:tasks.workunit.client.0.smithi027.stderr:+ . /etc/bashrc 2023-11-29T08:57:30.418 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -z '' ']' 2023-11-29T08:57:30.418 INFO:tasks.workunit.client.0.smithi027.stderr:++ BASHRCSOURCED=Y 2023-11-29T08:57:30.418 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.418 INFO:tasks.workunit.client.0.smithi027.stderr:++ shopt -q login_shell 2023-11-29T08:57:30.418 INFO:tasks.workunit.client.0.smithi027.stderr:+++ umask 2023-11-29T08:57:30.418 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' 0022 -eq 0 ']' 2023-11-29T08:57:30.418 INFO:tasks.workunit.client.0.smithi027.stderr:++ SHELL=/bin/bash 2023-11-29T08:57:30.418 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'grep=grep --color=auto' 2023-11-29T08:57:30.418 INFO:tasks.workunit.client.0.smithi027.stderr:+++ which_declare='declare -f' 2023-11-29T08:57:30.418 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.419 INFO:tasks.workunit.client.0.smithi027.stderr:+++ which_opt=-f 2023-11-29T08:57:30.419 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-29T08:57:30.419 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.419 INFO:tasks.workunit.client.0.smithi027.stderr:++ awk '{print $1}' 2023-11-29T08:57:30.419 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-29T08:57:30.419 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export which_declare 2023-11-29T08:57:30.419 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export -f which 2023-11-29T08:57:30.419 INFO:tasks.workunit.client.0.smithi027.stderr:++ unset i 2023-11-29T08:57:30.419 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-29T08:57:30.419 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-29T08:57:30.419 INFO:tasks.workunit.client.0.smithi027.stderr:++ unset -f pathmunge 2023-11-29T08:57:30.419 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.419 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-29T08:57:30.419 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.419 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-29T08:57:30.420 INFO:tasks.workunit.client.0.smithi027.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-29T08:57:30.420 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-29T08:57:30.420 INFO:tasks.workunit.client.0.smithi027.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-29T08:57:30.420 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.420 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-29T08:57:30.420 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.420 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-29T08:57:30.420 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.420 INFO:tasks.workunit.client.0.smithi027.stderr:+ export PATH 2023-11-29T08:57:30.420 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-29T08:57:30.420 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-29T08:57:30.420 INFO:tasks.workunit.client.0.smithi027.stderr:+ unset rc 2023-11-29T08:57:30.420 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.420 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-29T08:57:30.420 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.421 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorls.sh 2023-11-29T08:57:30.421 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' '!' -t 0 ']' 2023-11-29T08:57:30.421 INFO:tasks.workunit.client.0.smithi027.stderr:+++ return 2023-11-29T08:57:30.421 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-29T08:57:30.421 INFO:tasks.workunit.client.0.smithi027.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-29T08:57:30.421 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-29T08:57:30.421 INFO:tasks.workunit.client.0.smithi027.stderr:++++ export LANG=en_US.UTF-8 2023-11-29T08:57:30.421 INFO:tasks.workunit.client.0.smithi027.stderr:++++ LANG=en_US.UTF-8 2023-11-29T08:57:30.421 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-29T08:57:30.421 INFO:tasks.workunit.client.0.smithi027.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-29T08:57:30.421 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-29T08:57:30.421 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.421 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-29T08:57:30.421 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.422 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-29T08:57:30.422 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-29T08:57:30.422 INFO:tasks.workunit.client.0.smithi027.stderr:+++ LANG=en_US.UTF-8 2023-11-29T08:57:30.422 INFO:tasks.workunit.client.0.smithi027.stderr:+++ unset LANG_backup config 2023-11-29T08:57:30.422 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-29T08:57:30.422 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.422 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.422 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-29T08:57:30.422 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.422 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-29T08:57:30.422 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export S_COLORS=auto 2023-11-29T08:57:30.422 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n '' ']' 2023-11-29T08:57:30.422 INFO:tasks.workunit.client.0.smithi027.stderr:+++ S_COLORS=auto 2023-11-29T08:57:30.422 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.423 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-29T08:57:30.423 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.423 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-29T08:57:30.423 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.423 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-29T08:57:30.423 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-29T08:57:30.423 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-29T08:57:30.423 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-29T08:57:30.423 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' dumb = linux ']' 2023-11-29T08:57:30.423 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.423 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.423 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-29T08:57:30.423 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-29T08:57:30.423 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.423 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.424 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-29T08:57:30.424 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/less.sh 2023-11-29T08:57:30.424 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-29T08:57:30.424 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-29T08:57:30.424 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.424 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-29T08:57:30.424 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.424 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.424 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-29T08:57:30.424 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/which2.sh 2023-11-29T08:57:30.424 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.424 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/gawk.sh 2023-11-29T08:57:30.424 INFO:tasks.workunit.client.0.smithi027.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-29T08:57:30.424 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.424 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-29T08:57:30.425 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.425 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/lang.sh 2023-11-29T08:57:30.425 INFO:tasks.workunit.client.0.smithi027.stderr:+++ unset LANG_backup 2023-11-29T08:57:30.425 INFO:tasks.workunit.client.0.smithi027.stderr:++++ /usr/bin/locale 2023-11-29T08:57:30.425 INFO:tasks.workunit.client.0.smithi027.stderr:+ tee ceph_test_rados_api_aio_pp.log 2023-11-29T08:57:30.425 INFO:tasks.workunit.client.0.smithi027.stderr:+++++ readlink /proc/84302/exe 2023-11-29T08:57:30.425 INFO:tasks.workunit.client.0.smithi027.stderr:+ sed 's/^/ api_aio_pp: /' 2023-11-29T08:57:30.425 INFO:tasks.workunit.client.0.smithi027.stderr:+ ff=api_lock_pp 2023-11-29T08:57:30.425 INFO:tasks.workunit.client.0.smithi027.stderr:+ pid=84387 2023-11-29T08:57:30.425 INFO:tasks.workunit.client.0.smithi027.stderr:+ echo 'test api_lock_pp on pid 84387' 2023-11-29T08:57:30.425 INFO:tasks.workunit.client.0.smithi027.stdout:test api_lock_pp on pid 84387 2023-11-29T08:57:30.436 INFO:tasks.workunit.client.0.smithi027.stderr:+ pids[$f]=84387 2023-11-29T08:57:30.436 INFO:tasks.workunit.client.0.smithi027.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-29T08:57:30.436 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' 1 -eq 1 ']' 2023-11-29T08:57:30.437 INFO:tasks.workunit.client.0.smithi027.stderr:++ printf %25s api_misc 2023-11-29T08:57:30.437 INFO:tasks.workunit.client.0.smithi027.stderr:+ r=' api_misc' 2023-11-29T08:57:30.437 INFO:tasks.workunit.client.0.smithi027.stderr:++++ basename /usr/bin/bash 2023-11-29T08:57:30.437 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'grep=grep --color=auto' 2023-11-29T08:57:30.437 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-29T08:57:30.437 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-29T08:57:30.437 INFO:tasks.workunit.client.0.smithi027.stderr:+ ceph_test_rados_api_aio_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_aio_pp.xml 2023-11-29T08:57:30.437 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.437 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-29T08:57:30.437 INFO:tasks.workunit.client.0.smithi027.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_lock_pp.xml 2>&1 | tee ceph_test_rados_api_lock_pp.log | sed "s/^/ api_lock_pp: /"' 2023-11-29T08:57:30.437 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.437 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-29T08:57:30.437 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorls.sh 2023-11-29T08:57:30.437 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-29T08:57:30.438 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' '!' -t 0 ']' 2023-11-29T08:57:30.438 INFO:tasks.workunit.client.0.smithi027.stderr:+++ return 2023-11-29T08:57:30.438 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.438 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-29T08:57:30.438 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.438 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-29T08:57:30.438 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export S_COLORS=auto 2023-11-29T08:57:30.438 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-29T08:57:30.438 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-29T08:57:30.438 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.438 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-29T08:57:30.438 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-29T08:57:30.438 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.438 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-29T08:57:30.439 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-29T08:57:30.439 INFO:tasks.workunit.client.0.smithi027.stderr:+++ S_COLORS=auto 2023-11-29T08:57:30.439 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.439 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-29T08:57:30.439 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-29T08:57:30.439 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.439 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.439 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-29T08:57:30.439 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-29T08:57:30.439 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.439 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/gawk.sh 2023-11-29T08:57:30.439 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-29T08:57:30.439 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.439 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.439 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-29T08:57:30.439 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.440 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-29T08:57:30.440 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.440 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/lang.sh 2023-11-29T08:57:30.440 INFO:tasks.workunit.client.0.smithi027.stderr:+++ which_declare='declare -f' 2023-11-29T08:57:30.440 INFO:tasks.workunit.client.0.smithi027.stderr:+++ unset LANG_backup 2023-11-29T08:57:30.440 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.440 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-29T08:57:30.440 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.440 INFO:tasks.workunit.client.0.smithi027.stderr:+++ which_opt=-f 2023-11-29T08:57:30.440 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export which_declare 2023-11-29T08:57:30.440 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export -f which 2023-11-29T08:57:30.440 INFO:tasks.workunit.client.0.smithi027.stderr:++ awk '{print $1}' 2023-11-29T08:57:30.440 INFO:tasks.workunit.client.0.smithi027.stderr:++ unset i 2023-11-29T08:57:30.440 INFO:tasks.workunit.client.0.smithi027.stderr:++ unset -f pathmunge 2023-11-29T08:57:30.440 INFO:tasks.workunit.client.0.smithi027.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-29T08:57:30.441 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n '' ']' 2023-11-29T08:57:30.441 INFO:tasks.workunit.client.0.smithi027.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-29T08:57:30.441 INFO:tasks.workunit.client.0.smithi027.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-29T08:57:30.441 INFO:tasks.workunit.client.0.smithi027.stderr:+ export PATH 2023-11-29T08:57:30.441 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-29T08:57:30.441 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-29T08:57:30.441 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-29T08:57:30.441 INFO:tasks.workunit.client.0.smithi027.stderr:+ unset rc 2023-11-29T08:57:30.441 INFO:tasks.workunit.client.0.smithi027.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-29T08:57:30.441 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' -f /etc/bashrc ']' 2023-11-29T08:57:30.441 INFO:tasks.workunit.client.0.smithi027.stderr:+ . /etc/bashrc 2023-11-29T08:57:30.441 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -z '' ']' 2023-11-29T08:57:30.441 INFO:tasks.workunit.client.0.smithi027.stderr:++ BASHRCSOURCED=Y 2023-11-29T08:57:30.441 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.441 INFO:tasks.workunit.client.0.smithi027.stderr:+ ceph_test_rados_api_io --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_io.xml 2023-11-29T08:57:30.442 INFO:tasks.workunit.client.0.smithi027.stderr:++ shopt -q login_shell 2023-11-29T08:57:30.442 INFO:tasks.workunit.client.0.smithi027.stderr:+++ umask 2023-11-29T08:57:30.442 INFO:tasks.workunit.client.0.smithi027.stderr:+ tee ceph_test_rados_api_io.log 2023-11-29T08:57:30.442 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' 0022 -eq 0 ']' 2023-11-29T08:57:30.442 INFO:tasks.workunit.client.0.smithi027.stderr:++ SHELL=/bin/bash 2023-11-29T08:57:30.442 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.442 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-29T08:57:30.442 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.442 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-29T08:57:30.442 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-29T08:57:30.442 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.442 INFO:tasks.workunit.client.0.smithi027.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-29T08:57:30.442 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-29T08:57:30.442 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.443 INFO:tasks.workunit.client.0.smithi027.stderr:++++ /usr/bin/locale 2023-11-29T08:57:30.443 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-29T08:57:30.443 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-29T08:57:30.443 INFO:tasks.workunit.client.0.smithi027.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-29T08:57:30.443 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.443 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-29T08:57:30.443 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.443 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-29T08:57:30.443 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.443 INFO:tasks.workunit.client.0.smithi027.stderr:++++ export LANG=en_US.UTF-8 2023-11-29T08:57:30.443 INFO:tasks.workunit.client.0.smithi027.stderr:++++ LANG=en_US.UTF-8 2023-11-29T08:57:30.443 INFO:tasks.workunit.client.0.smithi027.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-29T08:57:30.443 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-29T08:57:30.443 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-29T08:57:30.443 INFO:tasks.workunit.client.0.smithi027.stderr:+++ LANG=en_US.UTF-8 2023-11-29T08:57:30.443 INFO:tasks.workunit.client.0.smithi027.stderr:+++ unset LANG_backup config 2023-11-29T08:57:30.444 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n '' ']' 2023-11-29T08:57:30.444 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-29T08:57:30.444 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' dumb = linux ']' 2023-11-29T08:57:30.444 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.444 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-29T08:57:30.444 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.444 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/less.sh 2023-11-29T08:57:30.444 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-29T08:57:30.444 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-29T08:57:30.444 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-29T08:57:30.444 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.444 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-29T08:57:30.444 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.444 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-29T08:57:30.444 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-29T08:57:30.445 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.445 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-29T08:57:30.445 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.445 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/which2.sh 2023-11-29T08:57:30.445 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-29T08:57:30.445 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.445 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-29T08:57:30.445 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.445 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/gawk.sh 2023-11-29T08:57:30.445 INFO:tasks.workunit.client.0.smithi027.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-29T08:57:30.445 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n '' ']' 2023-11-29T08:57:30.445 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.445 INFO:tasks.workunit.client.0.smithi027.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-29T08:57:30.445 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-29T08:57:30.445 INFO:tasks.workunit.client.0.smithi027.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-29T08:57:30.446 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-29T08:57:30.446 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-29T08:57:30.446 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.446 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/lang.sh 2023-11-29T08:57:30.446 INFO:tasks.workunit.client.0.smithi027.stderr:+++ unset LANG_backup 2023-11-29T08:57:30.446 INFO:tasks.workunit.client.0.smithi027.stderr:+++++ readlink /proc/84313/exe 2023-11-29T08:57:30.446 INFO:tasks.workunit.client.0.smithi027.stderr:++ echo api_misc 2023-11-29T08:57:30.446 INFO:tasks.workunit.client.0.smithi027.stderr:++++ /usr/bin/locale 2023-11-29T08:57:30.446 INFO:tasks.workunit.client.0.smithi027.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-29T08:57:30.446 INFO:tasks.workunit.client.0.smithi027.stderr:+ ff=api_misc 2023-11-29T08:57:30.446 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-29T08:57:30.446 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-29T08:57:30.446 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-29T08:57:30.446 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.446 INFO:tasks.workunit.client.0.smithi027.stderr:+ pid=84410 2023-11-29T08:57:30.447 INFO:tasks.workunit.client.0.smithi027.stdout:test api_misc on pid 84410 2023-11-29T08:57:30.459 INFO:tasks.workunit.client.0.smithi027.stderr:+ echo 'test api_misc on pid 84410' 2023-11-29T08:57:30.459 INFO:tasks.workunit.client.0.smithi027.stderr:+ pids[$f]=84410 2023-11-29T08:57:30.459 INFO:tasks.workunit.client.0.smithi027.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-29T08:57:30.459 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' 1 -eq 1 ']' 2023-11-29T08:57:30.459 INFO:tasks.workunit.client.0.smithi027.stderr:++++ basename /usr/bin/bash 2023-11-29T08:57:30.459 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-29T08:57:30.459 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.460 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-29T08:57:30.460 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-29T08:57:30.460 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.460 INFO:tasks.workunit.client.0.smithi027.stderr:+ sed 's/^/ api_io: /' 2023-11-29T08:57:30.460 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'grep=grep --color=auto' 2023-11-29T08:57:30.460 INFO:tasks.workunit.client.0.smithi027.stderr:++ printf %25s api_misc_pp 2023-11-29T08:57:30.460 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-29T08:57:30.460 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n '' ']' 2023-11-29T08:57:30.460 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-29T08:57:30.460 INFO:tasks.workunit.client.0.smithi027.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-29T08:57:30.460 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.460 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-29T08:57:30.460 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.460 INFO:tasks.workunit.client.0.smithi027.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-29T08:57:30.460 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorls.sh 2023-11-29T08:57:30.461 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-29T08:57:30.461 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-29T08:57:30.461 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' '!' -t 0 ']' 2023-11-29T08:57:30.461 INFO:tasks.workunit.client.0.smithi027.stderr:+++ return 2023-11-29T08:57:30.461 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.461 INFO:tasks.workunit.client.0.smithi027.stderr:+++ which_declare='declare -f' 2023-11-29T08:57:30.461 INFO:tasks.workunit.client.0.smithi027.stderr:+++ which_opt=-f 2023-11-29T08:57:30.461 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-29T08:57:30.461 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export which_declare 2023-11-29T08:57:30.461 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export -f which 2023-11-29T08:57:30.461 INFO:tasks.workunit.client.0.smithi027.stderr:++ unset i 2023-11-29T08:57:30.461 INFO:tasks.workunit.client.0.smithi027.stderr:+ r=' api_misc_pp' 2023-11-29T08:57:30.461 INFO:tasks.workunit.client.0.smithi027.stderr:++ unset -f pathmunge 2023-11-29T08:57:30.461 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.461 INFO:tasks.workunit.client.0.smithi027.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-29T08:57:30.462 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-29T08:57:30.462 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export S_COLORS=auto 2023-11-29T08:57:30.462 INFO:tasks.workunit.client.0.smithi027.stderr:+ export PATH 2023-11-29T08:57:30.462 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-29T08:57:30.462 INFO:tasks.workunit.client.0.smithi027.stderr:+ unset rc 2023-11-29T08:57:30.462 INFO:tasks.workunit.client.0.smithi027.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_misc.xml 2>&1 | tee ceph_test_rados_api_misc.log | sed "s/^/ api_misc: /"' 2023-11-29T08:57:30.462 INFO:tasks.workunit.client.0.smithi027.stderr:+++ S_COLORS=auto 2023-11-29T08:57:30.462 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.462 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-29T08:57:30.462 INFO:tasks.workunit.client.0.smithi027.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-29T08:57:30.462 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.462 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-29T08:57:30.462 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.462 INFO:tasks.workunit.client.0.smithi027.stderr:++++ export LANG=en_US.UTF-8 2023-11-29T08:57:30.462 INFO:tasks.workunit.client.0.smithi027.stderr:++++ LANG=en_US.UTF-8 2023-11-29T08:57:30.463 INFO:tasks.workunit.client.0.smithi027.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-29T08:57:30.463 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-29T08:57:30.463 INFO:tasks.workunit.client.0.smithi027.stderr:+ ceph_test_rados_api_io_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_io_pp.xml 2023-11-29T08:57:30.463 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-29T08:57:30.463 INFO:tasks.workunit.client.0.smithi027.stderr:+ tee ceph_test_rados_api_io_pp.log 2023-11-29T08:57:30.463 INFO:tasks.workunit.client.0.smithi027.stderr:+++ LANG=en_US.UTF-8 2023-11-29T08:57:30.463 INFO:tasks.workunit.client.0.smithi027.stderr:+++ unset LANG_backup config 2023-11-29T08:57:30.463 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n '' ']' 2023-11-29T08:57:30.463 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-29T08:57:30.463 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' dumb = linux ']' 2023-11-29T08:57:30.463 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.463 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-29T08:57:30.463 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.463 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/less.sh 2023-11-29T08:57:30.464 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-29T08:57:30.464 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.464 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-29T08:57:30.464 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.464 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/which2.sh 2023-11-29T08:57:30.464 INFO:tasks.workunit.client.0.smithi027.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-29T08:57:30.464 INFO:tasks.workunit.client.0.smithi027.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-29T08:57:30.464 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' -f /etc/bashrc ']' 2023-11-29T08:57:30.464 INFO:tasks.workunit.client.0.smithi027.stderr:+ . /etc/bashrc 2023-11-29T08:57:30.464 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -z '' ']' 2023-11-29T08:57:30.464 INFO:tasks.workunit.client.0.smithi027.stderr:++ BASHRCSOURCED=Y 2023-11-29T08:57:30.464 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.464 INFO:tasks.workunit.client.0.smithi027.stderr:+++++ readlink /proc/84328/exe 2023-11-29T08:57:30.464 INFO:tasks.workunit.client.0.smithi027.stderr:++ shopt -q login_shell 2023-11-29T08:57:30.465 INFO:tasks.workunit.client.0.smithi027.stderr:+++ umask 2023-11-29T08:57:30.465 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' 0022 -eq 0 ']' 2023-11-29T08:57:30.465 INFO:tasks.workunit.client.0.smithi027.stderr:++ SHELL=/bin/bash 2023-11-29T08:57:30.465 INFO:tasks.workunit.client.0.smithi027.stderr:+ sed 's/^/ api_io_pp: /' 2023-11-29T08:57:30.465 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.465 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-29T08:57:30.465 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.465 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-29T08:57:30.465 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-29T08:57:30.465 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.465 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-29T08:57:30.465 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.466 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-29T08:57:30.466 INFO:tasks.workunit.client.0.smithi027.stderr:++ echo api_misc_pp 2023-11-29T08:57:30.466 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-29T08:57:30.466 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-29T08:57:30.466 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-29T08:57:30.466 INFO:tasks.workunit.client.0.smithi027.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-29T08:57:30.466 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.466 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-29T08:57:30.466 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.466 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-29T08:57:30.466 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.466 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-29T08:57:30.466 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.466 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-29T08:57:30.467 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.467 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-29T08:57:30.467 INFO:tasks.workunit.client.0.smithi027.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-29T08:57:30.467 INFO:tasks.workunit.client.0.smithi027.stderr:++++ export LANG=en_US.UTF-8 2023-11-29T08:57:30.467 INFO:tasks.workunit.client.0.smithi027.stderr:++++ LANG=en_US.UTF-8 2023-11-29T08:57:30.467 INFO:tasks.workunit.client.0.smithi027.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-29T08:57:30.467 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-29T08:57:30.467 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.467 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-29T08:57:30.467 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-29T08:57:30.467 INFO:tasks.workunit.client.0.smithi027.stderr:+++ LANG=en_US.UTF-8 2023-11-29T08:57:30.467 INFO:tasks.workunit.client.0.smithi027.stderr:+++ unset LANG_backup config 2023-11-29T08:57:30.467 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n '' ']' 2023-11-29T08:57:30.467 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-29T08:57:30.467 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-29T08:57:30.468 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-29T08:57:30.468 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.468 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-29T08:57:30.468 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.468 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-29T08:57:30.468 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-29T08:57:30.468 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.468 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-29T08:57:30.468 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.468 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/gawk.sh 2023-11-29T08:57:30.468 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-29T08:57:30.468 INFO:tasks.workunit.client.0.smithi027.stderr:++ awk '{print $1}' 2023-11-29T08:57:30.468 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' dumb = linux ']' 2023-11-29T08:57:30.468 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.469 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-29T08:57:30.469 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.469 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.469 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/lang.sh 2023-11-29T08:57:30.469 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-29T08:57:30.469 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.469 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/less.sh 2023-11-29T08:57:30.469 INFO:tasks.workunit.client.0.smithi027.stderr:+++ unset LANG_backup 2023-11-29T08:57:30.469 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-29T08:57:30.469 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.469 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-29T08:57:30.469 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.469 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/which2.sh 2023-11-29T08:57:30.469 INFO:tasks.workunit.client.0.smithi027.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-29T08:57:30.470 INFO:tasks.workunit.client.0.smithi027.stderr:+++++ readlink /proc/84345/exe 2023-11-29T08:57:30.470 INFO:tasks.workunit.client.0.smithi027.stderr:++++ /usr/bin/locale 2023-11-29T08:57:30.470 INFO:tasks.workunit.client.0.smithi027.stderr:++++ basename /usr/bin/bash 2023-11-29T08:57:30.470 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n '' ']' 2023-11-29T08:57:30.470 INFO:tasks.workunit.client.0.smithi027.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-29T08:57:30.470 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-29T08:57:30.470 INFO:tasks.workunit.client.0.smithi027.stderr:+ ff=api_misc_pp 2023-11-29T08:57:30.470 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-29T08:57:30.470 INFO:tasks.workunit.client.0.smithi027.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-29T08:57:30.470 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-29T08:57:30.470 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-29T08:57:30.470 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-29T08:57:30.470 INFO:tasks.workunit.client.0.smithi027.stderr:+ pid=84434 2023-11-29T08:57:30.470 INFO:tasks.workunit.client.0.smithi027.stderr:+ echo 'test api_misc_pp on pid 84434' 2023-11-29T08:57:30.471 INFO:tasks.workunit.client.0.smithi027.stdout:test api_misc_pp on pid 84434 2023-11-29T08:57:30.483 INFO:tasks.workunit.client.0.smithi027.stderr:+ pids[$f]=84434 2023-11-29T08:57:30.483 INFO:tasks.workunit.client.0.smithi027.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-29T08:57:30.483 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' 1 -eq 1 ']' 2023-11-29T08:57:30.483 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.483 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-29T08:57:30.483 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.483 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-29T08:57:30.483 INFO:tasks.workunit.client.0.smithi027.stderr:++ printf %25s api_tier_pp 2023-11-29T08:57:30.483 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-29T08:57:30.483 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.483 INFO:tasks.workunit.client.0.smithi027.stderr:+ r=' api_tier_pp' 2023-11-29T08:57:30.484 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-29T08:57:30.484 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.484 INFO:tasks.workunit.client.0.smithi027.stderr:+++ which_declare='declare -f' 2023-11-29T08:57:30.484 INFO:tasks.workunit.client.0.smithi027.stderr:+++ which_opt=-f 2023-11-29T08:57:30.484 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/gawk.sh 2023-11-29T08:57:30.484 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export which_declare 2023-11-29T08:57:30.484 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export -f which 2023-11-29T08:57:30.484 INFO:tasks.workunit.client.0.smithi027.stderr:++ unset i 2023-11-29T08:57:30.484 INFO:tasks.workunit.client.0.smithi027.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_misc_pp.xml 2>&1 | tee ceph_test_rados_api_misc_pp.log | sed "s/^/ api_misc_pp: /"' 2023-11-29T08:57:30.484 INFO:tasks.workunit.client.0.smithi027.stderr:++ unset -f pathmunge 2023-11-29T08:57:30.484 INFO:tasks.workunit.client.0.smithi027.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-29T08:57:30.484 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.484 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-29T08:57:30.484 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.484 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/lang.sh 2023-11-29T08:57:30.484 INFO:tasks.workunit.client.0.smithi027.stderr:+++ unset LANG_backup 2023-11-29T08:57:30.485 INFO:tasks.workunit.client.0.smithi027.stderr:+ export PATH 2023-11-29T08:57:30.485 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-29T08:57:30.485 INFO:tasks.workunit.client.0.smithi027.stderr:+ unset rc 2023-11-29T08:57:30.485 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'grep=grep --color=auto' 2023-11-29T08:57:30.485 INFO:tasks.workunit.client.0.smithi027.stderr:++++ /usr/bin/locale 2023-11-29T08:57:30.485 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-29T08:57:30.485 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-29T08:57:30.485 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.485 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-29T08:57:30.485 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.485 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorls.sh 2023-11-29T08:57:30.485 INFO:tasks.workunit.client.0.smithi027.stderr:++ echo api_tier_pp 2023-11-29T08:57:30.485 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' '!' -t 0 ']' 2023-11-29T08:57:30.485 INFO:tasks.workunit.client.0.smithi027.stderr:+++ return 2023-11-29T08:57:30.485 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.486 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-29T08:57:30.486 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.486 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-29T08:57:30.486 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export S_COLORS=auto 2023-11-29T08:57:30.486 INFO:tasks.workunit.client.0.smithi027.stderr:+++ S_COLORS=auto 2023-11-29T08:57:30.486 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.487 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-29T08:57:30.487 INFO:tasks.workunit.client.0.smithi027.stderr:+ sed 's/^/ api_list: /' 2023-11-29T08:57:30.487 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.487 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-29T08:57:30.487 INFO:tasks.workunit.client.0.smithi027.stderr:++++ basename /usr/bin/bash 2023-11-29T08:57:30.487 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' -f /etc/bashrc ']' 2023-11-29T08:57:30.487 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.487 INFO:tasks.workunit.client.0.smithi027.stderr:+ . /etc/bashrc 2023-11-29T08:57:30.487 INFO:tasks.workunit.client.0.smithi027.stderr:+ tee ceph_test_rados_api_list.log 2023-11-29T08:57:30.487 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -z '' ']' 2023-11-29T08:57:30.487 INFO:tasks.workunit.client.0.smithi027.stderr:++ BASHRCSOURCED=Y 2023-11-29T08:57:30.488 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.488 INFO:tasks.workunit.client.0.smithi027.stderr:++ shopt -q login_shell 2023-11-29T08:57:30.488 INFO:tasks.workunit.client.0.smithi027.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-29T08:57:30.488 INFO:tasks.workunit.client.0.smithi027.stderr:+++ which_declare='declare -f' 2023-11-29T08:57:30.488 INFO:tasks.workunit.client.0.smithi027.stderr:+++ which_opt=-f 2023-11-29T08:57:30.488 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export which_declare 2023-11-29T08:57:30.488 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export -f which 2023-11-29T08:57:30.488 INFO:tasks.workunit.client.0.smithi027.stderr:++ unset i 2023-11-29T08:57:30.488 INFO:tasks.workunit.client.0.smithi027.stderr:+++ umask 2023-11-29T08:57:30.488 INFO:tasks.workunit.client.0.smithi027.stderr:++ unset -f pathmunge 2023-11-29T08:57:30.488 INFO:tasks.workunit.client.0.smithi027.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-29T08:57:30.488 INFO:tasks.workunit.client.0.smithi027.stderr:+ export PATH 2023-11-29T08:57:30.488 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-29T08:57:30.488 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' 0022 -eq 0 ']' 2023-11-29T08:57:30.489 INFO:tasks.workunit.client.0.smithi027.stderr:+ unset rc 2023-11-29T08:57:30.489 INFO:tasks.workunit.client.0.smithi027.stderr:++ SHELL=/bin/bash 2023-11-29T08:57:30.489 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.489 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-29T08:57:30.489 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.489 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-29T08:57:30.489 INFO:tasks.workunit.client.0.smithi027.stderr:+ ceph_test_rados_api_asio --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_asio.xml 2023-11-29T08:57:30.489 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-29T08:57:30.489 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.489 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-29T08:57:30.489 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.489 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-29T08:57:30.489 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-29T08:57:30.489 INFO:tasks.workunit.client.0.smithi027.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-29T08:57:30.490 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.490 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-29T08:57:30.490 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.490 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-29T08:57:30.490 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.490 INFO:tasks.workunit.client.0.smithi027.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-29T08:57:30.490 INFO:tasks.workunit.client.0.smithi027.stderr:++++ export LANG=en_US.UTF-8 2023-11-29T08:57:30.490 INFO:tasks.workunit.client.0.smithi027.stderr:++++ LANG=en_US.UTF-8 2023-11-29T08:57:30.490 INFO:tasks.workunit.client.0.smithi027.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-29T08:57:30.490 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-29T08:57:30.490 INFO:tasks.workunit.client.0.smithi027.stderr:+ tee ceph_test_rados_api_asio.log 2023-11-29T08:57:30.490 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-29T08:57:30.490 INFO:tasks.workunit.client.0.smithi027.stderr:+++ LANG=en_US.UTF-8 2023-11-29T08:57:30.490 INFO:tasks.workunit.client.0.smithi027.stderr:+++ unset LANG_backup config 2023-11-29T08:57:30.491 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n '' ']' 2023-11-29T08:57:30.491 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n '' ']' 2023-11-29T08:57:30.491 INFO:tasks.workunit.client.0.smithi027.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-29T08:57:30.491 INFO:tasks.workunit.client.0.smithi027.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-29T08:57:30.491 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-29T08:57:30.491 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-29T08:57:30.491 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' dumb = linux ']' 2023-11-29T08:57:30.491 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-29T08:57:30.491 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.491 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-29T08:57:30.491 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.491 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/less.sh 2023-11-29T08:57:30.491 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-29T08:57:30.491 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.491 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-29T08:57:30.492 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.492 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/which2.sh 2023-11-29T08:57:30.492 INFO:tasks.workunit.client.0.smithi027.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-29T08:57:30.492 INFO:tasks.workunit.client.0.smithi027.stderr:+ sed 's/^/ api_asio: /' 2023-11-29T08:57:30.492 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-29T08:57:30.492 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-29T08:57:30.492 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-29T08:57:30.492 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.492 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-29T08:57:30.492 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.492 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-29T08:57:30.492 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-29T08:57:30.492 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.492 INFO:tasks.workunit.client.0.smithi027.stderr:++ awk '{print $1}' 2023-11-29T08:57:30.493 INFO:tasks.workunit.client.0.smithi027.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-29T08:57:30.493 INFO:tasks.workunit.client.0.smithi027.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-29T08:57:30.493 INFO:tasks.workunit.client.0.smithi027.stderr:++++ export LANG=en_US.UTF-8 2023-11-29T08:57:30.493 INFO:tasks.workunit.client.0.smithi027.stderr:++++ LANG=en_US.UTF-8 2023-11-29T08:57:30.493 INFO:tasks.workunit.client.0.smithi027.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-29T08:57:30.493 INFO:tasks.workunit.client.0.smithi027.stderr:+ ff=api_tier_pp 2023-11-29T08:57:30.493 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-29T08:57:30.493 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-29T08:57:30.493 INFO:tasks.workunit.client.0.smithi027.stderr:+++ LANG=en_US.UTF-8 2023-11-29T08:57:30.493 INFO:tasks.workunit.client.0.smithi027.stderr:+++ unset LANG_backup config 2023-11-29T08:57:30.493 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n '' ']' 2023-11-29T08:57:30.493 INFO:tasks.workunit.client.0.smithi027.stderr:+ pid=84457 2023-11-29T08:57:30.493 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-29T08:57:30.493 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' dumb = linux ']' 2023-11-29T08:57:30.493 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.493 INFO:tasks.workunit.client.0.smithi027.stderr:+ echo 'test api_tier_pp on pid 84457' 2023-11-29T08:57:30.494 INFO:tasks.workunit.client.0.smithi027.stdout:test api_tier_pp on pid 84457 2023-11-29T08:57:30.500 INFO:tasks.workunit.client.0.smithi027.stderr:+ pids[$f]=84457 2023-11-29T08:57:30.500 INFO:tasks.workunit.client.0.smithi027.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-29T08:57:30.500 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' 1 -eq 1 ']' 2023-11-29T08:57:30.500 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-29T08:57:30.500 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.500 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/less.sh 2023-11-29T08:57:30.500 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-29T08:57:30.500 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.500 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-29T08:57:30.501 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.501 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/which2.sh 2023-11-29T08:57:30.501 INFO:tasks.workunit.client.0.smithi027.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-29T08:57:30.501 INFO:tasks.workunit.client.0.smithi027.stderr:++ printf %25s api_pool 2023-11-29T08:57:30.501 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-29T08:57:30.501 INFO:tasks.workunit.client.0.smithi027.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_tier_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_tier_pp.xml 2>&1 | tee ceph_test_rados_api_tier_pp.log | sed "s/^/ api_tier_pp: /"' 2023-11-29T08:57:30.501 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-29T08:57:30.501 INFO:tasks.workunit.client.0.smithi027.stderr:+ r=' api_pool' 2023-11-29T08:57:30.501 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-29T08:57:30.501 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.501 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-29T08:57:30.501 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.501 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-29T08:57:30.501 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-29T08:57:30.501 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.502 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-29T08:57:30.502 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.502 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/gawk.sh 2023-11-29T08:57:30.502 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'grep=grep --color=auto' 2023-11-29T08:57:30.502 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-29T08:57:30.502 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-29T08:57:30.502 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.502 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-29T08:57:30.502 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.502 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorls.sh 2023-11-29T08:57:30.502 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' '!' -t 0 ']' 2023-11-29T08:57:30.502 INFO:tasks.workunit.client.0.smithi027.stderr:+++ return 2023-11-29T08:57:30.502 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.502 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-29T08:57:30.503 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.503 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-29T08:57:30.503 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export S_COLORS=auto 2023-11-29T08:57:30.503 INFO:tasks.workunit.client.0.smithi027.stderr:+++ S_COLORS=auto 2023-11-29T08:57:30.503 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.503 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-29T08:57:30.503 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.503 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-29T08:57:30.503 INFO:tasks.workunit.client.0.smithi027.stderr:++ awk '{print $1}' 2023-11-29T08:57:30.503 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.503 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.503 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-29T08:57:30.503 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.504 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/lang.sh 2023-11-29T08:57:30.504 INFO:tasks.workunit.client.0.smithi027.stderr:+++ unset LANG_backup 2023-11-29T08:57:30.504 INFO:tasks.workunit.client.0.smithi027.stderr:++++ /usr/bin/locale 2023-11-29T08:57:30.504 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' -f /etc/bashrc ']' 2023-11-29T08:57:30.504 INFO:tasks.workunit.client.0.smithi027.stderr:+ . /etc/bashrc 2023-11-29T08:57:30.504 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -z '' ']' 2023-11-29T08:57:30.504 INFO:tasks.workunit.client.0.smithi027.stderr:++ BASHRCSOURCED=Y 2023-11-29T08:57:30.504 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.504 INFO:tasks.workunit.client.0.smithi027.stderr:++ shopt -q login_shell 2023-11-29T08:57:30.504 INFO:tasks.workunit.client.0.smithi027.stderr:++ echo api_pool 2023-11-29T08:57:30.504 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n '' ']' 2023-11-29T08:57:30.504 INFO:tasks.workunit.client.0.smithi027.stderr:+++ umask 2023-11-29T08:57:30.504 INFO:tasks.workunit.client.0.smithi027.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-29T08:57:30.504 INFO:tasks.workunit.client.0.smithi027.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-29T08:57:30.504 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' 0022 -eq 0 ']' 2023-11-29T08:57:30.505 INFO:tasks.workunit.client.0.smithi027.stderr:++ SHELL=/bin/bash 2023-11-29T08:57:30.505 INFO:tasks.workunit.client.0.smithi027.stderr:+ ff=api_pool 2023-11-29T08:57:30.505 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-29T08:57:30.505 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.505 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-29T08:57:30.505 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.505 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-29T08:57:30.505 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-29T08:57:30.505 INFO:tasks.workunit.client.0.smithi027.stderr:+ pid=84468 2023-11-29T08:57:30.505 INFO:tasks.workunit.client.0.smithi027.stdout:test api_pool on pid 84468 2023-11-29T08:57:30.519 INFO:tasks.workunit.client.0.smithi027.stderr:+ echo 'test api_pool on pid 84468' 2023-11-29T08:57:30.519 INFO:tasks.workunit.client.0.smithi027.stderr:+ pids[$f]=84468 2023-11-29T08:57:30.519 INFO:tasks.workunit.client.0.smithi027.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-29T08:57:30.519 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-29T08:57:30.519 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' 1 -eq 1 ']' 2023-11-29T08:57:30.519 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.519 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-29T08:57:30.519 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.519 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-29T08:57:30.520 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-29T08:57:30.520 INFO:tasks.workunit.client.0.smithi027.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-29T08:57:30.520 INFO:tasks.workunit.client.0.smithi027.stderr:+++++ readlink /proc/84387/exe 2023-11-29T08:57:30.520 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.520 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-29T08:57:30.520 INFO:tasks.workunit.client.0.smithi027.stderr:+ ceph_test_rados_api_list --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_list.xml 2023-11-29T08:57:30.520 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.520 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-29T08:57:30.520 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.520 INFO:tasks.workunit.client.0.smithi027.stderr:++ printf %25s api_snapshots 2023-11-29T08:57:30.520 INFO:tasks.workunit.client.0.smithi027.stderr:+ r=' api_snapshots' 2023-11-29T08:57:30.520 INFO:tasks.workunit.client.0.smithi027.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_pool --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_pool.xml 2>&1 | tee ceph_test_rados_api_pool.log | sed "s/^/ api_pool: /"' 2023-11-29T08:57:30.520 INFO:tasks.workunit.client.0.smithi027.stderr:++++ basename /usr/bin/bash 2023-11-29T08:57:30.520 INFO:tasks.workunit.client.0.smithi027.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-29T08:57:30.521 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' -f /etc/bashrc ']' 2023-11-29T08:57:30.521 INFO:tasks.workunit.client.0.smithi027.stderr:+ . /etc/bashrc 2023-11-29T08:57:30.521 INFO:tasks.workunit.client.0.smithi027.stderr:+++ which_declare='declare -f' 2023-11-29T08:57:30.521 INFO:tasks.workunit.client.0.smithi027.stderr:+++ which_opt=-f 2023-11-29T08:57:30.521 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export which_declare 2023-11-29T08:57:30.521 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export -f which 2023-11-29T08:57:30.521 INFO:tasks.workunit.client.0.smithi027.stderr:++ unset i 2023-11-29T08:57:30.521 INFO:tasks.workunit.client.0.smithi027.stderr:++ unset -f pathmunge 2023-11-29T08:57:30.521 INFO:tasks.workunit.client.0.smithi027.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-29T08:57:30.521 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -z '' ']' 2023-11-29T08:57:30.521 INFO:tasks.workunit.client.0.smithi027.stderr:++ BASHRCSOURCED=Y 2023-11-29T08:57:30.521 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.521 INFO:tasks.workunit.client.0.smithi027.stderr:+ export PATH 2023-11-29T08:57:30.521 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-29T08:57:30.521 INFO:tasks.workunit.client.0.smithi027.stderr:+ unset rc 2023-11-29T08:57:30.522 INFO:tasks.workunit.client.0.smithi027.stderr:++ shopt -q login_shell 2023-11-29T08:57:30.522 INFO:tasks.workunit.client.0.smithi027.stderr:+++ umask 2023-11-29T08:57:30.522 INFO:tasks.workunit.client.0.smithi027.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-29T08:57:30.522 INFO:tasks.workunit.client.0.smithi027.stderr:++++ export LANG=en_US.UTF-8 2023-11-29T08:57:30.522 INFO:tasks.workunit.client.0.smithi027.stderr:++++ LANG=en_US.UTF-8 2023-11-29T08:57:30.522 INFO:tasks.workunit.client.0.smithi027.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-29T08:57:30.522 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-29T08:57:30.522 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-29T08:57:30.522 INFO:tasks.workunit.client.0.smithi027.stderr:+++ LANG=en_US.UTF-8 2023-11-29T08:57:30.522 INFO:tasks.workunit.client.0.smithi027.stderr:+++ unset LANG_backup config 2023-11-29T08:57:30.522 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n '' ']' 2023-11-29T08:57:30.522 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-29T08:57:30.522 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' dumb = linux ']' 2023-11-29T08:57:30.522 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.523 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-29T08:57:30.523 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.523 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/less.sh 2023-11-29T08:57:30.523 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-29T08:57:30.523 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.523 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-29T08:57:30.523 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.523 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/which2.sh 2023-11-29T08:57:30.523 INFO:tasks.workunit.client.0.smithi027.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-29T08:57:30.523 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' 0022 -eq 0 ']' 2023-11-29T08:57:30.523 INFO:tasks.workunit.client.0.smithi027.stderr:++ SHELL=/bin/bash 2023-11-29T08:57:30.524 INFO:tasks.workunit.client.0.smithi027.stderr:+ tee ceph_test_rados_api_lock_pp.log 2023-11-29T08:57:30.524 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.524 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-29T08:57:30.524 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.524 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-29T08:57:30.524 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-29T08:57:30.524 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.524 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-29T08:57:30.524 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.524 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-29T08:57:30.524 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-29T08:57:30.524 INFO:tasks.workunit.client.0.smithi027.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-29T08:57:30.524 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.524 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-29T08:57:30.525 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.525 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-29T08:57:30.525 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.525 INFO:tasks.workunit.client.0.smithi027.stderr:+++++ readlink /proc/84364/exe 2023-11-29T08:57:30.525 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-29T08:57:30.525 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-29T08:57:30.525 INFO:tasks.workunit.client.0.smithi027.stderr:++ echo api_snapshots 2023-11-29T08:57:30.525 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-29T08:57:30.525 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.525 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-29T08:57:30.525 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.525 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-29T08:57:30.525 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-29T08:57:30.525 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.525 INFO:tasks.workunit.client.0.smithi027.stderr:+ ceph_test_rados_api_lock_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_lock_pp.xml 2023-11-29T08:57:30.526 INFO:tasks.workunit.client.0.smithi027.stderr:++++ basename /usr/bin/bash 2023-11-29T08:57:30.526 INFO:tasks.workunit.client.0.smithi027.stderr:+++ which_declare='declare -f' 2023-11-29T08:57:30.526 INFO:tasks.workunit.client.0.smithi027.stderr:+++ which_opt=-f 2023-11-29T08:57:30.526 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export which_declare 2023-11-29T08:57:30.526 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export -f which 2023-11-29T08:57:30.526 INFO:tasks.workunit.client.0.smithi027.stderr:++ unset i 2023-11-29T08:57:30.526 INFO:tasks.workunit.client.0.smithi027.stderr:++ unset -f pathmunge 2023-11-29T08:57:30.526 INFO:tasks.workunit.client.0.smithi027.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-29T08:57:30.526 INFO:tasks.workunit.client.0.smithi027.stderr:+ export PATH 2023-11-29T08:57:30.526 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-29T08:57:30.526 INFO:tasks.workunit.client.0.smithi027.stderr:+ unset rc 2023-11-29T08:57:30.526 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'grep=grep --color=auto' 2023-11-29T08:57:30.526 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-29T08:57:30.526 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-29T08:57:30.526 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.527 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-29T08:57:30.527 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.527 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorls.sh 2023-11-29T08:57:30.527 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' '!' -t 0 ']' 2023-11-29T08:57:30.527 INFO:tasks.workunit.client.0.smithi027.stderr:+++ return 2023-11-29T08:57:30.527 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.527 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-29T08:57:30.527 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.527 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-29T08:57:30.527 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export S_COLORS=auto 2023-11-29T08:57:30.527 INFO:tasks.workunit.client.0.smithi027.stderr:+++ S_COLORS=auto 2023-11-29T08:57:30.527 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.527 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-29T08:57:30.527 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.527 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-29T08:57:30.528 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.528 INFO:tasks.workunit.client.0.smithi027.stderr:++ awk '{print $1}' 2023-11-29T08:57:30.528 INFO:tasks.workunit.client.0.smithi027.stderr:+ tee ceph_test_rados_api_lock.log 2023-11-29T08:57:30.528 INFO:tasks.workunit.client.0.smithi027.stderr:+ sed 's/^/ api_lock_pp: /' 2023-11-29T08:57:30.528 INFO:tasks.workunit.client.0.smithi027.stderr:+ ff=api_snapshots 2023-11-29T08:57:30.528 INFO:tasks.workunit.client.0.smithi027.stderr:+ pid=84498 2023-11-29T08:57:30.528 INFO:tasks.workunit.client.0.smithi027.stderr:+ echo 'test api_snapshots on pid 84498' 2023-11-29T08:57:30.528 INFO:tasks.workunit.client.0.smithi027.stdout:test api_snapshots on pid 84498 2023-11-29T08:57:30.537 INFO:tasks.workunit.client.0.smithi027.stderr:+ pids[$f]=84498 2023-11-29T08:57:30.537 INFO:tasks.workunit.client.0.smithi027.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-29T08:57:30.538 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' 1 -eq 1 ']' 2023-11-29T08:57:30.538 INFO:tasks.workunit.client.0.smithi027.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_snapshots.xml 2>&1 | tee ceph_test_rados_api_snapshots.log | sed "s/^/ api_snapshots: /"' 2023-11-29T08:57:30.538 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' -f /etc/bashrc ']' 2023-11-29T08:57:30.538 INFO:tasks.workunit.client.0.smithi027.stderr:+ . /etc/bashrc 2023-11-29T08:57:30.538 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -z '' ']' 2023-11-29T08:57:30.538 INFO:tasks.workunit.client.0.smithi027.stderr:++ BASHRCSOURCED=Y 2023-11-29T08:57:30.538 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.538 INFO:tasks.workunit.client.0.smithi027.stderr:++ shopt -q login_shell 2023-11-29T08:57:30.538 INFO:tasks.workunit.client.0.smithi027.stderr:+ ceph_test_rados_api_lock --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_lock.xml 2023-11-29T08:57:30.538 INFO:tasks.workunit.client.0.smithi027.stderr:+ sed 's/^/ api_lock: /' 2023-11-29T08:57:30.538 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'grep=grep --color=auto' 2023-11-29T08:57:30.538 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-29T08:57:30.538 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-29T08:57:30.538 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-29T08:57:30.539 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-29T08:57:30.539 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.539 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-29T08:57:30.539 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-29T08:57:30.539 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.539 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorls.sh 2023-11-29T08:57:30.539 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.539 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-29T08:57:30.539 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.539 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-29T08:57:30.539 INFO:tasks.workunit.client.0.smithi027.stderr:+++++ readlink /proc/84410/exe 2023-11-29T08:57:30.539 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-29T08:57:30.539 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' '!' -t 0 ']' 2023-11-29T08:57:30.539 INFO:tasks.workunit.client.0.smithi027.stderr:+++ return 2023-11-29T08:57:30.539 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.540 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-29T08:57:30.540 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.540 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.540 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-29T08:57:30.540 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/gawk.sh 2023-11-29T08:57:30.540 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.540 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-29T08:57:30.540 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export S_COLORS=auto 2023-11-29T08:57:30.540 INFO:tasks.workunit.client.0.smithi027.stderr:+++ S_COLORS=auto 2023-11-29T08:57:30.540 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.540 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-29T08:57:30.540 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.540 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.540 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-29T08:57:30.540 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-29T08:57:30.541 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.541 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/lang.sh 2023-11-29T08:57:30.541 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.541 INFO:tasks.workunit.client.0.smithi027.stderr:+++ unset LANG_backup 2023-11-29T08:57:30.541 INFO:tasks.workunit.client.0.smithi027.stderr:++++ /usr/bin/locale 2023-11-29T08:57:30.541 INFO:tasks.workunit.client.0.smithi027.stderr:++++ basename /usr/bin/bash 2023-11-29T08:57:30.541 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n '' ']' 2023-11-29T08:57:30.541 INFO:tasks.workunit.client.0.smithi027.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-29T08:57:30.541 INFO:tasks.workunit.client.0.smithi027.stderr:+++ which_declare='declare -f' 2023-11-29T08:57:30.541 INFO:tasks.workunit.client.0.smithi027.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-29T08:57:30.541 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-29T08:57:30.541 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-29T08:57:30.541 INFO:tasks.workunit.client.0.smithi027.stderr:+++ which_opt=-f 2023-11-29T08:57:30.541 INFO:tasks.workunit.client.0.smithi027.stderr:+++ umask 2023-11-29T08:57:30.541 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export which_declare 2023-11-29T08:57:30.542 INFO:tasks.workunit.client.0.smithi027.stderr:++ printf %25s api_snapshots_pp 2023-11-29T08:57:30.542 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export -f which 2023-11-29T08:57:30.542 INFO:tasks.workunit.client.0.smithi027.stderr:++ unset i 2023-11-29T08:57:30.542 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' 0022 -eq 0 ']' 2023-11-29T08:57:30.542 INFO:tasks.workunit.client.0.smithi027.stderr:++ SHELL=/bin/bash 2023-11-29T08:57:30.542 INFO:tasks.workunit.client.0.smithi027.stderr:+ r=' api_snapshots_pp' 2023-11-29T08:57:30.542 INFO:tasks.workunit.client.0.smithi027.stderr:++ unset -f pathmunge 2023-11-29T08:57:30.542 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.542 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-29T08:57:30.542 INFO:tasks.workunit.client.0.smithi027.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-29T08:57:30.542 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.542 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-29T08:57:30.542 INFO:tasks.workunit.client.0.smithi027.stderr:+ export PATH 2023-11-29T08:57:30.542 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-29T08:57:30.542 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.543 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-29T08:57:30.543 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-29T08:57:30.543 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.543 INFO:tasks.workunit.client.0.smithi027.stderr:+ unset rc 2023-11-29T08:57:30.543 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-29T08:57:30.543 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-29T08:57:30.543 INFO:tasks.workunit.client.0.smithi027.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-29T08:57:30.543 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.543 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-29T08:57:30.543 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.543 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-29T08:57:30.543 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.543 INFO:tasks.workunit.client.0.smithi027.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-29T08:57:30.543 INFO:tasks.workunit.client.0.smithi027.stderr:++ awk '{print $1}' 2023-11-29T08:57:30.543 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-29T08:57:30.544 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-29T08:57:30.544 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-29T08:57:30.544 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.544 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-29T08:57:30.544 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.544 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-29T08:57:30.544 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-29T08:57:30.544 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.544 INFO:tasks.workunit.client.0.smithi027.stderr:+ ceph_test_rados_api_misc --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_misc.xml 2023-11-29T08:57:30.544 INFO:tasks.workunit.client.0.smithi027.stderr:+ tee ceph_test_rados_api_misc.log 2023-11-29T08:57:30.544 INFO:tasks.workunit.client.0.smithi027.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-29T08:57:30.544 INFO:tasks.workunit.client.0.smithi027.stderr:++++ export LANG=en_US.UTF-8 2023-11-29T08:57:30.544 INFO:tasks.workunit.client.0.smithi027.stderr:++++ LANG=en_US.UTF-8 2023-11-29T08:57:30.545 INFO:tasks.workunit.client.0.smithi027.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-29T08:57:30.545 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-29T08:57:30.545 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-29T08:57:30.545 INFO:tasks.workunit.client.0.smithi027.stderr:+++ LANG=en_US.UTF-8 2023-11-29T08:57:30.545 INFO:tasks.workunit.client.0.smithi027.stderr:+++ unset LANG_backup config 2023-11-29T08:57:30.545 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n '' ']' 2023-11-29T08:57:30.545 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-29T08:57:30.545 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' dumb = linux ']' 2023-11-29T08:57:30.545 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.545 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-29T08:57:30.545 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.545 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/less.sh 2023-11-29T08:57:30.545 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-29T08:57:30.545 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.546 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-29T08:57:30.546 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.546 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/which2.sh 2023-11-29T08:57:30.546 INFO:tasks.workunit.client.0.smithi027.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-29T08:57:30.546 INFO:tasks.workunit.client.0.smithi027.stderr:++ echo api_snapshots_pp 2023-11-29T08:57:30.546 INFO:tasks.workunit.client.0.smithi027.stderr:+ sed 's/^/ api_misc: /' 2023-11-29T08:57:30.546 INFO:tasks.workunit.client.0.smithi027.stderr:+ ff=api_snapshots_pp 2023-11-29T08:57:30.546 INFO:tasks.workunit.client.0.smithi027.stderr:+ pid=84543 2023-11-29T08:57:30.546 INFO:tasks.workunit.client.0.smithi027.stderr:+ echo 'test api_snapshots_pp on pid 84543' 2023-11-29T08:57:30.546 INFO:tasks.workunit.client.0.smithi027.stdout:test api_snapshots_pp on pid 84543 2023-11-29T08:57:30.553 INFO:tasks.workunit.client.0.smithi027.stderr:+ pids[$f]=84543 2023-11-29T08:57:30.553 INFO:tasks.workunit.client.0.smithi027.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-29T08:57:30.553 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' 1 -eq 1 ']' 2023-11-29T08:57:30.553 INFO:tasks.workunit.client.0.smithi027.stderr:++ printf %25s api_stat 2023-11-29T08:57:30.553 INFO:tasks.workunit.client.0.smithi027.stderr:+ r=' api_stat' 2023-11-29T08:57:30.553 INFO:tasks.workunit.client.0.smithi027.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_snapshots_pp.xml 2>&1 | tee ceph_test_rados_api_snapshots_pp.log | sed "s/^/ api_snapshots_pp: /"' 2023-11-29T08:57:30.553 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' -f /etc/bashrc ']' 2023-11-29T08:57:30.553 INFO:tasks.workunit.client.0.smithi027.stderr:+ . /etc/bashrc 2023-11-29T08:57:30.553 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -z '' ']' 2023-11-29T08:57:30.553 INFO:tasks.workunit.client.0.smithi027.stderr:++ BASHRCSOURCED=Y 2023-11-29T08:57:30.553 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.554 INFO:tasks.workunit.client.0.smithi027.stderr:++ shopt -q login_shell 2023-11-29T08:57:30.554 INFO:tasks.workunit.client.0.smithi027.stderr:+++ umask 2023-11-29T08:57:30.554 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' 0022 -eq 0 ']' 2023-11-29T08:57:30.554 INFO:tasks.workunit.client.0.smithi027.stderr:++ SHELL=/bin/bash 2023-11-29T08:57:30.554 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.554 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-29T08:57:30.554 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.554 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-29T08:57:30.554 INFO:tasks.workunit.client.0.smithi027.stderr:++ awk '{print $1}' 2023-11-29T08:57:30.554 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-29T08:57:30.554 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.554 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-29T08:57:30.555 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.555 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-29T08:57:30.555 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-29T08:57:30.555 INFO:tasks.workunit.client.0.smithi027.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-29T08:57:30.555 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.555 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-29T08:57:30.555 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.555 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-29T08:57:30.555 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.555 INFO:tasks.workunit.client.0.smithi027.stderr:++ echo api_stat 2023-11-29T08:57:30.555 INFO:tasks.workunit.client.0.smithi027.stderr:+++++ readlink /proc/84434/exe 2023-11-29T08:57:30.555 INFO:tasks.workunit.client.0.smithi027.stderr:++++ basename /usr/bin/bash 2023-11-29T08:57:30.555 INFO:tasks.workunit.client.0.smithi027.stderr:+++ which_declare='declare -f' 2023-11-29T08:57:30.556 INFO:tasks.workunit.client.0.smithi027.stderr:+++ which_opt=-f 2023-11-29T08:57:30.556 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export which_declare 2023-11-29T08:57:30.556 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export -f which 2023-11-29T08:57:30.556 INFO:tasks.workunit.client.0.smithi027.stderr:++ unset i 2023-11-29T08:57:30.556 INFO:tasks.workunit.client.0.smithi027.stderr:++ unset -f pathmunge 2023-11-29T08:57:30.556 INFO:tasks.workunit.client.0.smithi027.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-29T08:57:30.556 INFO:tasks.workunit.client.0.smithi027.stderr:+ export PATH 2023-11-29T08:57:30.556 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-29T08:57:30.556 INFO:tasks.workunit.client.0.smithi027.stderr:+ unset rc 2023-11-29T08:57:30.556 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'grep=grep --color=auto' 2023-11-29T08:57:30.556 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-29T08:57:30.556 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-29T08:57:30.557 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.557 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-29T08:57:30.557 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.557 INFO:tasks.workunit.client.0.smithi027.stderr:+ ceph_test_rados_api_misc_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_misc_pp.xml 2023-11-29T08:57:30.557 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorls.sh 2023-11-29T08:57:30.557 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' '!' -t 0 ']' 2023-11-29T08:57:30.557 INFO:tasks.workunit.client.0.smithi027.stderr:+++ return 2023-11-29T08:57:30.557 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.557 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-29T08:57:30.557 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.558 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-29T08:57:30.558 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export S_COLORS=auto 2023-11-29T08:57:30.558 INFO:tasks.workunit.client.0.smithi027.stderr:+++ S_COLORS=auto 2023-11-29T08:57:30.558 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.558 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-29T08:57:30.558 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.558 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-29T08:57:30.558 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.558 INFO:tasks.workunit.client.0.smithi027.stderr:+ ff=api_stat 2023-11-29T08:57:30.558 INFO:tasks.workunit.client.0.smithi027.stderr:+ pid=84579 2023-11-29T08:57:30.558 INFO:tasks.workunit.client.0.smithi027.stderr:+ echo 'test api_stat on pid 84579' 2023-11-29T08:57:30.559 INFO:tasks.workunit.client.0.smithi027.stdout:test api_stat on pid 84579 2023-11-29T08:57:30.578 INFO:tasks.workunit.client.0.smithi027.stderr:+ pids[$f]=84579 2023-11-29T08:57:30.578 INFO:tasks.workunit.client.0.smithi027.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-29T08:57:30.578 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' 1 -eq 1 ']' 2023-11-29T08:57:30.579 INFO:tasks.workunit.client.0.smithi027.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_stat.xml 2>&1 | tee ceph_test_rados_api_stat.log | sed "s/^/ api_stat: /"' 2023-11-29T08:57:30.579 INFO:tasks.workunit.client.0.smithi027.stderr:+ tee ceph_test_rados_api_misc_pp.log 2023-11-29T08:57:30.579 INFO:tasks.workunit.client.0.smithi027.stderr:+ sed 's/^/ api_misc_pp: /' 2023-11-29T08:57:30.579 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' -f /etc/bashrc ']' 2023-11-29T08:57:30.579 INFO:tasks.workunit.client.0.smithi027.stderr:+ . /etc/bashrc 2023-11-29T08:57:30.579 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -z '' ']' 2023-11-29T08:57:30.579 INFO:tasks.workunit.client.0.smithi027.stderr:++ BASHRCSOURCED=Y 2023-11-29T08:57:30.579 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.579 INFO:tasks.workunit.client.0.smithi027.stderr:++ shopt -q login_shell 2023-11-29T08:57:30.579 INFO:tasks.workunit.client.0.smithi027.stderr:+++ umask 2023-11-29T08:57:30.579 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' 0022 -eq 0 ']' 2023-11-29T08:57:30.579 INFO:tasks.workunit.client.0.smithi027.stderr:++ SHELL=/bin/bash 2023-11-29T08:57:30.579 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.580 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-29T08:57:30.580 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.580 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-29T08:57:30.580 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-29T08:57:30.580 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.580 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-29T08:57:30.580 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.580 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-29T08:57:30.580 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-29T08:57:30.580 INFO:tasks.workunit.client.0.smithi027.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-29T08:57:30.580 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.580 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-29T08:57:30.580 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.580 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-29T08:57:30.581 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.581 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-29T08:57:30.581 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-29T08:57:30.581 INFO:tasks.workunit.client.0.smithi027.stderr:++ printf %25s api_stat_pp 2023-11-29T08:57:30.581 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-29T08:57:30.581 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-29T08:57:30.581 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-29T08:57:30.581 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-29T08:57:30.581 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.581 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.581 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-29T08:57:30.581 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-29T08:57:30.581 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.581 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-29T08:57:30.581 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.581 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-29T08:57:30.582 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-29T08:57:30.582 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.582 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-29T08:57:30.582 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.582 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-29T08:57:30.582 INFO:tasks.workunit.client.0.smithi027.stderr:+ r=' api_stat_pp' 2023-11-29T08:57:30.582 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.582 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/gawk.sh 2023-11-29T08:57:30.582 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.582 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-29T08:57:30.582 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'grep=grep --color=auto' 2023-11-29T08:57:30.582 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-29T08:57:30.582 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-29T08:57:30.582 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.583 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.583 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-29T08:57:30.583 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.583 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorls.sh 2023-11-29T08:57:30.583 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/lang.sh 2023-11-29T08:57:30.583 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' '!' -t 0 ']' 2023-11-29T08:57:30.583 INFO:tasks.workunit.client.0.smithi027.stderr:+++ return 2023-11-29T08:57:30.583 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.583 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-29T08:57:30.583 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.583 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-29T08:57:30.583 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export S_COLORS=auto 2023-11-29T08:57:30.583 INFO:tasks.workunit.client.0.smithi027.stderr:+++ S_COLORS=auto 2023-11-29T08:57:30.583 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.583 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-29T08:57:30.583 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.584 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-29T08:57:30.584 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.584 INFO:tasks.workunit.client.0.smithi027.stderr:+++ unset LANG_backup 2023-11-29T08:57:30.584 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-29T08:57:30.584 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-29T08:57:30.584 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-29T08:57:30.584 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.584 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-29T08:57:30.584 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.584 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-29T08:57:30.584 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-29T08:57:30.584 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.584 INFO:tasks.workunit.client.0.smithi027.stderr:++ echo api_stat_pp 2023-11-29T08:57:30.584 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-29T08:57:30.584 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-29T08:57:30.584 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-29T08:57:30.585 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-29T08:57:30.585 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.585 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-29T08:57:30.585 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.585 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-29T08:57:30.585 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-29T08:57:30.585 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-29T08:57:30.585 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.585 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-29T08:57:30.585 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.585 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/gawk.sh 2023-11-29T08:57:30.585 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-29T08:57:30.585 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.585 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.585 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-29T08:57:30.585 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.586 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-29T08:57:30.586 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-29T08:57:30.586 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-29T08:57:30.586 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.586 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/lang.sh 2023-11-29T08:57:30.586 INFO:tasks.workunit.client.0.smithi027.stderr:+++ unset LANG_backup 2023-11-29T08:57:30.586 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.586 INFO:tasks.workunit.client.0.smithi027.stderr:++++ /usr/bin/locale 2023-11-29T08:57:30.586 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n '' ']' 2023-11-29T08:57:30.586 INFO:tasks.workunit.client.0.smithi027.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-29T08:57:30.586 INFO:tasks.workunit.client.0.smithi027.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-29T08:57:30.586 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-29T08:57:30.586 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-29T08:57:30.586 INFO:tasks.workunit.client.0.smithi027.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-29T08:57:30.586 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-29T08:57:30.587 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-29T08:57:30.587 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-29T08:57:30.587 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.587 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-29T08:57:30.587 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.587 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-29T08:57:30.587 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-29T08:57:30.587 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-29T08:57:30.587 INFO:tasks.workunit.client.0.smithi027.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-29T08:57:30.587 INFO:tasks.workunit.client.0.smithi027.stderr:++++ export LANG=en_US.UTF-8 2023-11-29T08:57:30.587 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-29T08:57:30.587 INFO:tasks.workunit.client.0.smithi027.stderr:++++ LANG=en_US.UTF-8 2023-11-29T08:57:30.587 INFO:tasks.workunit.client.0.smithi027.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-29T08:57:30.587 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-29T08:57:30.587 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.587 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-29T08:57:30.588 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.588 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.588 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/gawk.sh 2023-11-29T08:57:30.588 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-29T08:57:30.588 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.588 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-29T08:57:30.588 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-29T08:57:30.588 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-29T08:57:30.588 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.588 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-29T08:57:30.588 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-29T08:57:30.588 INFO:tasks.workunit.client.0.smithi027.stderr:+++ LANG=en_US.UTF-8 2023-11-29T08:57:30.588 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.588 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/lang.sh 2023-11-29T08:57:30.588 INFO:tasks.workunit.client.0.smithi027.stderr:+++ unset LANG_backup config 2023-11-29T08:57:30.588 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n '' ']' 2023-11-29T08:57:30.589 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.589 INFO:tasks.workunit.client.0.smithi027.stderr:+++ unset LANG_backup 2023-11-29T08:57:30.589 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-29T08:57:30.589 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.589 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/gawk.sh 2023-11-29T08:57:30.589 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-29T08:57:30.589 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.589 INFO:tasks.workunit.client.0.smithi027.stderr:++++ /usr/bin/locale 2023-11-29T08:57:30.589 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-29T08:57:30.589 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.589 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/lang.sh 2023-11-29T08:57:30.589 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' dumb = linux ']' 2023-11-29T08:57:30.589 INFO:tasks.workunit.client.0.smithi027.stderr:+++ unset LANG_backup 2023-11-29T08:57:30.589 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.589 INFO:tasks.workunit.client.0.smithi027.stderr:++++ /usr/bin/locale 2023-11-29T08:57:30.589 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-29T08:57:30.590 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.590 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/less.sh 2023-11-29T08:57:30.590 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-29T08:57:30.590 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.590 INFO:tasks.workunit.client.0.smithi027.stderr:++++ /usr/bin/locale 2023-11-29T08:57:30.590 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-29T08:57:30.590 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.590 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/which2.sh 2023-11-29T08:57:30.590 INFO:tasks.workunit.client.0.smithi027.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-29T08:57:30.590 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n '' ']' 2023-11-29T08:57:30.590 INFO:tasks.workunit.client.0.smithi027.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-29T08:57:30.590 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n '' ']' 2023-11-29T08:57:30.590 INFO:tasks.workunit.client.0.smithi027.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-29T08:57:30.590 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-29T08:57:30.590 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-29T08:57:30.591 INFO:tasks.workunit.client.0.smithi027.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-29T08:57:30.591 INFO:tasks.workunit.client.0.smithi027.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-29T08:57:30.591 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-29T08:57:30.591 INFO:tasks.workunit.client.0.smithi027.stderr:+++++ readlink /proc/84457/exe 2023-11-29T08:57:30.591 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n '' ']' 2023-11-29T08:57:30.591 INFO:tasks.workunit.client.0.smithi027.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-29T08:57:30.591 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-29T08:57:30.591 INFO:tasks.workunit.client.0.smithi027.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-29T08:57:30.591 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-29T08:57:30.591 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-29T08:57:30.591 INFO:tasks.workunit.client.0.smithi027.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-29T08:57:30.591 INFO:tasks.workunit.client.0.smithi027.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-29T08:57:30.591 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'grep=grep --color=auto' 2023-11-29T08:57:30.591 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-29T08:57:30.591 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-29T08:57:30.591 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.592 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-29T08:57:30.592 INFO:tasks.workunit.client.0.smithi027.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-29T08:57:30.592 INFO:tasks.workunit.client.0.smithi027.stderr:++++ export LANG=en_US.UTF-8 2023-11-29T08:57:30.592 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.592 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorls.sh 2023-11-29T08:57:30.592 INFO:tasks.workunit.client.0.smithi027.stderr:++++ LANG=en_US.UTF-8 2023-11-29T08:57:30.592 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' '!' -t 0 ']' 2023-11-29T08:57:30.592 INFO:tasks.workunit.client.0.smithi027.stderr:+++ return 2023-11-29T08:57:30.592 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.592 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-29T08:57:30.592 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.592 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-29T08:57:30.592 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export S_COLORS=auto 2023-11-29T08:57:30.592 INFO:tasks.workunit.client.0.smithi027.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-29T08:57:30.592 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-29T08:57:30.593 INFO:tasks.workunit.client.0.smithi027.stderr:+++ S_COLORS=auto 2023-11-29T08:57:30.593 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-29T08:57:30.593 INFO:tasks.workunit.client.0.smithi027.stderr:+++ LANG=en_US.UTF-8 2023-11-29T08:57:30.593 INFO:tasks.workunit.client.0.smithi027.stderr:+++ unset LANG_backup config 2023-11-29T08:57:30.593 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.593 INFO:tasks.workunit.client.0.smithi027.stderr:++++ basename /usr/bin/bash 2023-11-29T08:57:30.593 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-29T08:57:30.593 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.593 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-29T08:57:30.593 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.593 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n '' ']' 2023-11-29T08:57:30.593 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-29T08:57:30.593 INFO:tasks.workunit.client.0.smithi027.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-29T08:57:30.593 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' dumb = linux ']' 2023-11-29T08:57:30.593 INFO:tasks.workunit.client.0.smithi027.stderr:++++ export LANG=en_US.UTF-8 2023-11-29T08:57:30.593 INFO:tasks.workunit.client.0.smithi027.stderr:++++ LANG=en_US.UTF-8 2023-11-29T08:57:30.594 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.594 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-29T08:57:30.594 INFO:tasks.workunit.client.0.smithi027.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-29T08:57:30.594 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.594 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-29T08:57:30.594 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/less.sh 2023-11-29T08:57:30.594 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-29T08:57:30.594 INFO:tasks.workunit.client.0.smithi027.stderr:+++ LANG=en_US.UTF-8 2023-11-29T08:57:30.594 INFO:tasks.workunit.client.0.smithi027.stderr:+++ unset LANG_backup config 2023-11-29T08:57:30.594 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-29T08:57:30.594 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n '' ']' 2023-11-29T08:57:30.594 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.594 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-29T08:57:30.594 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' dumb = linux ']' 2023-11-29T08:57:30.594 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.595 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-29T08:57:30.595 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.595 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/less.sh 2023-11-29T08:57:30.595 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-29T08:57:30.595 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-29T08:57:30.595 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.595 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-29T08:57:30.595 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.595 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/which2.sh 2023-11-29T08:57:30.595 INFO:tasks.workunit.client.0.smithi027.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-29T08:57:30.595 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.595 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/which2.sh 2023-11-29T08:57:30.595 INFO:tasks.workunit.client.0.smithi027.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-29T08:57:30.595 INFO:tasks.workunit.client.0.smithi027.stderr:+++ which_declare='declare -f' 2023-11-29T08:57:30.595 INFO:tasks.workunit.client.0.smithi027.stderr:+++ which_opt=-f 2023-11-29T08:57:30.596 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export which_declare 2023-11-29T08:57:30.596 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export -f which 2023-11-29T08:57:30.596 INFO:tasks.workunit.client.0.smithi027.stderr:++ unset i 2023-11-29T08:57:30.596 INFO:tasks.workunit.client.0.smithi027.stderr:++ awk '{print $1}' 2023-11-29T08:57:30.596 INFO:tasks.workunit.client.0.smithi027.stderr:++ unset -f pathmunge 2023-11-29T08:57:30.596 INFO:tasks.workunit.client.0.smithi027.stderr:+++++ readlink /proc/84468/exe 2023-11-29T08:57:30.596 INFO:tasks.workunit.client.0.smithi027.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-29T08:57:30.596 INFO:tasks.workunit.client.0.smithi027.stderr:+ export PATH 2023-11-29T08:57:30.596 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-29T08:57:30.596 INFO:tasks.workunit.client.0.smithi027.stderr:+ unset rc 2023-11-29T08:57:30.596 INFO:tasks.workunit.client.0.smithi027.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-29T08:57:30.596 INFO:tasks.workunit.client.0.smithi027.stderr:+ sed 's/^/ api_tier_pp: /' 2023-11-29T08:57:30.596 INFO:tasks.workunit.client.0.smithi027.stderr:+ ceph_test_rados_api_tier_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_tier_pp.xml 2023-11-29T08:57:30.596 INFO:tasks.workunit.client.0.smithi027.stderr:++++ basename /usr/bin/bash 2023-11-29T08:57:30.596 INFO:tasks.workunit.client.0.smithi027.stderr:+ tee ceph_test_rados_api_tier_pp.log 2023-11-29T08:57:30.597 INFO:tasks.workunit.client.0.smithi027.stderr:+ ff=api_stat_pp 2023-11-29T08:57:30.597 INFO:tasks.workunit.client.0.smithi027.stderr:+ pid=84631 2023-11-29T08:57:30.597 INFO:tasks.workunit.client.0.smithi027.stderr:+ echo 'test api_stat_pp on pid 84631' 2023-11-29T08:57:30.597 INFO:tasks.workunit.client.0.smithi027.stdout:test api_stat_pp on pid 84631 2023-11-29T08:57:30.604 INFO:tasks.workunit.client.0.smithi027.stderr:+ pids[$f]=84631 2023-11-29T08:57:30.604 INFO:tasks.workunit.client.0.smithi027.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-29T08:57:30.604 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' 1 -eq 1 ']' 2023-11-29T08:57:30.604 INFO:tasks.workunit.client.0.smithi027.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-29T08:57:30.604 INFO:tasks.workunit.client.0.smithi027.stderr:++++ export LANG=en_US.UTF-8 2023-11-29T08:57:30.604 INFO:tasks.workunit.client.0.smithi027.stderr:++++ LANG=en_US.UTF-8 2023-11-29T08:57:30.605 INFO:tasks.workunit.client.0.smithi027.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-29T08:57:30.605 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-29T08:57:30.605 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-29T08:57:30.605 INFO:tasks.workunit.client.0.smithi027.stderr:+++ LANG=en_US.UTF-8 2023-11-29T08:57:30.605 INFO:tasks.workunit.client.0.smithi027.stderr:+++ which_declare='declare -f' 2023-11-29T08:57:30.605 INFO:tasks.workunit.client.0.smithi027.stderr:+++ which_opt=-f 2023-11-29T08:57:30.605 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export which_declare 2023-11-29T08:57:30.605 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export -f which 2023-11-29T08:57:30.605 INFO:tasks.workunit.client.0.smithi027.stderr:++ unset i 2023-11-29T08:57:30.605 INFO:tasks.workunit.client.0.smithi027.stderr:++ unset -f pathmunge 2023-11-29T08:57:30.605 INFO:tasks.workunit.client.0.smithi027.stderr:+++ unset LANG_backup config 2023-11-29T08:57:30.605 INFO:tasks.workunit.client.0.smithi027.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-29T08:57:30.605 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n '' ']' 2023-11-29T08:57:30.605 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-29T08:57:30.605 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' dumb = linux ']' 2023-11-29T08:57:30.605 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.606 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-29T08:57:30.606 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.606 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/less.sh 2023-11-29T08:57:30.606 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-29T08:57:30.606 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.606 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-29T08:57:30.606 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.606 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/which2.sh 2023-11-29T08:57:30.606 INFO:tasks.workunit.client.0.smithi027.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-29T08:57:30.606 INFO:tasks.workunit.client.0.smithi027.stderr:+ export PATH 2023-11-29T08:57:30.606 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-29T08:57:30.606 INFO:tasks.workunit.client.0.smithi027.stderr:+ unset rc 2023-11-29T08:57:30.606 INFO:tasks.workunit.client.0.smithi027.stderr:+++++ readlink /proc/84498/exe 2023-11-29T08:57:30.606 INFO:tasks.workunit.client.0.smithi027.stderr:+ ceph_test_rados_api_pool --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_pool.xml 2023-11-29T08:57:30.607 INFO:tasks.workunit.client.0.smithi027.stderr:+ tee ceph_test_rados_api_pool.log 2023-11-29T08:57:30.607 INFO:tasks.workunit.client.0.smithi027.stderr:+ sed 's/^/ api_pool: /' 2023-11-29T08:57:30.607 INFO:tasks.workunit.client.0.smithi027.stderr:++++ basename /usr/bin/bash 2023-11-29T08:57:30.607 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-29T08:57:30.607 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-29T08:57:30.607 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-29T08:57:30.607 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.607 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-29T08:57:30.607 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.607 INFO:tasks.workunit.client.0.smithi027.stderr:+++ which_declare='declare -f' 2023-11-29T08:57:30.607 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-29T08:57:30.607 INFO:tasks.workunit.client.0.smithi027.stderr:+++ which_opt=-f 2023-11-29T08:57:30.607 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-29T08:57:30.607 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.607 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export which_declare 2023-11-29T08:57:30.607 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export -f which 2023-11-29T08:57:30.607 INFO:tasks.workunit.client.0.smithi027.stderr:++ unset i 2023-11-29T08:57:30.608 INFO:tasks.workunit.client.0.smithi027.stderr:++ unset -f pathmunge 2023-11-29T08:57:30.608 INFO:tasks.workunit.client.0.smithi027.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-29T08:57:30.608 INFO:tasks.workunit.client.0.smithi027.stderr:+ export PATH 2023-11-29T08:57:30.608 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-29T08:57:30.608 INFO:tasks.workunit.client.0.smithi027.stderr:+ unset rc 2023-11-29T08:57:30.608 INFO:tasks.workunit.client.0.smithi027.stderr:+ sed 's/^/ api_snapshots: /' 2023-11-29T08:57:30.608 INFO:tasks.workunit.client.0.smithi027.stderr:+ tee ceph_test_rados_api_snapshots.log 2023-11-29T08:57:30.608 INFO:tasks.workunit.client.0.smithi027.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_stat_pp.xml 2>&1 | tee ceph_test_rados_api_stat_pp.log | sed "s/^/ api_stat_pp: /"' 2023-11-29T08:57:30.608 INFO:tasks.workunit.client.0.smithi027.stderr:+ ceph_test_rados_api_snapshots --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_snapshots.xml 2023-11-29T08:57:30.608 INFO:tasks.workunit.client.0.smithi027.stderr:++ printf %25s api_watch_notify 2023-11-29T08:57:30.608 INFO:tasks.workunit.client.0.smithi027.stderr:+ r=' api_watch_notify' 2023-11-29T08:57:30.608 INFO:tasks.workunit.client.0.smithi027.stderr:+++++ readlink /proc/84543/exe 2023-11-29T08:57:30.608 INFO:tasks.workunit.client.0.smithi027.stderr:++ awk '{print $1}' 2023-11-29T08:57:30.608 INFO:tasks.workunit.client.0.smithi027.stderr:++++ basename /usr/bin/bash 2023-11-29T08:57:30.608 INFO:tasks.workunit.client.0.smithi027.stderr:++ echo api_watch_notify 2023-11-29T08:57:30.609 INFO:tasks.workunit.client.0.smithi027.stderr:+ ff=api_watch_notify 2023-11-29T08:57:30.609 INFO:tasks.workunit.client.0.smithi027.stderr:+++ which_declare='declare -f' 2023-11-29T08:57:30.609 INFO:tasks.workunit.client.0.smithi027.stderr:+++ which_opt=-f 2023-11-29T08:57:30.609 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' -f /etc/bashrc ']' 2023-11-29T08:57:30.609 INFO:tasks.workunit.client.0.smithi027.stderr:+ . /etc/bashrc 2023-11-29T08:57:30.609 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export which_declare 2023-11-29T08:57:30.609 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export -f which 2023-11-29T08:57:30.609 INFO:tasks.workunit.client.0.smithi027.stderr:++ unset i 2023-11-29T08:57:30.609 INFO:tasks.workunit.client.0.smithi027.stderr:++ unset -f pathmunge 2023-11-29T08:57:30.609 INFO:tasks.workunit.client.0.smithi027.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-29T08:57:30.609 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -z '' ']' 2023-11-29T08:57:30.609 INFO:tasks.workunit.client.0.smithi027.stderr:++ BASHRCSOURCED=Y 2023-11-29T08:57:30.609 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.609 INFO:tasks.workunit.client.0.smithi027.stderr:++ shopt -q login_shell 2023-11-29T08:57:30.609 INFO:tasks.workunit.client.0.smithi027.stderr:+ export PATH 2023-11-29T08:57:30.609 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-29T08:57:30.609 INFO:tasks.workunit.client.0.smithi027.stderr:+ unset rc 2023-11-29T08:57:30.610 INFO:tasks.workunit.client.0.smithi027.stderr:+ pid=84679 2023-11-29T08:57:30.610 INFO:tasks.workunit.client.0.smithi027.stderr:+ echo 'test api_watch_notify on pid 84679' 2023-11-29T08:57:30.610 INFO:tasks.workunit.client.0.smithi027.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_watch_notify.xml 2>&1 | tee ceph_test_rados_api_watch_notify.log | sed "s/^/ api_watch_notify: /"' 2023-11-29T08:57:30.610 INFO:tasks.workunit.client.0.smithi027.stdout:test api_watch_notify on pid 84679 2023-11-29T08:57:30.621 INFO:tasks.workunit.client.0.smithi027.stderr:+ pids[$f]=84679 2023-11-29T08:57:30.621 INFO:tasks.workunit.client.0.smithi027.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-29T08:57:30.622 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' 1 -eq 1 ']' 2023-11-29T08:57:30.622 INFO:tasks.workunit.client.0.smithi027.stderr:+ sed 's/^/ api_snapshots_pp: /' 2023-11-29T08:57:30.622 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' -f /etc/bashrc ']' 2023-11-29T08:57:30.622 INFO:tasks.workunit.client.0.smithi027.stderr:+ . /etc/bashrc 2023-11-29T08:57:30.622 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -z '' ']' 2023-11-29T08:57:30.622 INFO:tasks.workunit.client.0.smithi027.stderr:++ BASHRCSOURCED=Y 2023-11-29T08:57:30.622 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.622 INFO:tasks.workunit.client.0.smithi027.stderr:++ shopt -q login_shell 2023-11-29T08:57:30.622 INFO:tasks.workunit.client.0.smithi027.stderr:++ printf %25s api_watch_notify_pp 2023-11-29T08:57:30.622 INFO:tasks.workunit.client.0.smithi027.stderr:+ r=' api_watch_notify_pp' 2023-11-29T08:57:30.622 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-29T08:57:30.623 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-29T08:57:30.623 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-29T08:57:30.623 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.623 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-29T08:57:30.623 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.623 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-29T08:57:30.623 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-29T08:57:30.624 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.624 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-29T08:57:30.624 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.624 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/gawk.sh 2023-11-29T08:57:30.624 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.624 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-29T08:57:30.624 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.624 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/lang.sh 2023-11-29T08:57:30.624 INFO:tasks.workunit.client.0.smithi027.stderr:+++ unset LANG_backup 2023-11-29T08:57:30.624 INFO:tasks.workunit.client.0.smithi027.stderr:+++ umask 2023-11-29T08:57:30.624 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' 0022 -eq 0 ']' 2023-11-29T08:57:30.624 INFO:tasks.workunit.client.0.smithi027.stderr:++ SHELL=/bin/bash 2023-11-29T08:57:30.624 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.624 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-29T08:57:30.625 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.625 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-29T08:57:30.625 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-29T08:57:30.625 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.625 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-29T08:57:30.625 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.625 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-29T08:57:30.625 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-29T08:57:30.625 INFO:tasks.workunit.client.0.smithi027.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-29T08:57:30.625 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.625 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-29T08:57:30.626 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.626 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-29T08:57:30.626 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.626 INFO:tasks.workunit.client.0.smithi027.stderr:+++ umask 2023-11-29T08:57:30.626 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' 0022 -eq 0 ']' 2023-11-29T08:57:30.626 INFO:tasks.workunit.client.0.smithi027.stderr:++ SHELL=/bin/bash 2023-11-29T08:57:30.626 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.626 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-29T08:57:30.626 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.626 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-29T08:57:30.626 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-29T08:57:30.627 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.627 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-29T08:57:30.627 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.627 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-29T08:57:30.627 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-29T08:57:30.627 INFO:tasks.workunit.client.0.smithi027.stderr:+ tee ceph_test_rados_api_snapshots_pp.log 2023-11-29T08:57:30.627 INFO:tasks.workunit.client.0.smithi027.stderr:+ ceph_test_rados_api_snapshots_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_snapshots_pp.xml 2023-11-29T08:57:30.627 INFO:tasks.workunit.client.0.smithi027.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-29T08:57:30.627 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.627 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-29T08:57:30.627 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.627 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-29T08:57:30.627 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.628 INFO:tasks.workunit.client.0.smithi027.stderr:++++ /usr/bin/locale 2023-11-29T08:57:30.628 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n '' ']' 2023-11-29T08:57:30.628 INFO:tasks.workunit.client.0.smithi027.stderr:++ awk '{print $1}' 2023-11-29T08:57:30.628 INFO:tasks.workunit.client.0.smithi027.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-29T08:57:30.628 INFO:tasks.workunit.client.0.smithi027.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-29T08:57:30.628 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-29T08:57:30.628 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-29T08:57:30.628 INFO:tasks.workunit.client.0.smithi027.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-29T08:57:30.628 INFO:tasks.workunit.client.0.smithi027.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-29T08:57:30.628 INFO:tasks.workunit.client.0.smithi027.stderr:++++ export LANG=en_US.UTF-8 2023-11-29T08:57:30.628 INFO:tasks.workunit.client.0.smithi027.stderr:++++ LANG=en_US.UTF-8 2023-11-29T08:57:30.628 INFO:tasks.workunit.client.0.smithi027.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-29T08:57:30.628 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-29T08:57:30.628 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-29T08:57:30.628 INFO:tasks.workunit.client.0.smithi027.stderr:+++ LANG=en_US.UTF-8 2023-11-29T08:57:30.628 INFO:tasks.workunit.client.0.smithi027.stderr:+++ unset LANG_backup config 2023-11-29T08:57:30.629 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n '' ']' 2023-11-29T08:57:30.629 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-29T08:57:30.629 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' dumb = linux ']' 2023-11-29T08:57:30.629 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.629 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-29T08:57:30.629 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.629 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/less.sh 2023-11-29T08:57:30.629 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-29T08:57:30.629 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.629 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-29T08:57:30.629 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.629 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/which2.sh 2023-11-29T08:57:30.629 INFO:tasks.workunit.client.0.smithi027.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-29T08:57:30.629 INFO:tasks.workunit.client.0.smithi027.stderr:+++++ readlink /proc/84579/exe 2023-11-29T08:57:30.630 INFO:tasks.workunit.client.0.smithi027.stderr:++++ basename /usr/bin/bash 2023-11-29T08:57:30.630 INFO:tasks.workunit.client.0.smithi027.stderr:+++ which_declare='declare -f' 2023-11-29T08:57:30.630 INFO:tasks.workunit.client.0.smithi027.stderr:+++ which_opt=-f 2023-11-29T08:57:30.630 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export which_declare 2023-11-29T08:57:30.630 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export -f which 2023-11-29T08:57:30.630 INFO:tasks.workunit.client.0.smithi027.stderr:++ unset i 2023-11-29T08:57:30.630 INFO:tasks.workunit.client.0.smithi027.stderr:++ unset -f pathmunge 2023-11-29T08:57:30.630 INFO:tasks.workunit.client.0.smithi027.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-29T08:57:30.630 INFO:tasks.workunit.client.0.smithi027.stderr:+ export PATH 2023-11-29T08:57:30.630 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-29T08:57:30.630 INFO:tasks.workunit.client.0.smithi027.stderr:+ unset rc 2023-11-29T08:57:30.630 INFO:tasks.workunit.client.0.smithi027.stderr:+ ceph_test_rados_api_stat --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_stat.xml 2023-11-29T08:57:30.630 INFO:tasks.workunit.client.0.smithi027.stderr:++ echo api_watch_notify_pp 2023-11-29T08:57:30.631 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'grep=grep --color=auto' 2023-11-29T08:57:30.631 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-29T08:57:30.631 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-29T08:57:30.631 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.631 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-29T08:57:30.631 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.631 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorls.sh 2023-11-29T08:57:30.631 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' '!' -t 0 ']' 2023-11-29T08:57:30.632 INFO:tasks.workunit.client.0.smithi027.stderr:+++ return 2023-11-29T08:57:30.632 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.632 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-29T08:57:30.632 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.632 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-29T08:57:30.632 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export S_COLORS=auto 2023-11-29T08:57:30.632 INFO:tasks.workunit.client.0.smithi027.stderr:+++ S_COLORS=auto 2023-11-29T08:57:30.632 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.632 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-29T08:57:30.632 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.632 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-29T08:57:30.632 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.632 INFO:tasks.workunit.client.0.smithi027.stderr:+ ff=api_watch_notify_pp 2023-11-29T08:57:30.632 INFO:tasks.workunit.client.0.smithi027.stderr:+ pid=84713 2023-11-29T08:57:30.632 INFO:tasks.workunit.client.0.smithi027.stderr:+ echo 'test api_watch_notify_pp on pid 84713' 2023-11-29T08:57:30.633 INFO:tasks.workunit.client.0.smithi027.stdout:test api_watch_notify_pp on pid 84713 2023-11-29T08:57:30.633 INFO:tasks.workunit.client.0.smithi027.stderr:+ pids[$f]=84713 2023-11-29T08:57:30.633 INFO:tasks.workunit.client.0.smithi027.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-29T08:57:30.633 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' 1 -eq 1 ']' 2023-11-29T08:57:30.634 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:30.440+0000 7fa359258640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:57:30.634 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: [==========] Running 12 tests from 1 test suite. 2023-11-29T08:57:30.634 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: [----------] Global test environment set-up. 2023-11-29T08:57:30.634 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: [----------] 12 tests from AsioRados 2023-11-29T08:57:30.634 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:30.483+0000 7fa359258640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:57:30.634 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:30.483+0000 7fa359258640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:57:30.634 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:30.484+0000 7fa359258640 1 Processor -- start 2023-11-29T08:57:30.634 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:30.484+0000 7fa359258640 1 -- start start 2023-11-29T08:57:30.634 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:30.485+0000 7fa359258640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dcc32ef660 0x55dcc32d4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:57:30.634 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:30.485+0000 7fa359258640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcc31ead50 con 0x55dcc32ef660 2023-11-29T08:57:30.634 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:30.485+0000 7fa35239a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dcc32ef660 0x55dcc32d4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:57:30.635 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:30.486+0000 7fa35239a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dcc32ef660 0x55dcc32d4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:50540/0 (socket says 172.21.15.27:50540) 2023-11-29T08:57:30.635 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:30.486+0000 7fa35239a640 1 -- 172.21.15.27:0/3206243509 learned_addr learned my addr 172.21.15.27:0/3206243509 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-11-29T08:57:30.635 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:30.488+0000 7fa35239a640 1 -- 172.21.15.27:0/3206243509 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dcc318c630 con 0x55dcc32ef660 2023-11-29T08:57:30.635 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:30.488+0000 7fa35239a640 1 --2- 172.21.15.27:0/3206243509 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dcc32ef660 0x55dcc32d4450 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e3f531a25d4f5d7 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:57:30.635 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:30.522+0000 7fa350b97640 1 -- 172.21.15.27:0/3206243509 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fa34c0060b0 con 0x55dcc32ef660 2023-11-29T08:57:30.635 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:30.522+0000 7fa350b97640 1 -- 172.21.15.27:0/3206243509 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fa34c006210 con 0x55dcc32ef660 2023-11-29T08:57:30.635 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:30.522+0000 7fa350b97640 1 -- 172.21.15.27:0/3206243509 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fa34c001b60 con 0x55dcc32ef660 2023-11-29T08:57:30.635 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:30.525+0000 7fa359258640 1 -- 172.21.15.27:0/3206243509 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dcc32ef660 msgr2=0x55dcc32d4450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:57:30.635 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:30.525+0000 7fa359258640 1 --2- 172.21.15.27:0/3206243509 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dcc32ef660 0x55dcc32d4450 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:57:30.635 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:30.525+0000 7fa359258640 1 -- 172.21.15.27:0/3206243509 shutdown_connections 2023-11-29T08:57:30.648 INFO:tasks.workunit.client.0.smithi027.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_watch_notify_pp.xml 2>&1 | tee ceph_test_rados_api_watch_notify_pp.log | sed "s/^/ api_watch_notify_pp: /"' 2023-11-29T08:57:30.648 INFO:tasks.workunit.client.0.smithi027.stderr:+ tee ceph_test_rados_api_stat.log 2023-11-29T08:57:30.648 INFO:tasks.workunit.client.0.smithi027.stderr:+ sed 's/^/ api_stat: /' 2023-11-29T08:57:30.648 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' -f /etc/bashrc ']' 2023-11-29T08:57:30.648 INFO:tasks.workunit.client.0.smithi027.stderr:+ . /etc/bashrc 2023-11-29T08:57:30.649 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -z '' ']' 2023-11-29T08:57:30.649 INFO:tasks.workunit.client.0.smithi027.stderr:++ BASHRCSOURCED=Y 2023-11-29T08:57:30.649 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.649 INFO:tasks.workunit.client.0.smithi027.stderr:++ shopt -q login_shell 2023-11-29T08:57:30.649 INFO:tasks.workunit.client.0.smithi027.stderr:+++ umask 2023-11-29T08:57:30.649 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' 0022 -eq 0 ']' 2023-11-29T08:57:30.649 INFO:tasks.workunit.client.0.smithi027.stderr:++ SHELL=/bin/bash 2023-11-29T08:57:30.649 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.649 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-29T08:57:30.649 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.649 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-29T08:57:30.649 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-29T08:57:30.649 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.649 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-29T08:57:30.649 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.650 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-29T08:57:30.650 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-29T08:57:30.650 INFO:tasks.workunit.client.0.smithi027.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-29T08:57:30.650 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.650 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-29T08:57:30.650 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.650 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-29T08:57:30.650 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.650 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-29T08:57:30.650 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-29T08:57:30.651 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-29T08:57:30.651 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.651 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-29T08:57:30.651 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.651 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-29T08:57:30.651 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-29T08:57:30.651 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.651 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'grep=grep --color=auto' 2023-11-29T08:57:30.651 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-29T08:57:30.651 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-29T08:57:30.651 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.651 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-29T08:57:30.652 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.652 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorls.sh 2023-11-29T08:57:30.652 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' '!' -t 0 ']' 2023-11-29T08:57:30.652 INFO:tasks.workunit.client.0.smithi027.stderr:+++ return 2023-11-29T08:57:30.652 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.652 INFO:tasks.workunit.client.0.smithi027.stderr:++ printf %25s api_cmd 2023-11-29T08:57:30.652 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-29T08:57:30.652 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.652 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-29T08:57:30.652 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export S_COLORS=auto 2023-11-29T08:57:30.652 INFO:tasks.workunit.client.0.smithi027.stderr:+++ S_COLORS=auto 2023-11-29T08:57:30.653 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.653 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-29T08:57:30.653 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.653 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-29T08:57:30.653 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.653 INFO:tasks.workunit.client.0.smithi027.stderr:+ r=' api_cmd' 2023-11-29T08:57:30.653 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-29T08:57:30.653 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-29T08:57:30.653 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-29T08:57:30.653 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.653 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-29T08:57:30.653 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.653 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-29T08:57:30.654 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-29T08:57:30.654 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.654 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-29T08:57:30.654 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.654 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/gawk.sh 2023-11-29T08:57:30.654 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.654 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-29T08:57:30.654 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.654 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/lang.sh 2023-11-29T08:57:30.654 INFO:tasks.workunit.client.0.smithi027.stderr:+++ unset LANG_backup 2023-11-29T08:57:30.654 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'grep=grep --color=auto' 2023-11-29T08:57:30.654 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-29T08:57:30.655 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-29T08:57:30.655 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.655 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-29T08:57:30.655 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.655 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorls.sh 2023-11-29T08:57:30.655 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' '!' -t 0 ']' 2023-11-29T08:57:30.655 INFO:tasks.workunit.client.0.smithi027.stderr:+++ return 2023-11-29T08:57:30.655 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.655 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-29T08:57:30.655 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.655 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-29T08:57:30.656 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export S_COLORS=auto 2023-11-29T08:57:30.656 INFO:tasks.workunit.client.0.smithi027.stderr:+++ S_COLORS=auto 2023-11-29T08:57:30.656 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.656 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-29T08:57:30.656 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.656 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-29T08:57:30.656 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.656 INFO:tasks.workunit.client.0.smithi027.stderr:++++ /usr/bin/locale 2023-11-29T08:57:30.656 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-29T08:57:30.656 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-29T08:57:30.656 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-29T08:57:30.656 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.656 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-29T08:57:30.657 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.657 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-29T08:57:30.657 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-29T08:57:30.657 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.657 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n '' ']' 2023-11-29T08:57:30.657 INFO:tasks.workunit.client.0.smithi027.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-29T08:57:30.657 INFO:tasks.workunit.client.0.smithi027.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-29T08:57:30.657 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-29T08:57:30.657 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-29T08:57:30.658 INFO:tasks.workunit.client.0.smithi027.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-29T08:57:30.658 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-29T08:57:30.658 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-29T08:57:30.658 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-29T08:57:30.658 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.658 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-29T08:57:30.658 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.658 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-29T08:57:30.658 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-29T08:57:30.658 INFO:tasks.workunit.client.0.smithi027.stderr:++ echo api_cmd 2023-11-29T08:57:30.658 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.658 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-29T08:57:30.659 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.659 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/gawk.sh 2023-11-29T08:57:30.659 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.659 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-29T08:57:30.659 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.659 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/lang.sh 2023-11-29T08:57:30.659 INFO:tasks.workunit.client.0.smithi027.stderr:+++ unset LANG_backup 2023-11-29T08:57:30.659 INFO:tasks.workunit.client.0.smithi027.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-29T08:57:30.659 INFO:tasks.workunit.client.0.smithi027.stderr:++++ export LANG=en_US.UTF-8 2023-11-29T08:57:30.659 INFO:tasks.workunit.client.0.smithi027.stderr:++++ LANG=en_US.UTF-8 2023-11-29T08:57:30.659 INFO:tasks.workunit.client.0.smithi027.stderr:++ awk '{print $1}' 2023-11-29T08:57:30.659 INFO:tasks.workunit.client.0.smithi027.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-29T08:57:30.660 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-29T08:57:30.660 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-29T08:57:30.660 INFO:tasks.workunit.client.0.smithi027.stderr:+++ LANG=en_US.UTF-8 2023-11-29T08:57:30.660 INFO:tasks.workunit.client.0.smithi027.stderr:+++ unset LANG_backup config 2023-11-29T08:57:30.660 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n '' ']' 2023-11-29T08:57:30.660 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-29T08:57:30.660 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' dumb = linux ']' 2023-11-29T08:57:30.660 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.660 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-29T08:57:30.660 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.660 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/less.sh 2023-11-29T08:57:30.660 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-29T08:57:30.660 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.661 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-29T08:57:30.661 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.661 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/which2.sh 2023-11-29T08:57:30.661 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-29T08:57:30.661 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-29T08:57:30.661 INFO:tasks.workunit.client.0.smithi027.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-29T08:57:30.661 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-29T08:57:30.661 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.661 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-29T08:57:30.661 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.661 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-29T08:57:30.661 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-29T08:57:30.661 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.661 INFO:tasks.workunit.client.0.smithi027.stderr:+++++ readlink /proc/84631/exe 2023-11-29T08:57:30.661 INFO:tasks.workunit.client.0.smithi027.stderr:++++ /usr/bin/locale 2023-11-29T08:57:30.661 INFO:tasks.workunit.client.0.smithi027.stderr:+ ff=api_cmd 2023-11-29T08:57:30.662 INFO:tasks.workunit.client.0.smithi027.stderr:+ pid=84799 2023-11-29T08:57:30.662 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:30.525+0000 7fa359258640 1 --2- 172.21test api_cmd on pid 84799 2023-11-29T08:57:30.670 INFO:tasks.workunit.client.0.smithi027.stderr:+ echo 'test api_cmd on pid 84799' 2023-11-29T08:57:30.670 INFO:tasks.workunit.client.0.smithi027.stderr:+ pids[$f]=84799 2023-11-29T08:57:30.671 INFO:tasks.workunit.client.0.smithi027.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-29T08:57:30.671 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' 1 -eq 1 ']' 2023-11-29T08:57:30.671 INFO:tasks.workunit.client.0.smithi027.stderr:++++ basename /usr/bin/bash 2023-11-29T08:57:30.671 INFO:tasks.workunit.client.0.smithi027.stderr:++ printf %25s api_cmd_pp 2023-11-29T08:57:30.671 INFO:tasks.workunit.client.0.smithi027.stderr:+ r=' api_cmd_pp' 2023-11-29T08:57:30.671 INFO:tasks.workunit.client.0.smithi027.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_cmd.xml 2>&1 | tee ceph_test_rados_api_cmd.log | sed "s/^/ api_cmd: /"' 2023-11-29T08:57:30.671 INFO:tasks.workunit.client.0.smithi027.stderr:+++ which_declare='declare -f' 2023-11-29T08:57:30.671 INFO:tasks.workunit.client.0.smithi027.stderr:+++ which_opt=-f 2023-11-29T08:57:30.671 INFO:tasks.workunit.client.0.smithi027.stderr:++ echo api_cmd_pp 2023-11-29T08:57:30.671 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export which_declare 2023-11-29T08:57:30.671 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export -f which 2023-11-29T08:57:30.672 INFO:tasks.workunit.client.0.smithi027.stderr:++ unset i 2023-11-29T08:57:30.672 INFO:tasks.workunit.client.0.smithi027.stderr:++ unset -f pathmunge 2023-11-29T08:57:30.672 INFO:tasks.workunit.client.0.smithi027.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-29T08:57:30.672 INFO:tasks.workunit.client.0.smithi027.stderr:+ export PATH 2023-11-29T08:57:30.672 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-29T08:57:30.672 INFO:tasks.workunit.client.0.smithi027.stderr:+ unset rc 2023-11-29T08:57:30.672 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' -f /etc/bashrc ']' 2023-11-29T08:57:30.672 INFO:tasks.workunit.client.0.smithi027.stderr:+ . /etc/bashrc 2023-11-29T08:57:30.672 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -z '' ']' 2023-11-29T08:57:30.672 INFO:tasks.workunit.client.0.smithi027.stderr:++ BASHRCSOURCED=Y 2023-11-29T08:57:30.672 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.672 INFO:tasks.workunit.client.0.smithi027.stderr:++ shopt -q login_shell 2023-11-29T08:57:30.672 INFO:tasks.workunit.client.0.smithi027.stderr:+ ceph_test_rados_api_stat_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_stat_pp.xml 2023-11-29T08:57:30.673 INFO:tasks.workunit.client.0.smithi027.stderr:+++ umask 2023-11-29T08:57:30.673 INFO:tasks.workunit.client.0.smithi027.stderr:+ sed 's/^/ api_stat_pp: /' 2023-11-29T08:57:30.673 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n '' ']' 2023-11-29T08:57:30.673 INFO:tasks.workunit.client.0.smithi027.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-29T08:57:30.673 INFO:tasks.workunit.client.0.smithi027.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-29T08:57:30.673 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' 0022 -eq 0 ']' 2023-11-29T08:57:30.673 INFO:tasks.workunit.client.0.smithi027.stderr:++ SHELL=/bin/bash 2023-11-29T08:57:30.673 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-29T08:57:30.673 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-29T08:57:30.673 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.673 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-29T08:57:30.673 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.674 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-29T08:57:30.674 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-29T08:57:30.674 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.674 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-29T08:57:30.674 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.674 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-29T08:57:30.674 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-29T08:57:30.674 INFO:tasks.workunit.client.0.smithi027.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-29T08:57:30.674 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.674 INFO:tasks.workunit.client.0.smithi027.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-29T08:57:30.674 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-29T08:57:30.674 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.675 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-29T08:57:30.675 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.675 INFO:tasks.workunit.client.0.smithi027.stderr:++ awk '{print $1}' 2023-11-29T08:57:30.675 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-29T08:57:30.675 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-29T08:57:30.675 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-29T08:57:30.675 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.675 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-29T08:57:30.675 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.675 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-29T08:57:30.675 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-29T08:57:30.675 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.675 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-29T08:57:30.675 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.675 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/gawk.sh 2023-11-29T08:57:30.676 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.676 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-29T08:57:30.676 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.676 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/lang.sh 2023-11-29T08:57:30.676 INFO:tasks.workunit.client.0.smithi027.stderr:+++ unset LANG_backup 2023-11-29T08:57:30.676 INFO:tasks.workunit.client.0.smithi027.stderr:++++ /usr/bin/locale 2023-11-29T08:57:30.676 INFO:tasks.workunit.client.0.smithi027.stderr:+ tee ceph_test_rados_api_stat_pp.log 2023-11-29T08:57:30.676 INFO:tasks.workunit.client.0.smithi027.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-29T08:57:30.676 INFO:tasks.workunit.client.0.smithi027.stderr:++++ export LANG=en_US.UTF-8 2023-11-29T08:57:30.676 INFO:tasks.workunit.client.0.smithi027.stderr:++++ LANG=en_US.UTF-8 2023-11-29T08:57:30.676 INFO:tasks.workunit.client.0.smithi027.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-29T08:57:30.676 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-29T08:57:30.676 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-29T08:57:30.677 INFO:tasks.workunit.client.0.smithi027.stderr:+++ LANG=en_US.UTF-8 2023-11-29T08:57:30.677 INFO:tasks.workunit.client.0.smithi027.stderr:+++ unset LANG_backup config 2023-11-29T08:57:30.677 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n '' ']' 2023-11-29T08:57:30.677 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-29T08:57:30.677 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n '' ']' 2023-11-29T08:57:30.677 INFO:tasks.workunit.client.0.smithi027.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-29T08:57:30.677 INFO:tasks.workunit.client.0.smithi027.stderr:+ ff=api_cmd_pp 2023-11-29T08:57:30.677 INFO:tasks.workunit.client.0.smithi027.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-29T08:57:30.677 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-29T08:57:30.677 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-29T08:57:30.677 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' dumb = linux ']' 2023-11-29T08:57:30.677 INFO:tasks.workunit.client.0.smithi027.stderr:+ pid=84816 2023-11-29T08:57:30.677 INFO:tasks.workunit.client.0.smithi027.stderr:+ echo 'test api_cmd_pp on pid 84816' 2023-11-29T08:57:30.678 INFO:tasks.workunit.client.0.smithi027.stdout:test api_cmd_pp on pid 84816 2023-11-29T08:57:30.685 INFO:tasks.workunit.client.0.smithi027.stderr:+ pids[$f]=84816 2023-11-29T08:57:30.685 INFO:tasks.workunit.client.0.smithi027.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-29T08:57:30.685 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' 1 -eq 1 ']' 2023-11-29T08:57:30.685 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.685 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-29T08:57:30.685 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.686 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/less.sh 2023-11-29T08:57:30.686 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-29T08:57:30.686 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.686 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-29T08:57:30.686 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.686 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/which2.sh 2023-11-29T08:57:30.686 INFO:tasks.workunit.client.0.smithi027.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-29T08:57:30.686 INFO:tasks.workunit.client.0.smithi027.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-29T08:57:30.686 INFO:tasks.workunit.client.0.smithi027.stderr:++ printf %25s api_service 2023-11-29T08:57:30.686 INFO:tasks.workunit.client.0.smithi027.stderr:+ r=' api_service' 2023-11-29T08:57:30.687 INFO:tasks.workunit.client.0.smithi027.stderr:+++++ readlink /proc/84713/exe 2023-11-29T08:57:30.687 INFO:tasks.workunit.client.0.smithi027.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-29T08:57:30.687 INFO:tasks.workunit.client.0.smithi027.stderr:++++ export LANG=en_US.UTF-8 2023-11-29T08:57:30.687 INFO:tasks.workunit.client.0.smithi027.stderr:++++ LANG=en_US.UTF-8 2023-11-29T08:57:30.687 INFO:tasks.workunit.client.0.smithi027.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-29T08:57:30.687 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-29T08:57:30.687 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-29T08:57:30.687 INFO:tasks.workunit.client.0.smithi027.stderr:+++ LANG=en_US.UTF-8 2023-11-29T08:57:30.687 INFO:tasks.workunit.client.0.smithi027.stderr:+++ unset LANG_backup config 2023-11-29T08:57:30.687 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n '' ']' 2023-11-29T08:57:30.687 INFO:tasks.workunit.client.0.smithi027.stderr:++ awk '{print $1}' 2023-11-29T08:57:30.687 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-29T08:57:30.688 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' dumb = linux ']' 2023-11-29T08:57:30.688 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.688 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-29T08:57:30.688 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.688 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/less.sh 2023-11-29T08:57:30.688 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-29T08:57:30.688 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.688 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-29T08:57:30.688 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.688 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/which2.sh 2023-11-29T08:57:30.688 INFO:tasks.workunit.client.0.smithi027.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-29T08:57:30.688 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'grep=grep --color=auto' 2023-11-29T08:57:30.688 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-29T08:57:30.688 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-29T08:57:30.688 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.689 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-29T08:57:30.689 INFO:tasks.workunit.client.0.smithi027.stderr:++ echo api_service 2023-11-29T08:57:30.689 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.689 INFO:tasks.workunit.client.0.smithi027.stderr:++++ basename /usr/bin/bash 2023-11-29T08:57:30.689 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorls.sh 2023-11-29T08:57:30.689 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' '!' -t 0 ']' 2023-11-29T08:57:30.689 INFO:tasks.workunit.client.0.smithi027.stderr:+++ return 2023-11-29T08:57:30.689 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.689 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-29T08:57:30.689 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.689 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-29T08:57:30.689 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export S_COLORS=auto 2023-11-29T08:57:30.689 INFO:tasks.workunit.client.0.smithi027.stderr:+++ S_COLORS=auto 2023-11-29T08:57:30.689 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.690 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-29T08:57:30.690 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.690 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-29T08:57:30.690 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.690 INFO:tasks.workunit.client.0.smithi027.stderr:+++ which_declare='declare -f' 2023-11-29T08:57:30.690 INFO:tasks.workunit.client.0.smithi027.stderr:+++ which_opt=-f 2023-11-29T08:57:30.690 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export which_declare 2023-11-29T08:57:30.690 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export -f which 2023-11-29T08:57:30.690 INFO:tasks.workunit.client.0.smithi027.stderr:++ unset i 2023-11-29T08:57:30.690 INFO:tasks.workunit.client.0.smithi027.stderr:++ unset -f pathmunge 2023-11-29T08:57:30.690 INFO:tasks.workunit.client.0.smithi027.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-29T08:57:30.690 INFO:tasks.workunit.client.0.smithi027.stderr:+ export PATH 2023-11-29T08:57:30.690 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-29T08:57:30.690 INFO:tasks.workunit.client.0.smithi027.stderr:+ unset rc 2023-11-29T08:57:30.691 INFO:tasks.workunit.client.0.smithi027.stderr:+ sed 's/^/ api_watch_notify_pp: /' 2023-11-29T08:57:30.691 INFO:tasks.workunit.client.0.smithi027.stderr:+ ff=api_service 2023-11-29T08:57:30.691 INFO:tasks.workunit.client.0.smithi027.stderr:+ tee ceph_test_rados_api_watch_notify_pp.log 2023-11-29T08:57:30.691 INFO:tasks.workunit.client.0.smithi027.stderr:+ pid=84839 2023-11-29T08:57:30.691 INFO:tasks.workunit.client.0.smithi027.stderr:+++++ readlink /proc/84679/exe 2023-11-29T08:57:30.691 INFO:tasks.workunit.client.0.smithi027.stderr:+ echo 'test api_service on pid 84839' 2023-11-29T08:57:30.691 INFO:tasks.workunit.client.0.smithi027.stdout:test api_service on pid 84839 2023-11-29T08:57:30.696 INFO:tasks.workunit.client.0.smithi027.stderr:+ pids[$f]=84839 2023-11-29T08:57:30.696 INFO:tasks.workunit.client.0.smithi027.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-29T08:57:30.696 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' 1 -eq 1 ']' 2023-11-29T08:57:30.696 INFO:tasks.workunit.client.0.smithi027.stderr:++ printf %25s api_service_pp 2023-11-29T08:57:30.696 INFO:tasks.workunit.client.0.smithi027.stderr:+ r=' api_service_pp' 2023-11-29T08:57:30.697 INFO:tasks.workunit.client.0.smithi027.stderr:++++ basename /usr/bin/bash 2023-11-29T08:57:30.697 INFO:tasks.workunit.client.0.smithi027.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_service.xml 2>&1 | tee ceph_test_rados_api_service.log | sed "s/^/ api_service: /"' 2023-11-29T08:57:30.697 INFO:tasks.workunit.client.0.smithi027.stderr:++ echo api_service_pp 2023-11-29T08:57:30.697 INFO:tasks.workunit.client.0.smithi027.stderr:+++ which_declare='declare -f' 2023-11-29T08:57:30.697 INFO:tasks.workunit.client.0.smithi027.stderr:+++ which_opt=-f 2023-11-29T08:57:30.697 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export which_declare 2023-11-29T08:57:30.697 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export -f which 2023-11-29T08:57:30.697 INFO:tasks.workunit.client.0.smithi027.stderr:++ unset i 2023-11-29T08:57:30.697 INFO:tasks.workunit.client.0.smithi027.stderr:++ unset -f pathmunge 2023-11-29T08:57:30.697 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' -f /etc/bashrc ']' 2023-11-29T08:57:30.697 INFO:tasks.workunit.client.0.smithi027.stderr:+ . /etc/bashrc 2023-11-29T08:57:30.697 INFO:tasks.workunit.client.0.smithi027.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-29T08:57:30.697 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -z '' ']' 2023-11-29T08:57:30.698 INFO:tasks.workunit.client.0.smithi027.stderr:+ export PATH 2023-11-29T08:57:30.698 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-29T08:57:30.698 INFO:tasks.workunit.client.0.smithi027.stderr:+ unset rc 2023-11-29T08:57:30.698 INFO:tasks.workunit.client.0.smithi027.stderr:+ ceph_test_rados_api_watch_notify_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_watch_notify_pp.xml 2023-11-29T08:57:30.698 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-29T08:57:30.698 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-29T08:57:30.698 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-29T08:57:30.698 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.698 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-29T08:57:30.698 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.698 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-29T08:57:30.699 INFO:tasks.workunit.client.0.smithi027.stderr:++ BASHRCSOURCED=Y 2023-11-29T08:57:30.699 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.699 INFO:tasks.workunit.client.0.smithi027.stderr:++ shopt -q login_shell 2023-11-29T08:57:30.699 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-29T08:57:30.699 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.699 INFO:tasks.workunit.client.0.smithi027.stderr:+ ceph_test_rados_api_watch_notify --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_watch_notify.xml 2023-11-29T08:57:30.699 INFO:tasks.workunit.client.0.smithi027.stderr:++ awk '{print $1}' 2023-11-29T08:57:30.699 INFO:tasks.workunit.client.0.smithi027.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_cmd_pp.xml 2>&1 | tee ceph_test_rados_api_cmd_pp.log | sed "s/^/ api_cmd_pp: /"' 2023-11-29T08:57:30.699 INFO:tasks.workunit.client.0.smithi027.stderr:+ tee ceph_test_rados_api_watch_notify.log 2023-11-29T08:57:30.699 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' -f /etc/bashrc ']' 2023-11-29T08:57:30.699 INFO:tasks.workunit.client.0.smithi027.stderr:+ . /etc/bashrc 2023-11-29T08:57:30.699 INFO:tasks.workunit.client.0.smithi027.stderr:+ sed 's/^/ api_watch_notify: /' 2023-11-29T08:57:30.700 INFO:tasks.workunit.client.0.smithi027.stderr:+ ff=api_service_pp 2023-11-29T08:57:30.700 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -z '' ']' 2023-11-29T08:57:30.700 INFO:tasks.workunit.client.0.smithi027.stderr:++ BASHRCSOURCED=Y 2023-11-29T08:57:30.700 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.700 INFO:tasks.workunit.client.0.smithi027.stderr:++ shopt -q login_shell 2023-11-29T08:57:30.700 INFO:tasks.workunit.client.0.smithi027.stderr:+ pid=84856 2023-11-29T08:57:30.700 INFO:tasks.workunit.client.0.smithi027.stderr:+ echo 'test api_service_pp on pid 84856' 2023-11-29T08:57:30.700 INFO:tasks.workunit.client.0.smithi027.stdout:test api_service_pp on pid 84856 2023-11-29T08:57:30.739 INFO:tasks.workunit.client.0.smithi027.stderr:+ pids[$f]=84856 2023-11-29T08:57:30.739 INFO:tasks.workunit.client.0.smithi027.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-29T08:57:30.739 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' 1 -eq 1 ']' 2023-11-29T08:57:30.739 INFO:tasks.workunit.client.0.smithi027.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_service_pp.xml 2>&1 | tee ceph_test_rados_api_service_pp.log | sed "s/^/ api_service_pp: /"' 2023-11-29T08:57:30.739 INFO:tasks.workunit.client.0.smithi027.stderr:+++ umask 2023-11-29T08:57:30.739 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' 0022 -eq 0 ']' 2023-11-29T08:57:30.739 INFO:tasks.workunit.client.0.smithi027.stderr:++ SHELL=/bin/bash 2023-11-29T08:57:30.739 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.739 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-29T08:57:30.740 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.740 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-29T08:57:30.740 INFO:tasks.workunit.client.0.smithi027.stderr:++ printf %25s api_c_write_operations 2023-11-29T08:57:30.740 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-29T08:57:30.740 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.740 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-29T08:57:30.740 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.740 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-29T08:57:30.740 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-29T08:57:30.740 INFO:tasks.workunit.client.0.smithi027.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-29T08:57:30.740 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.740 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-29T08:57:30.740 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.740 INFO:tasks.workunit.client.0.smithi027.stderr:+ r=' api_c_write_operations' 2023-11-29T08:57:30.740 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-29T08:57:30.741 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.741 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' -f /etc/bashrc ']' 2023-11-29T08:57:30.741 INFO:tasks.workunit.client.0.smithi027.stderr:+ . /etc/bashrc 2023-11-29T08:57:30.741 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -z '' ']' 2023-11-29T08:57:30.741 INFO:tasks.workunit.client.0.smithi027.stderr:++ BASHRCSOURCED=Y 2023-11-29T08:57:30.741 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.741 INFO:tasks.workunit.client.0.smithi027.stderr:++ shopt -q login_shell 2023-11-29T08:57:30.741 INFO:tasks.workunit.client.0.smithi027.stderr:+++ umask 2023-11-29T08:57:30.741 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' 0022 -eq 0 ']' 2023-11-29T08:57:30.742 INFO:tasks.workunit.client.0.smithi027.stderr:++ SHELL=/bin/bash 2023-11-29T08:57:30.742 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.742 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-29T08:57:30.742 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.742 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-29T08:57:30.742 INFO:tasks.workunit.client.0.smithi027.stderr:+++ umask 2023-11-29T08:57:30.742 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-29T08:57:30.743 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.743 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-29T08:57:30.743 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.743 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-29T08:57:30.743 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-29T08:57:30.743 INFO:tasks.workunit.client.0.smithi027.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-29T08:57:30.743 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.743 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-29T08:57:30.744 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.744 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-29T08:57:30.744 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.744 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' 0022 -eq 0 ']' 2023-11-29T08:57:30.744 INFO:tasks.workunit.client.0.smithi027.stderr:++ echo api_c_write_operations 2023-11-29T08:57:30.744 INFO:tasks.workunit.client.0.smithi027.stderr:++ SHELL=/bin/bash 2023-11-29T08:57:30.744 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.745 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-29T08:57:30.745 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.745 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-29T08:57:30.745 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-29T08:57:30.745 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.745 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-29T08:57:30.746 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.746 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-29T08:57:30.746 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-29T08:57:30.746 INFO:tasks.workunit.client.0.smithi027.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-29T08:57:30.746 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.746 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-29T08:57:30.746 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.746 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-29T08:57:30.746 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.746 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'grep=grep --color=auto' 2023-11-29T08:57:30.746 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-29T08:57:30.746 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-29T08:57:30.747 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.747 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-29T08:57:30.747 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.747 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorls.sh 2023-11-29T08:57:30.747 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' '!' -t 0 ']' 2023-11-29T08:57:30.747 INFO:tasks.workunit.client.0.smithi027.stderr:+++ return 2023-11-29T08:57:30.747 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.747 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-29T08:57:30.747 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.747 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-29T08:57:30.747 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export S_COLORS=auto 2023-11-29T08:57:30.747 INFO:tasks.workunit.client.0.smithi027.stderr:+++ S_COLORS=auto 2023-11-29T08:57:30.747 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.747 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-29T08:57:30.747 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.748 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-29T08:57:30.748 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.748 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'grep=grep --color=auto' 2023-11-29T08:57:30.748 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-29T08:57:30.748 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-29T08:57:30.748 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.748 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-29T08:57:30.748 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.748 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorls.sh 2023-11-29T08:57:30.748 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' '!' -t 0 ']' 2023-11-29T08:57:30.748 INFO:tasks.workunit.client.0.smithi027.stderr:+++ return 2023-11-29T08:57:30.748 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.748 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-29T08:57:30.748 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.748 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-29T08:57:30.749 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export S_COLORS=auto 2023-11-29T08:57:30.749 INFO:tasks.workunit.client.0.smithi027.stderr:+++ S_COLORS=auto 2023-11-29T08:57:30.749 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.749 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-29T08:57:30.749 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.749 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-29T08:57:30.749 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.749 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'grep=grep --color=auto' 2023-11-29T08:57:30.749 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-29T08:57:30.749 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-29T08:57:30.749 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.749 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-29T08:57:30.749 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.749 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorls.sh 2023-11-29T08:57:30.749 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' '!' -t 0 ']' 2023-11-29T08:57:30.750 INFO:tasks.workunit.client.0.smithi027.stderr:+++ return 2023-11-29T08:57:30.750 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.750 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-29T08:57:30.750 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.750 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-29T08:57:30.750 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export S_COLORS=auto 2023-11-29T08:57:30.750 INFO:tasks.workunit.client.0.smithi027.stderr:+++ S_COLORS=auto 2023-11-29T08:57:30.750 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.750 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-29T08:57:30.750 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.750 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-29T08:57:30.750 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.750 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-29T08:57:30.750 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-29T08:57:30.750 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-29T08:57:30.751 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.751 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-29T08:57:30.751 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.751 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-29T08:57:30.751 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-29T08:57:30.751 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.751 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-29T08:57:30.751 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-29T08:57:30.751 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-29T08:57:30.751 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.751 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-29T08:57:30.751 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.751 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-29T08:57:30.751 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-29T08:57:30.751 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.751 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-29T08:57:30.752 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-29T08:57:30.752 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-29T08:57:30.752 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-29T08:57:30.752 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.752 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-29T08:57:30.752 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.752 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-29T08:57:30.752 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-29T08:57:30.752 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-29T08:57:30.752 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.752 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-29T08:57:30.752 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.752 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/gawk.sh 2023-11-29T08:57:30.752 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-29T08:57:30.752 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.752 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-29T08:57:30.753 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.753 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/lang.sh 2023-11-29T08:57:30.753 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.753 INFO:tasks.workunit.client.0.smithi027.stderr:+++ unset LANG_backup 2023-11-29T08:57:30.753 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-29T08:57:30.753 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.753 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-29T08:57:30.753 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-29T08:57:30.753 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.753 INFO:tasks.workunit.client.0.smithi027.stderr:++++ /usr/bin/locale 2023-11-29T08:57:30.753 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-29T08:57:30.753 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-29T08:57:30.753 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-29T08:57:30.753 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.753 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-29T08:57:30.754 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.754 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-29T08:57:30.754 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-29T08:57:30.754 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.754 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-29T08:57:30.754 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.754 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/gawk.sh 2023-11-29T08:57:30.754 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.754 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-29T08:57:30.754 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.754 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/lang.sh 2023-11-29T08:57:30.754 INFO:tasks.workunit.client.0.smithi027.stderr:+++ unset LANG_backup 2023-11-29T08:57:30.755 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n '' ']' 2023-11-29T08:57:30.755 INFO:tasks.workunit.client.0.smithi027.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-29T08:57:30.755 INFO:tasks.workunit.client.0.smithi027.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-29T08:57:30.755 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-29T08:57:30.755 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-29T08:57:30.755 INFO:tasks.workunit.client.0.smithi027.stderr:++++ /usr/bin/locale 2023-11-29T08:57:30.755 INFO:tasks.workunit.client.0.smithi027.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-29T08:57:30.755 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-29T08:57:30.755 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-29T08:57:30.755 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-29T08:57:30.755 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.755 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-29T08:57:30.755 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.755 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-29T08:57:30.755 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-29T08:57:30.756 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.756 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-29T08:57:30.756 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.756 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/gawk.sh 2023-11-29T08:57:30.756 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.756 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-29T08:57:30.756 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.756 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/lang.sh 2023-11-29T08:57:30.756 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n '' ']' 2023-11-29T08:57:30.757 INFO:tasks.workunit.client.0.smithi027.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-29T08:57:30.757 INFO:tasks.workunit.client.0.smithi027.stderr:+++ unset LANG_backup 2023-11-29T08:57:30.757 INFO:tasks.workunit.client.0.smithi027.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-29T08:57:30.757 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-29T08:57:30.757 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-29T08:57:30.757 INFO:tasks.workunit.client.0.smithi027.stderr:++++ /usr/bin/locale 2023-11-29T08:57:30.757 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-29T08:57:30.757 INFO:tasks.workunit.client.0.smithi027.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-29T08:57:30.757 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-29T08:57:30.757 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-29T08:57:30.757 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.757 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-29T08:57:30.757 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.757 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-29T08:57:30.757 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-29T08:57:30.758 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.758 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-29T08:57:30.758 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.758 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/gawk.sh 2023-11-29T08:57:30.758 INFO:tasks.workunit.client.0.smithi027.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-29T08:57:30.758 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.758 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-29T08:57:30.758 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.758 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/lang.sh 2023-11-29T08:57:30.758 INFO:tasks.workunit.client.0.smithi027.stderr:+++ unset LANG_backup 2023-11-29T08:57:30.759 INFO:tasks.workunit.client.0.smithi027.stderr:++++ export LANG=en_US.UTF-8 2023-11-29T08:57:30.759 INFO:tasks.workunit.client.0.smithi027.stderr:++++ LANG=en_US.UTF-8 2023-11-29T08:57:30.759 INFO:tasks.workunit.client.0.smithi027.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-29T08:57:30.759 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-29T08:57:30.759 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n '' ']' 2023-11-29T08:57:30.759 INFO:tasks.workunit.client.0.smithi027.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-29T08:57:30.759 INFO:tasks.workunit.client.0.smithi027.stderr:++++ /usr/bin/locale 2023-11-29T08:57:30.759 INFO:tasks.workunit.client.0.smithi027.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-29T08:57:30.759 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-29T08:57:30.759 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-29T08:57:30.759 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-29T08:57:30.759 INFO:tasks.workunit.client.0.smithi027.stderr:+++ LANG=en_US.UTF-8 2023-11-29T08:57:30.759 INFO:tasks.workunit.client.0.smithi027.stderr:+++ unset LANG_backup config 2023-11-29T08:57:30.760 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n '' ']' 2023-11-29T08:57:30.760 INFO:tasks.workunit.client.0.smithi027.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-29T08:57:30.760 INFO:tasks.workunit.client.0.smithi027.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-29T08:57:30.760 INFO:tasks.workunit.client.0.smithi027.stderr:++++ export LANG=en_US.UTF-8 2023-11-29T08:57:30.760 INFO:tasks.workunit.client.0.smithi027.stderr:++++ LANG=en_US.UTF-8 2023-11-29T08:57:30.760 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-29T08:57:30.760 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' dumb = linux ']' 2023-11-29T08:57:30.760 INFO:tasks.workunit.client.0.smithi027.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-29T08:57:30.761 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-29T08:57:30.761 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.761 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-29T08:57:30.761 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.761 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/less.sh 2023-11-29T08:57:30.761 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-29T08:57:30.761 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-29T08:57:30.761 INFO:tasks.workunit.client.0.smithi027.stderr:+++ LANG=en_US.UTF-8 2023-11-29T08:57:30.761 INFO:tasks.workunit.client.0.smithi027.stderr:+++ unset LANG_backup config 2023-11-29T08:57:30.761 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.761 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n '' ']' 2023-11-29T08:57:30.761 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-29T08:57:30.761 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.761 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-29T08:57:30.762 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/which2.sh 2023-11-29T08:57:30.762 INFO:tasks.workunit.client.0.smithi027.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-29T08:57:30.762 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' dumb = linux ']' 2023-11-29T08:57:30.762 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.762 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-29T08:57:30.762 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.762 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/less.sh 2023-11-29T08:57:30.762 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-29T08:57:30.762 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.762 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n '' ']' 2023-11-29T08:57:30.762 INFO:tasks.workunit.client.0.smithi027.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-29T08:57:30.762 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-29T08:57:30.762 INFO:tasks.workunit.client.0.smithi027.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-29T08:57:30.762 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.763 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/which2.sh 2023-11-29T08:57:30.763 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-29T08:57:30.763 INFO:tasks.workunit.client.0.smithi027.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-29T08:57:30.763 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-29T08:57:30.763 INFO:tasks.workunit.client.0.smithi027.stderr:+++++ readlink /proc/84839/exe 2023-11-29T08:57:30.763 INFO:tasks.workunit.client.0.smithi027.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-29T08:57:30.763 INFO:tasks.workunit.client.0.smithi027.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-29T08:57:30.763 INFO:tasks.workunit.client.0.smithi027.stderr:++++ export LANG=en_US.UTF-8 2023-11-29T08:57:30.763 INFO:tasks.workunit.client.0.smithi027.stderr:++++ LANG=en_US.UTF-8 2023-11-29T08:57:30.763 INFO:tasks.workunit.client.0.smithi027.stderr:+++++ readlink /proc/84799/exe 2023-11-29T08:57:30.763 INFO:tasks.workunit.client.0.smithi027.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-29T08:57:30.763 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-29T08:57:30.763 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-29T08:57:30.763 INFO:tasks.workunit.client.0.smithi027.stderr:+++ LANG=en_US.UTF-8 2023-11-29T08:57:30.764 INFO:tasks.workunit.client.0.smithi027.stderr:+++ unset LANG_backup config 2023-11-29T08:57:30.764 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n '' ']' 2023-11-29T08:57:30.764 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-29T08:57:30.764 INFO:tasks.workunit.client.0.smithi027.stderr:++ awk '{print $1}' 2023-11-29T08:57:30.764 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' dumb = linux ']' 2023-11-29T08:57:30.764 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.764 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-29T08:57:30.764 INFO:tasks.workunit.client.0.smithi027.stderr:++++ basename /usr/bin/bash 2023-11-29T08:57:30.764 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.764 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/less.sh 2023-11-29T08:57:30.764 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-29T08:57:30.764 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.764 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-29T08:57:30.764 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.764 INFO:tasks.workunit.client.0.smithi027.stderr:++++ basename /usr/bin/bash 2023-11-29T08:57:30.765 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/which2.sh 2023-11-29T08:57:30.765 INFO:tasks.workunit.client.0.smithi027.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-29T08:57:30.765 INFO:tasks.workunit.client.0.smithi027.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-29T08:57:30.765 INFO:tasks.workunit.client.0.smithi027.stderr:++++ export LANG=en_US.UTF-8 2023-11-29T08:57:30.765 INFO:tasks.workunit.client.0.smithi027.stderr:++++ LANG=en_US.UTF-8 2023-11-29T08:57:30.765 INFO:tasks.workunit.client.0.smithi027.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-29T08:57:30.765 INFO:tasks.workunit.client.0.smithi027.stderr:+++ which_declare='declare -f' 2023-11-29T08:57:30.765 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-29T08:57:30.765 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-29T08:57:30.765 INFO:tasks.workunit.client.0.smithi027.stderr:+++ which_opt=-f 2023-11-29T08:57:30.765 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export which_declare 2023-11-29T08:57:30.765 INFO:tasks.workunit.client.0.smithi027.stderr:+++ LANG=en_US.UTF-8 2023-11-29T08:57:30.765 INFO:tasks.workunit.client.0.smithi027.stderr:+++ unset LANG_backup config 2023-11-29T08:57:30.765 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export -f which 2023-11-29T08:57:30.766 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n '' ']' 2023-11-29T08:57:30.766 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-29T08:57:30.766 INFO:tasks.workunit.client.0.smithi027.stderr:++ unset i 2023-11-29T08:57:30.766 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' dumb = linux ']' 2023-11-29T08:57:30.766 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.766 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-29T08:57:30.766 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.766 INFO:tasks.workunit.client.0.smithi027.stderr:++ unset -f pathmunge 2023-11-29T08:57:30.766 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/less.sh 2023-11-29T08:57:30.766 INFO:tasks.workunit.client.0.smithi027.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-29T08:57:30.766 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-29T08:57:30.767 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.767 INFO:tasks.workunit.client.0.smithi027.stderr:+ export PATH 2023-11-29T08:57:30.767 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-29T08:57:30.767 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-29T08:57:30.767 INFO:tasks.workunit.client.0.smithi027.stderr:+ unset rc 2023-11-29T08:57:30.767 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.767 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/which2.sh 2023-11-29T08:57:30.767 INFO:tasks.workunit.client.0.smithi027.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-29T08:57:30.767 INFO:tasks.workunit.client.0.smithi027.stderr:+ sed 's/^/ api_service: /' 2023-11-29T08:57:30.767 INFO:tasks.workunit.client.0.smithi027.stderr:+++++ readlink /proc/84856/exe 2023-11-29T08:57:30.768 INFO:tasks.workunit.client.0.smithi027.stderr:+ tee ceph_test_rados_api_service.log 2023-11-29T08:57:30.768 INFO:tasks.workunit.client.0.smithi027.stderr:++++ basename /usr/bin/bash 2023-11-29T08:57:30.768 INFO:tasks.workunit.client.0.smithi027.stderr:+++ which_declare='declare -f' 2023-11-29T08:57:30.768 INFO:tasks.workunit.client.0.smithi027.stderr:+++ which_opt=-f 2023-11-29T08:57:30.768 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export which_declare 2023-11-29T08:57:30.768 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export -f which 2023-11-29T08:57:30.768 INFO:tasks.workunit.client.0.smithi027.stderr:++ unset i 2023-11-29T08:57:30.768 INFO:tasks.workunit.client.0.smithi027.stderr:++ unset -f pathmunge 2023-11-29T08:57:30.768 INFO:tasks.workunit.client.0.smithi027.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-29T08:57:30.768 INFO:tasks.workunit.client.0.smithi027.stderr:+ export PATH 2023-11-29T08:57:30.769 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-29T08:57:30.769 INFO:tasks.workunit.client.0.smithi027.stderr:+ unset rc 2023-11-29T08:57:30.769 INFO:tasks.workunit.client.0.smithi027.stderr:+ ceph_test_rados_api_service --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_service.xml 2023-11-29T08:57:30.769 INFO:tasks.workunit.client.0.smithi027.stderr:+ sed 's/^/ api_cmd: /' 2023-11-29T08:57:30.769 INFO:tasks.workunit.client.0.smithi027.stderr:+ tee ceph_test_rados_api_cmd.log 2023-11-29T08:57:30.769 INFO:tasks.workunit.client.0.smithi027.stderr:+++ which_declare='declare -f' 2023-11-29T08:57:30.769 INFO:tasks.workunit.client.0.smithi027.stderr:+++ which_opt=-f 2023-11-29T08:57:30.769 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export which_declare 2023-11-29T08:57:30.769 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export -f which 2023-11-29T08:57:30.769 INFO:tasks.workunit.client.0.smithi027.stderr:++ unset i 2023-11-29T08:57:30.770 INFO:tasks.workunit.client.0.smithi027.stderr:++ unset -f pathmunge 2023-11-29T08:57:30.770 INFO:tasks.workunit.client.0.smithi027.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-29T08:57:30.770 INFO:tasks.workunit.client.0.smithi027.stderr:+ export PATH 2023-11-29T08:57:30.770 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-29T08:57:30.770 INFO:tasks.workunit.client.0.smithi027.stderr:+ unset rc 2023-11-29T08:57:30.770 INFO:tasks.workunit.client.0.smithi027.stderr:+ ceph_test_rados_api_cmd --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_cmd.xml 2023-11-29T08:57:30.770 INFO:tasks.workunit.client.0.smithi027.stderr:+ ff=api_c_write_operations 2023-11-29T08:57:30.770 INFO:tasks.workunit.client.0.smithi027.stderr:+ pid=84936 2023-11-29T08:57:30.771 INFO:tasks.workunit.client.0.smithi027.stderr:+ sed 's/^/ api_service_pp: /' 2023-11-29T08:57:30.771 INFO:tasks.workunit.client.0.smithi027.stderr:+ echo 'test api_c_write_operations on pid 84936' 2023-11-29T08:57:30.771 INFO:tasks.workunit.client.0.smithi027.stdout:test api_c_write_operations on pid 84936 2023-11-29T08:57:30.772 INFO:tasks.workunit.client.0.smithi027.stderr:+ pids[$f]=84936 2023-11-29T08:57:30.772 INFO:tasks.workunit.client.0.smithi027.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-29T08:57:30.772 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' 1 -eq 1 ']' 2023-11-29T08:57:30.772 INFO:tasks.workunit.client.0.smithi027.stdout:.15.27:0/3206243509 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dcc32ef660 0x55dcc32d4450 crc :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:57:30.772 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:30.525+0000 7fa359258640 1 -- 172.21.15.27:0/3206243509 >> 172.21.15.27:0/3206243509 conn(0x55dcc315fd80 msgr2=0x55dcc322d380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T08:57:30.773 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:30.528+0000 7fa359258640 1 -- 172.21.15.27:0/3206243509 shutdown_connections 2023-11-29T08:57:30.773 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:30.528+0000 7fa359258640 1 -- 172.21.15.27:0/3206243509 wait complete. 2023-11-29T08:57:30.773 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:30.529+0000 7fa359258640 1 Processor -- start 2023-11-29T08:57:30.773 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:30.530+0000 7fa359258640 1 -- start start 2023-11-29T08:57:30.773 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:30.531+0000 7fa359258640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dcc32e9d10 0x55dcc32ea120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:57:30.773 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:30.531+0000 7fa359258640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcc31e6640 con 0x55dcc32e9d10 2023-11-29T08:57:30.773 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:30.532+0000 7fa35239a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dcc32e9d10 0x55dcc32ea120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:57:30.773 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:30.532+0000 7fa35239a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dcc32e9d10 0x55dcc32ea120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:50590/0 (socket says 172.21.15.27:50590) 2023-11-29T08:57:30.773 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:30.532+0000 7fa35239a640 1 -- 172.21.15.27:0/2308983894 learned_addr learned my addr 172.21.15.27:0/2308983894 (peer_addr_for_me v2:172.21.15.27:0/0) 2023-11-29T08:57:30.773 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:30.533+0000 7fa35239a640 1 -- 172.21.15.27:0/2308983894 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dcc317f7e0 con 0x55dcc32e9d10 2023-11-29T08:57:30.774 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:30.533+0000 7fa35239a640 1 --2- 172.21.15.27:0/2308983894 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dcc32e9d10 0x55dcc32ea120 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:57:30.774 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:30.604+0000 7fa3437fe640 1 -- 172.21.15.27:0/2308983894 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fa34c006380 con 0x55dcc32e9d10 2023-11-29T08:57:30.774 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:30.604+0000 7fa359258640 1 -- 172.21.15.27:0/2308983894 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55dcc317f240 con 0x55dcc32e9d10 2023-11-29T08:57:30.774 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:30.604+0000 7fa359258640 1 -- 172.21.15.27:0/2308983894 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dcc32eadb0 con 0x55dcc32e9d10 2023-11-29T08:57:30.774 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:30.608+0000 7fa3437fe640 1 -- 172.21.15.27:0/2308983894 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fa34c007e90 con 0x55dcc32e9d10 2023-11-29T08:57:30.774 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:30.608+0000 7fa3437fe640 1 -- 172.21.15.27:0/2308983894 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fa34c004e00 con 0x55dcc32e9d10 2023-11-29T08:57:30.774 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:30.612+0000 7fa3437fe640 1 -- 172.21.15.27:0/2308983894 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (crc 0 0 0) 0x7fa34c0133a0 con 0x55dcc32e9d10 2023-11-29T08:57:30.778 INFO:tasks.workunit.client.0.smithi027.stderr:+++++ readlink /proc/84816/exe 2023-11-29T08:57:30.778 INFO:tasks.workunit.client.0.smithi027.stderr:+ ceph_test_rados_api_service_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_service_pp.xml 2023-11-29T08:57:30.778 INFO:tasks.workunit.client.0.smithi027.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_write_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_c_write_operations.xml 2>&1 | tee ceph_test_rados_api_c_write_operations.log | sed "s/^/ api_c_write_operations: /"' 2023-11-29T08:57:30.778 INFO:tasks.workunit.client.0.smithi027.stderr:++ printf %25s api_c_read_operations 2023-11-29T08:57:30.778 INFO:tasks.workunit.client.0.smithi027.stderr:+ r=' api_c_read_operations' 2023-11-29T08:57:30.778 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' -f /etc/bashrc ']' 2023-11-29T08:57:30.778 INFO:tasks.workunit.client.0.smithi027.stderr:+ . /etc/bashrc 2023-11-29T08:57:30.779 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -z '' ']' 2023-11-29T08:57:30.779 INFO:tasks.workunit.client.0.smithi027.stderr:++ BASHRCSOURCED=Y 2023-11-29T08:57:30.779 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.779 INFO:tasks.workunit.client.0.smithi027.stderr:++ shopt -q login_shell 2023-11-29T08:57:30.779 INFO:tasks.workunit.client.0.smithi027.stderr:++++ basename /usr/bin/bash 2023-11-29T08:57:30.779 INFO:tasks.workunit.client.0.smithi027.stderr:+++ umask 2023-11-29T08:57:30.779 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' 0022 -eq 0 ']' 2023-11-29T08:57:30.779 INFO:tasks.workunit.client.0.smithi027.stderr:++ SHELL=/bin/bash 2023-11-29T08:57:30.779 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.779 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-29T08:57:30.779 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.779 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-29T08:57:30.779 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-29T08:57:30.779 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.779 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-29T08:57:30.779 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.780 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-29T08:57:30.780 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-29T08:57:30.780 INFO:tasks.workunit.client.0.smithi027.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-29T08:57:30.780 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.780 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-29T08:57:30.780 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.780 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-29T08:57:30.780 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.780 INFO:tasks.workunit.client.0.smithi027.stderr:++ echo api_c_read_operations 2023-11-29T08:57:30.780 INFO:tasks.workunit.client.0.smithi027.stderr:++ awk '{print $1}' 2023-11-29T08:57:30.780 INFO:tasks.workunit.client.0.smithi027.stderr:+++ which_declare='declare -f' 2023-11-29T08:57:30.780 INFO:tasks.workunit.client.0.smithi027.stderr:+++ which_opt=-f 2023-11-29T08:57:30.780 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export which_declare 2023-11-29T08:57:30.780 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export -f which 2023-11-29T08:57:30.780 INFO:tasks.workunit.client.0.smithi027.stderr:++ unset i 2023-11-29T08:57:30.781 INFO:tasks.workunit.client.0.smithi027.stderr:++ unset -f pathmunge 2023-11-29T08:57:30.781 INFO:tasks.workunit.client.0.smithi027.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-29T08:57:30.781 INFO:tasks.workunit.client.0.smithi027.stderr:+ export PATH 2023-11-29T08:57:30.781 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-29T08:57:30.781 INFO:tasks.workunit.client.0.smithi027.stderr:+ unset rc 2023-11-29T08:57:30.781 INFO:tasks.workunit.client.0.smithi027.stderr:+ ceph_test_rados_api_cmd_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_cmd_pp.xml 2023-11-29T08:57:30.781 INFO:tasks.workunit.client.0.smithi027.stderr:+ ff=api_c_read_operations 2023-11-29T08:57:30.781 INFO:tasks.workunit.client.0.smithi027.stderr:+ pid=84986 2023-11-29T08:57:30.781 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:30.612+0000 7fa3437fe640 1 --2- 172.21.15.27:0/2308983894 >> test api_c_read_operations on pid 84986 2023-11-29T08:57:30.790 INFO:tasks.workunit.client.0.smithi027.stderr:+ echo 'test api_c_read_operations on pid 84986' 2023-11-29T08:57:30.790 INFO:tasks.workunit.client.0.smithi027.stderr:+ pids[$f]=84986 2023-11-29T08:57:30.790 INFO:tasks.workunit.client.0.smithi027.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-29T08:57:30.790 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' 1 -eq 1 ']' 2023-11-29T08:57:30.790 INFO:tasks.workunit.client.0.smithi027.stderr:+ tee ceph_test_rados_api_cmd_pp.log 2023-11-29T08:57:30.790 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'grep=grep --color=auto' 2023-11-29T08:57:30.790 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-29T08:57:30.791 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-29T08:57:30.791 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.791 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-29T08:57:30.791 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.791 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorls.sh 2023-11-29T08:57:30.791 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' '!' -t 0 ']' 2023-11-29T08:57:30.791 INFO:tasks.workunit.client.0.smithi027.stderr:+++ return 2023-11-29T08:57:30.791 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.791 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-29T08:57:30.791 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.791 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-29T08:57:30.791 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export S_COLORS=auto 2023-11-29T08:57:30.791 INFO:tasks.workunit.client.0.smithi027.stderr:+++ S_COLORS=auto 2023-11-29T08:57:30.791 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.792 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-29T08:57:30.792 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.792 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-29T08:57:30.792 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.792 INFO:tasks.workunit.client.0.smithi027.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_read_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_c_read_operations.xml 2>&1 | tee ceph_test_rados_api_c_read_operations.log | sed "s/^/ api_c_read_operations: /"' 2023-11-29T08:57:30.792 INFO:tasks.workunit.client.0.smithi027.stderr:+ tee ceph_test_rados_api_service_pp.log 2023-11-29T08:57:30.792 INFO:tasks.workunit.client.0.smithi027.stderr:++ printf %25s api_cls_remote_reads 2023-11-29T08:57:30.792 INFO:tasks.workunit.client.0.smithi027.stderr:+ r=' api_cls_remote_reads' 2023-11-29T08:57:30.792 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' -f /etc/bashrc ']' 2023-11-29T08:57:30.792 INFO:tasks.workunit.client.0.smithi027.stderr:+ . /etc/bashrc 2023-11-29T08:57:30.792 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -z '' ']' 2023-11-29T08:57:30.792 INFO:tasks.workunit.client.0.smithi027.stderr:++ BASHRCSOURCED=Y 2023-11-29T08:57:30.792 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.792 INFO:tasks.workunit.client.0.smithi027.stderr:++ shopt -q login_shell 2023-11-29T08:57:30.792 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-29T08:57:30.793 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-29T08:57:30.793 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-29T08:57:30.793 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.793 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-29T08:57:30.793 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.793 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-29T08:57:30.793 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-29T08:57:30.793 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.793 INFO:tasks.workunit.client.0.smithi027.stderr:+++ umask 2023-11-29T08:57:30.793 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' 0022 -eq 0 ']' 2023-11-29T08:57:30.793 INFO:tasks.workunit.client.0.smithi027.stderr:++ SHELL=/bin/bash 2023-11-29T08:57:30.793 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.793 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-29T08:57:30.793 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.793 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-29T08:57:30.793 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-29T08:57:30.793 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.794 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-29T08:57:30.794 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.794 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-29T08:57:30.794 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-29T08:57:30.794 INFO:tasks.workunit.client.0.smithi027.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-29T08:57:30.794 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.794 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-29T08:57:30.794 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.794 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-29T08:57:30.794 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.794 INFO:tasks.workunit.client.0.smithi027.stderr:++ echo api_cls_remote_reads 2023-11-29T08:57:30.794 INFO:tasks.workunit.client.0.smithi027.stderr:+ sed 's/^/ api_cmd_pp: /' 2023-11-29T08:57:30.794 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'grep=grep --color=auto' 2023-11-29T08:57:30.794 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-29T08:57:30.795 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-29T08:57:30.795 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.795 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-29T08:57:30.795 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.795 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorls.sh 2023-11-29T08:57:30.795 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' '!' -t 0 ']' 2023-11-29T08:57:30.795 INFO:tasks.workunit.client.0.smithi027.stderr:+++ return 2023-11-29T08:57:30.795 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.795 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-29T08:57:30.795 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.795 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-29T08:57:30.795 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export S_COLORS=auto 2023-11-29T08:57:30.795 INFO:tasks.workunit.client.0.smithi027.stderr:+++ S_COLORS=auto 2023-11-29T08:57:30.795 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.795 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-29T08:57:30.795 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.796 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-29T08:57:30.796 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.796 INFO:tasks.workunit.client.0.smithi027.stderr:++ awk '{print $1}' 2023-11-29T08:57:30.796 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-29T08:57:30.796 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-29T08:57:30.796 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-29T08:57:30.796 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.796 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-29T08:57:30.796 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.796 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-29T08:57:30.796 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-29T08:57:30.797 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.797 INFO:tasks.workunit.client.0.smithi027.stderr:+ ff=api_cls_remote_reads 2023-11-29T08:57:30.797 INFO:tasks.workunit.client.0.smithi027.stderr:+ pid=85012 2023-11-29T08:57:30.797 INFO:tasks.workunit.client.0.smithi027.stderr:+ echo 'test api_cls_remote_reads on pid 85012' 2023-11-29T08:57:30.797 INFO:tasks.workunit.client.0.smithi027.stdout:test api_cls_remote_reads on pid 85012 2023-11-29T08:57:30.803 INFO:tasks.workunit.client.0.smithi027.stderr:+ pids[$f]=85012 2023-11-29T08:57:30.803 INFO:tasks.workunit.client.0.smithi027.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-29T08:57:30.803 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' 1 -eq 1 ']' 2023-11-29T08:57:30.803 INFO:tasks.workunit.client.0.smithi027.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cls_remote_reads --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_cls_remote_reads.xml 2>&1 | tee ceph_test_rados_api_cls_remote_reads.log | sed "s/^/ api_cls_remote_reads: /"' 2023-11-29T08:57:30.804 INFO:tasks.workunit.client.0.smithi027.stderr:++ printf %25s list_parallel 2023-11-29T08:57:30.804 INFO:tasks.workunit.client.0.smithi027.stderr:+ r=' list_parallel' 2023-11-29T08:57:30.804 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-29T08:57:30.804 INFO:tasks.workunit.client.0.smithi027.stderr:++ awk '{print $1}' 2023-11-29T08:57:30.804 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-29T08:57:30.804 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-29T08:57:30.804 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' -f /etc/bashrc ']' 2023-11-29T08:57:30.804 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.805 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-29T08:57:30.805 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.805 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-29T08:57:30.805 INFO:tasks.workunit.client.0.smithi027.stderr:+ . /etc/bashrc 2023-11-29T08:57:30.805 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-29T08:57:30.805 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.805 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-29T08:57:30.805 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.805 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/gawk.sh 2023-11-29T08:57:30.805 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.805 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-29T08:57:30.805 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -z '' ']' 2023-11-29T08:57:30.806 INFO:tasks.workunit.client.0.smithi027.stderr:++ BASHRCSOURCED=Y 2023-11-29T08:57:30.806 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.806 INFO:tasks.workunit.client.0.smithi027.stderr:++ shopt -q login_shell 2023-11-29T08:57:30.806 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.806 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/lang.sh 2023-11-29T08:57:30.806 INFO:tasks.workunit.client.0.smithi027.stderr:+++ unset LANG_backup 2023-11-29T08:57:30.806 INFO:tasks.workunit.client.0.smithi027.stderr:++ echo list_parallel 2023-11-29T08:57:30.806 INFO:tasks.workunit.client.0.smithi027.stderr:+++ umask 2023-11-29T08:57:30.806 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' 0022 -eq 0 ']' 2023-11-29T08:57:30.806 INFO:tasks.workunit.client.0.smithi027.stderr:++ SHELL=/bin/bash 2023-11-29T08:57:30.806 INFO:tasks.workunit.client.0.smithi027.stderr:++++ /usr/bin/locale 2023-11-29T08:57:30.806 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.806 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-29T08:57:30.807 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.807 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-29T08:57:30.807 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-29T08:57:30.807 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.807 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-29T08:57:30.807 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.807 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-29T08:57:30.807 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-29T08:57:30.807 INFO:tasks.workunit.client.0.smithi027.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-29T08:57:30.807 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.807 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-29T08:57:30.808 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.808 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-29T08:57:30.808 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.808 INFO:tasks.workunit.client.0.smithi027.stderr:+ ff=list_parallel 2023-11-29T08:57:30.808 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n '' ']' 2023-11-29T08:57:30.808 INFO:tasks.workunit.client.0.smithi027.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-29T08:57:30.808 INFO:tasks.workunit.client.0.smithi027.stderr:+ pid=85035 2023-11-29T08:57:30.808 INFO:tasks.workunit.client.0.smithi027.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-29T08:57:30.808 INFO:tasks.workunit.client.0.smithi027.stderr:+ echo 'test list_parallel on pid 85035' 2023-11-29T08:57:30.809 INFO:tasks.workunit.client.0.smithi027.stdout:test list_parallel on pid 85035 2023-11-29T08:57:30.823 INFO:tasks.workunit.client.0.smithi027.stderr:+ pids[$f]=85035 2023-11-29T08:57:30.824 INFO:tasks.workunit.client.0.smithi027.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-29T08:57:30.824 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' 1 -eq 1 ']' 2023-11-29T08:57:30.824 INFO:tasks.workunit.client.0.smithi027.stderr:+ bash -o pipefail -exc 'ceph_test_rados_list_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-list_parallel.xml 2>&1 | tee ceph_test_rados_list_parallel.log | sed "s/^/ list_parallel: /"' 2023-11-29T08:57:30.824 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-29T08:57:30.824 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-29T08:57:30.824 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-29T08:57:30.825 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-29T08:57:30.825 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-29T08:57:30.825 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.825 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-29T08:57:30.825 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.825 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-29T08:57:30.826 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-29T08:57:30.826 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.826 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-29T08:57:30.826 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.826 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/gawk.sh 2023-11-29T08:57:30.826 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.827 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-29T08:57:30.827 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' -f /etc/bashrc ']' 2023-11-29T08:57:30.827 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.827 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/lang.sh 2023-11-29T08:57:30.827 INFO:tasks.workunit.client.0.smithi027.stderr:+++ unset LANG_backup 2023-11-29T08:57:30.827 INFO:tasks.workunit.client.0.smithi027.stderr:+ . /etc/bashrc 2023-11-29T08:57:30.828 INFO:tasks.workunit.client.0.smithi027.stderr:++ printf %25s open_pools_parallel 2023-11-29T08:57:30.828 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -z '' ']' 2023-11-29T08:57:30.828 INFO:tasks.workunit.client.0.smithi027.stderr:++ BASHRCSOURCED=Y 2023-11-29T08:57:30.828 INFO:tasks.workunit.client.0.smithi027.stderr:+ r=' open_pools_parallel' 2023-11-29T08:57:30.828 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.829 INFO:tasks.workunit.client.0.smithi027.stderr:++ shopt -q login_shell 2023-11-29T08:57:30.829 INFO:tasks.workunit.client.0.smithi027.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-29T08:57:30.829 INFO:tasks.workunit.client.0.smithi027.stderr:+++ umask 2023-11-29T08:57:30.829 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' 0022 -eq 0 ']' 2023-11-29T08:57:30.829 INFO:tasks.workunit.client.0.smithi027.stderr:++ SHELL=/bin/bash 2023-11-29T08:57:30.829 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.830 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-29T08:57:30.830 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.830 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-29T08:57:30.830 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-29T08:57:30.830 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.831 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'grep=grep --color=auto' 2023-11-29T08:57:30.831 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-29T08:57:30.831 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-29T08:57:30.831 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-29T08:57:30.831 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.831 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.832 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-29T08:57:30.832 INFO:tasks.workunit.client.0.smithi027.stderr:++ echo open_pools_parallel 2023-11-29T08:57:30.832 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-29T08:57:30.832 INFO:tasks.workunit.client.0.smithi027.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-29T08:57:30.832 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.832 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-29T08:57:30.832 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.833 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-29T08:57:30.833 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.833 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-29T08:57:30.833 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.833 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorls.sh 2023-11-29T08:57:30.834 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' '!' -t 0 ']' 2023-11-29T08:57:30.834 INFO:tasks.workunit.client.0.smithi027.stderr:+++ return 2023-11-29T08:57:30.834 INFO:tasks.workunit.client.0.smithi027.stderr:++ awk '{print $1}' 2023-11-29T08:57:30.834 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.834 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-29T08:57:30.834 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.834 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-29T08:57:30.835 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export S_COLORS=auto 2023-11-29T08:57:30.835 INFO:tasks.workunit.client.0.smithi027.stderr:+++ S_COLORS=auto 2023-11-29T08:57:30.835 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.835 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-29T08:57:30.835 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.835 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-29T08:57:30.835 INFO:tasks.workunit.client.0.smithi027.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-29T08:57:30.836 INFO:tasks.workunit.client.0.smithi027.stderr:++++ export LANG=en_US.UTF-8 2023-11-29T08:57:30.836 INFO:tasks.workunit.client.0.smithi027.stderr:++++ LANG=en_US.UTF-8 2023-11-29T08:57:30.836 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.836 INFO:tasks.workunit.client.0.smithi027.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-29T08:57:30.836 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-29T08:57:30.836 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-29T08:57:30.836 INFO:tasks.workunit.client.0.smithi027.stderr:+++ LANG=en_US.UTF-8 2023-11-29T08:57:30.836 INFO:tasks.workunit.client.0.smithi027.stderr:+++ unset LANG_backup config 2023-11-29T08:57:30.837 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n '' ']' 2023-11-29T08:57:30.837 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-29T08:57:30.837 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' dumb = linux ']' 2023-11-29T08:57:30.837 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.837 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-29T08:57:30.837 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.837 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/less.sh 2023-11-29T08:57:30.837 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-29T08:57:30.838 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.838 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-29T08:57:30.838 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.838 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/which2.sh 2023-11-29T08:57:30.838 INFO:tasks.workunit.client.0.smithi027.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-29T08:57:30.838 INFO:tasks.workunit.client.0.smithi027.stderr:+ ff=open_pools_parallel 2023-11-29T08:57:30.838 INFO:tasks.workunit.client.0.smithi027.stderr:+++++ readlink /proc/84936/exe 2023-11-29T08:57:30.838 INFO:tasks.workunit.client.0.smithi027.stderr:+ pid=85050 2023-11-29T08:57:30.839 INFO:tasks.workunit.client.0.smithi027.stderr:+ echo 'test open_pools_parallel on pid 85050' 2023-11-29T08:57:30.839 INFO:tasks.workunit.client.0.smithi027.stdout:test open_pools_parallel on pid 85050 2023-11-29T08:57:30.858 INFO:tasks.workunit.client.0.smithi027.stderr:+ pids[$f]=85050 2023-11-29T08:57:30.859 INFO:tasks.workunit.client.0.smithi027.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-29T08:57:30.859 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' 1 -eq 1 ']' 2023-11-29T08:57:30.859 INFO:tasks.workunit.client.0.smithi027.stderr:++++ basename /usr/bin/bash 2023-11-29T08:57:30.859 INFO:tasks.workunit.client.0.smithi027.stderr:+ bash -o pipefail -exc 'ceph_test_rados_open_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-open_pools_parallel.xml 2>&1 | tee ceph_test_rados_open_pools_parallel.log | sed "s/^/ open_pools_parallel: /"' 2023-11-29T08:57:30.859 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-29T08:57:30.859 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-29T08:57:30.859 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-29T08:57:30.860 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.860 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-29T08:57:30.860 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.860 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-29T08:57:30.860 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-29T08:57:30.860 INFO:tasks.workunit.client.0.smithi027.stderr:+++ which_declare='declare -f' 2023-11-29T08:57:30.860 INFO:tasks.workunit.client.0.smithi027.stderr:+++ which_opt=-f 2023-11-29T08:57:30.861 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export which_declare 2023-11-29T08:57:30.861 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.861 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export -f which 2023-11-29T08:57:30.861 INFO:tasks.workunit.client.0.smithi027.stderr:++ unset i 2023-11-29T08:57:30.861 INFO:tasks.workunit.client.0.smithi027.stderr:++ unset -f pathmunge 2023-11-29T08:57:30.861 INFO:tasks.workunit.client.0.smithi027.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-29T08:57:30.861 INFO:tasks.workunit.client.0.smithi027.stderr:+ export PATH 2023-11-29T08:57:30.862 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-29T08:57:30.862 INFO:tasks.workunit.client.0.smithi027.stderr:+ unset rc 2023-11-29T08:57:30.862 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' -f /etc/bashrc ']' 2023-11-29T08:57:30.862 INFO:tasks.workunit.client.0.smithi027.stderr:+ . /etc/bashrc 2023-11-29T08:57:30.862 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -z '' ']' 2023-11-29T08:57:30.862 INFO:tasks.workunit.client.0.smithi027.stderr:++ BASHRCSOURCED=Y 2023-11-29T08:57:30.862 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.863 INFO:tasks.workunit.client.0.smithi027.stderr:++ shopt -q login_shell 2023-11-29T08:57:30.863 INFO:tasks.workunit.client.0.smithi027.stderr:+ sed 's/^/ api_c_write_operations: /' 2023-11-29T08:57:30.863 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'grep=grep --color=auto' 2023-11-29T08:57:30.863 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-29T08:57:30.863 INFO:tasks.workunit.client.0.smithi027.stderr:+ ceph_test_rados_api_c_write_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_c_write_operations.xml 2023-11-29T08:57:30.863 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-29T08:57:30.863 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.864 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-29T08:57:30.864 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.864 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorls.sh 2023-11-29T08:57:30.864 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' '!' -t 0 ']' 2023-11-29T08:57:30.864 INFO:tasks.workunit.client.0.smithi027.stderr:+ tee ceph_test_rados_api_c_write_operations.log 2023-11-29T08:57:30.864 INFO:tasks.workunit.client.0.smithi027.stderr:+++ return 2023-11-29T08:57:30.864 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.864 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-29T08:57:30.865 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.865 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-29T08:57:30.865 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export S_COLORS=auto 2023-11-29T08:57:30.865 INFO:tasks.workunit.client.0.smithi027.stderr:+++ S_COLORS=auto 2023-11-29T08:57:30.865 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.865 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-29T08:57:30.865 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.865 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-29T08:57:30.866 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.866 INFO:tasks.workunit.client.0.smithi027.stderr:+++ umask 2023-11-29T08:57:30.866 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' 0022 -eq 0 ']' 2023-11-29T08:57:30.866 INFO:tasks.workunit.client.0.smithi027.stderr:++ SHELL=/bin/bash 2023-11-29T08:57:30.866 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.866 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-29T08:57:30.866 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.867 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-29T08:57:30.867 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-29T08:57:30.867 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.867 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-29T08:57:30.867 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.867 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-29T08:57:30.867 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-29T08:57:30.867 INFO:tasks.workunit.client.0.smithi027.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-29T08:57:30.868 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.868 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-29T08:57:30.868 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.868 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-29T08:57:30.868 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.868 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-29T08:57:30.868 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-29T08:57:30.868 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-29T08:57:30.869 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.869 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-29T08:57:30.869 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.869 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-29T08:57:30.869 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-29T08:57:30.869 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.869 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-29T08:57:30.869 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.870 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/gawk.sh 2023-11-29T08:57:30.870 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.870 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-29T08:57:30.870 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.870 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/lang.sh 2023-11-29T08:57:30.870 INFO:tasks.workunit.client.0.smithi027.stderr:+++ unset LANG_backup 2023-11-29T08:57:30.870 INFO:tasks.workunit.client.0.smithi027.stderr:++++ /usr/bin/locale 2023-11-29T08:57:30.870 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-29T08:57:30.871 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-29T08:57:30.871 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-29T08:57:30.871 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.871 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-29T08:57:30.871 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.871 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-29T08:57:30.872 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-29T08:57:30.872 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.872 INFO:tasks.workunit.client.0.smithi027.stderr:++ printf %25s delete_pools_parallel 2023-11-29T08:57:30.872 INFO:tasks.workunit.client.0.smithi027.stderr:+ r=' delete_pools_parallel' 2023-11-29T08:57:30.872 INFO:tasks.workunit.client.0.smithi027.stderr:++ echo delete_pools_parallel 2023-11-29T08:57:30.872 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'grep=grep --color=auto' 2023-11-29T08:57:30.872 INFO:tasks.workunit.client.0.smithi027.stderr:++ awk '{print $1}' 2023-11-29T08:57:30.872 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-29T08:57:30.872 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-29T08:57:30.872 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.872 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-29T08:57:30.873 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.873 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorls.sh 2023-11-29T08:57:30.873 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' '!' -t 0 ']' 2023-11-29T08:57:30.873 INFO:tasks.workunit.client.0.smithi027.stderr:+++ return 2023-11-29T08:57:30.873 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.873 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-29T08:57:30.873 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.873 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-29T08:57:30.873 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export S_COLORS=auto 2023-11-29T08:57:30.873 INFO:tasks.workunit.client.0.smithi027.stderr:+++ S_COLORS=auto 2023-11-29T08:57:30.873 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.873 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-29T08:57:30.873 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.873 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-29T08:57:30.873 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.874 INFO:tasks.workunit.client.0.smithi027.stderr:+ ff=delete_pools_parallel 2023-11-29T08:57:30.874 INFO:tasks.workunit.client.0.smithi027.stderr:+ pid=85073 2023-11-29T08:57:30.874 INFO:tasks.workunit.client.0.smithi027.stderr:+ echo 'test delete_pools_parallel on pid 85073' 2023-11-29T08:57:30.874 INFO:tasks.workunit.client.0.smithi027.stdout:test delete_pools_parallel on pid 85073 2023-11-29T08:57:30.900 INFO:tasks.workunit.client.0.smithi027.stderr:+ pids[$f]=85073 2023-11-29T08:57:30.900 INFO:tasks.workunit.client.0.smithi027.stderr:+ ret=0 2023-11-29T08:57:30.900 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' 1 -eq 1 ']' 2023-11-29T08:57:30.900 INFO:tasks.workunit.client.0.smithi027.stderr:+ for t in "${!pids[@]}" 2023-11-29T08:57:30.900 INFO:tasks.workunit.client.0.smithi027.stderr:+ pid=84457 2023-11-29T08:57:30.900 INFO:tasks.workunit.client.0.smithi027.stderr:+ wait 84457 2023-11-29T08:57:30.901 INFO:tasks.workunit.client.0.smithi027.stderr:+ bash -o pipefail -exc 'ceph_test_rados_delete_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-delete_pools_parallel.xml 2>&1 | tee ceph_test_rados_delete_pools_parallel.log | sed "s/^/ delete_pools_parallel: /"' 2023-11-29T08:57:30.901 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-29T08:57:30.901 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-29T08:57:30.901 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-29T08:57:30.901 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.901 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-29T08:57:30.901 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' -f /etc/bashrc ']' 2023-11-29T08:57:30.901 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.901 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-29T08:57:30.901 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-29T08:57:30.901 INFO:tasks.workunit.client.0.smithi027.stderr:+ . /etc/bashrc 2023-11-29T08:57:30.901 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.901 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -z '' ']' 2023-11-29T08:57:30.901 INFO:tasks.workunit.client.0.smithi027.stderr:++ BASHRCSOURCED=Y 2023-11-29T08:57:30.901 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.902 INFO:tasks.workunit.client.0.smithi027.stderr:++ shopt -q login_shell 2023-11-29T08:57:30.902 INFO:tasks.workunit.client.0.smithi027.stderr:+++ umask 2023-11-29T08:57:30.902 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' 0022 -eq 0 ']' 2023-11-29T08:57:30.902 INFO:tasks.workunit.client.0.smithi027.stderr:++ SHELL=/bin/bash 2023-11-29T08:57:30.902 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.902 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-29T08:57:30.902 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.902 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-29T08:57:30.902 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-29T08:57:30.902 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.902 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-29T08:57:30.902 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.902 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-29T08:57:30.902 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n '' ']' 2023-11-29T08:57:30.903 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-29T08:57:30.903 INFO:tasks.workunit.client.0.smithi027.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-29T08:57:30.903 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.903 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-29T08:57:30.903 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.903 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-29T08:57:30.903 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.903 INFO:tasks.workunit.client.0.smithi027.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-29T08:57:30.903 INFO:tasks.workunit.client.0.smithi027.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-29T08:57:30.903 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-29T08:57:30.903 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-29T08:57:30.903 INFO:tasks.workunit.client.0.smithi027.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-29T08:57:30.903 INFO:tasks.workunit.client.0.smithi027.stderr:++++ /usr/bin/locale 2023-11-29T08:57:30.903 INFO:tasks.workunit.client.0.smithi027.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-29T08:57:30.904 INFO:tasks.workunit.client.0.smithi027.stderr:++++ export LANG=en_US.UTF-8 2023-11-29T08:57:30.904 INFO:tasks.workunit.client.0.smithi027.stderr:++++ LANG=en_US.UTF-8 2023-11-29T08:57:30.904 INFO:tasks.workunit.client.0.smithi027.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-29T08:57:30.904 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-29T08:57:30.904 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-29T08:57:30.904 INFO:tasks.workunit.client.0.smithi027.stderr:+++ LANG=en_US.UTF-8 2023-11-29T08:57:30.904 INFO:tasks.workunit.client.0.smithi027.stderr:+++ unset LANG_backup config 2023-11-29T08:57:30.904 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n '' ']' 2023-11-29T08:57:30.904 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-29T08:57:30.904 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' dumb = linux ']' 2023-11-29T08:57:30.904 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.904 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-29T08:57:30.904 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.904 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/less.sh 2023-11-29T08:57:30.904 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-29T08:57:30.905 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.905 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-29T08:57:30.905 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.905 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/which2.sh 2023-11-29T08:57:30.905 INFO:tasks.workunit.client.0.smithi027.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-29T08:57:30.905 INFO:tasks.workunit.client.0.smithi027.stderr:+++++ readlink /proc/85012/exe 2023-11-29T08:57:30.905 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n '' ']' 2023-11-29T08:57:30.905 INFO:tasks.workunit.client.0.smithi027.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-29T08:57:30.905 INFO:tasks.workunit.client.0.smithi027.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-29T08:57:30.905 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-29T08:57:30.905 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-29T08:57:30.905 INFO:tasks.workunit.client.0.smithi027.stderr:++++ basename /usr/bin/bash 2023-11-29T08:57:30.905 INFO:tasks.workunit.client.0.smithi027.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-29T08:57:30.906 INFO:tasks.workunit.client.0.smithi027.stderr:+++ which_declare='declare -f' 2023-11-29T08:57:30.906 INFO:tasks.workunit.client.0.smithi027.stderr:+++ which_opt=-f 2023-11-29T08:57:30.906 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export which_declare 2023-11-29T08:57:30.906 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export -f which 2023-11-29T08:57:30.906 INFO:tasks.workunit.client.0.smithi027.stderr:++ unset i 2023-11-29T08:57:30.906 INFO:tasks.workunit.client.0.smithi027.stderr:++ unset -f pathmunge 2023-11-29T08:57:30.906 INFO:tasks.workunit.client.0.smithi027.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-29T08:57:30.906 INFO:tasks.workunit.client.0.smithi027.stderr:+ export PATH 2023-11-29T08:57:30.906 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-29T08:57:30.906 INFO:tasks.workunit.client.0.smithi027.stderr:+ unset rc 2023-11-29T08:57:30.906 INFO:tasks.workunit.client.0.smithi027.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-29T08:57:30.906 INFO:tasks.workunit.client.0.smithi027.stderr:++++ export LANG=en_US.UTF-8 2023-11-29T08:57:30.906 INFO:tasks.workunit.client.0.smithi027.stderr:++++ LANG=en_US.UTF-8 2023-11-29T08:57:30.906 INFO:tasks.workunit.client.0.smithi027.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-29T08:57:30.906 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-29T08:57:30.907 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-29T08:57:30.907 INFO:tasks.workunit.client.0.smithi027.stderr:+++ LANG=en_US.UTF-8 2023-11-29T08:57:30.907 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-29T08:57:30.907 INFO:tasks.workunit.client.0.smithi027.stderr:+++ unset LANG_backup config 2023-11-29T08:57:30.907 INFO:tasks.workunit.client.0.smithi027.stderr:+ tee ceph_test_rados_api_cls_remote_reads.log 2023-11-29T08:57:30.907 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n '' ']' 2023-11-29T08:57:30.907 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-29T08:57:30.907 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-29T08:57:30.907 INFO:tasks.workunit.client.0.smithi027.stderr:+ ceph_test_rados_api_cls_remote_reads --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_cls_remote_reads.xml 2023-11-29T08:57:30.907 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-29T08:57:30.907 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' dumb = linux ']' 2023-11-29T08:57:30.907 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.907 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.907 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-29T08:57:30.908 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-29T08:57:30.908 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.908 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.908 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/less.sh 2023-11-29T08:57:30.908 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-29T08:57:30.908 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-29T08:57:30.908 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.908 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-29T08:57:30.908 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-29T08:57:30.908 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.908 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/which2.sh 2023-11-29T08:57:30.908 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.908 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-29T08:57:30.908 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.909 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/gawk.sh 2023-11-29T08:57:30.909 INFO:tasks.workunit.client.0.smithi027.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-29T08:57:30.909 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.909 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-29T08:57:30.909 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.909 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/lang.sh 2023-11-29T08:57:30.909 INFO:tasks.workunit.client.0.smithi027.stderr:+++ unset LANG_backup 2023-11-29T08:57:30.909 INFO:tasks.workunit.client.0.smithi027.stderr:+++++ readlink /proc/84986/exe 2023-11-29T08:57:30.909 INFO:tasks.workunit.client.0.smithi027.stderr:++++ /usr/bin/locale 2023-11-29T08:57:30.909 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n '' ']' 2023-11-29T08:57:30.909 INFO:tasks.workunit.client.0.smithi027.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-29T08:57:30.909 INFO:tasks.workunit.client.0.smithi027.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-29T08:57:30.909 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-29T08:57:30.909 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-29T08:57:30.910 INFO:tasks.workunit.client.0.smithi027.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-29T08:57:30.910 INFO:tasks.workunit.client.0.smithi027.stderr:++++ basename /usr/bin/bash 2023-11-29T08:57:30.910 INFO:tasks.workunit.client.0.smithi027.stderr:+++ which_declare='declare -f' 2023-11-29T08:57:30.910 INFO:tasks.workunit.client.0.smithi027.stderr:+++ which_opt=-f 2023-11-29T08:57:30.910 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export which_declare 2023-11-29T08:57:30.910 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export -f which 2023-11-29T08:57:30.910 INFO:tasks.workunit.client.0.smithi027.stderr:++ unset i 2023-11-29T08:57:30.910 INFO:tasks.workunit.client.0.smithi027.stderr:++ unset -f pathmunge 2023-11-29T08:57:30.910 INFO:tasks.workunit.client.0.smithi027.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-29T08:57:30.910 INFO:tasks.workunit.client.0.smithi027.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-29T08:57:30.910 INFO:tasks.workunit.client.0.smithi027.stderr:++++ export LANG=en_US.UTF-8 2023-11-29T08:57:30.910 INFO:tasks.workunit.client.0.smithi027.stderr:++++ LANG=en_US.UTF-8 2023-11-29T08:57:30.911 INFO:tasks.workunit.client.0.smithi027.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-29T08:57:30.911 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-29T08:57:30.911 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-29T08:57:30.911 INFO:tasks.workunit.client.0.smithi027.stderr:+++ LANG=en_US.UTF-8 2023-11-29T08:57:30.911 INFO:tasks.workunit.client.0.smithi027.stderr:+++ unset LANG_backup config 2023-11-29T08:57:30.911 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n '' ']' 2023-11-29T08:57:30.911 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-29T08:57:30.911 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' dumb = linux ']' 2023-11-29T08:57:30.911 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.911 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-29T08:57:30.911 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.911 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/less.sh 2023-11-29T08:57:30.911 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-29T08:57:30.911 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.912 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-29T08:57:30.912 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.912 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/which2.sh 2023-11-29T08:57:30.912 INFO:tasks.workunit.client.0.smithi027.stderr:+ export PATH 2023-11-29T08:57:30.912 INFO:tasks.workunit.client.0.smithi027.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-29T08:57:30.912 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-29T08:57:30.912 INFO:tasks.workunit.client.0.smithi027.stderr:+ unset rc 2023-11-29T08:57:30.912 INFO:tasks.workunit.client.0.smithi027.stderr:+ tee ceph_test_rados_api_c_read_operations.log 2023-11-29T08:57:30.912 INFO:tasks.workunit.client.0.smithi027.stderr:+ sed 's/^/ api_c_read_operations: /' 2023-11-29T08:57:30.912 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'grep=grep --color=auto' 2023-11-29T08:57:30.912 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-29T08:57:30.912 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-29T08:57:30.912 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.912 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-29T08:57:30.912 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.913 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorls.sh 2023-11-29T08:57:30.913 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' '!' -t 0 ']' 2023-11-29T08:57:30.913 INFO:tasks.workunit.client.0.smithi027.stderr:+++ return 2023-11-29T08:57:30.913 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.913 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-29T08:57:30.913 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.913 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-29T08:57:30.913 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export S_COLORS=auto 2023-11-29T08:57:30.913 INFO:tasks.workunit.client.0.smithi027.stderr:+++ S_COLORS=auto 2023-11-29T08:57:30.913 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.913 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-29T08:57:30.913 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.913 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-29T08:57:30.913 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-29T08:57:30.913 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-29T08:57:30.913 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-29T08:57:30.914 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.914 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-29T08:57:30.914 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.914 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-29T08:57:30.914 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.914 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-29T08:57:30.914 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.914 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-29T08:57:30.914 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.914 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/gawk.sh 2023-11-29T08:57:30.914 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.914 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-29T08:57:30.914 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.914 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/lang.sh 2023-11-29T08:57:30.914 INFO:tasks.workunit.client.0.smithi027.stderr:+++ unset LANG_backup 2023-11-29T08:57:30.915 INFO:tasks.workunit.client.0.smithi027.stderr:++++ /usr/bin/locale 2023-11-29T08:57:30.915 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n '' ']' 2023-11-29T08:57:30.915 INFO:tasks.workunit.client.0.smithi027.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-29T08:57:30.915 INFO:tasks.workunit.client.0.smithi027.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-29T08:57:30.915 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-29T08:57:30.915 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-29T08:57:30.915 INFO:tasks.workunit.client.0.smithi027.stderr:+ sed 's/^/ api_cls_remote_reads: /' 2023-11-29T08:57:30.915 INFO:tasks.workunit.client.0.smithi027.stderr:+++++ readlink /proc/85050/exe 2023-11-29T08:57:30.915 INFO:tasks.workunit.client.0.smithi027.stderr:+ ceph_test_rados_api_c_read_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_c_read_operations.xml 2023-11-29T08:57:30.915 INFO:tasks.workunit.client.0.smithi027.stderr:++++ basename /usr/bin/bash 2023-11-29T08:57:30.915 INFO:tasks.workunit.client.0.smithi027.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-29T08:57:30.915 INFO:tasks.workunit.client.0.smithi027.stderr:+++ which_declare='declare -f' 2023-11-29T08:57:30.915 INFO:tasks.workunit.client.0.smithi027.stderr:+++ which_opt=-f 2023-11-29T08:57:30.915 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export which_declare 2023-11-29T08:57:30.915 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export -f which 2023-11-29T08:57:30.916 INFO:tasks.workunit.client.0.smithi027.stderr:++ unset i 2023-11-29T08:57:30.916 INFO:tasks.workunit.client.0.smithi027.stderr:++ unset -f pathmunge 2023-11-29T08:57:30.916 INFO:tasks.workunit.client.0.smithi027.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-29T08:57:30.916 INFO:tasks.workunit.client.0.smithi027.stderr:+ export PATH 2023-11-29T08:57:30.917 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-29T08:57:30.917 INFO:tasks.workunit.client.0.smithi027.stderr:+ unset rc 2023-11-29T08:57:30.917 INFO:tasks.workunit.client.0.smithi027.stderr:+ tee ceph_test_rados_open_pools_parallel.log 2023-11-29T08:57:30.917 INFO:tasks.workunit.client.0.smithi027.stderr:+ sed 's/^/ open_pools_parallel: /' 2023-11-29T08:57:30.917 INFO:tasks.workunit.client.0.smithi027.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-29T08:57:30.917 INFO:tasks.workunit.client.0.smithi027.stderr:++++ export LANG=en_US.UTF-8 2023-11-29T08:57:30.917 INFO:tasks.workunit.client.0.smithi027.stderr:++++ LANG=en_US.UTF-8 2023-11-29T08:57:30.917 INFO:tasks.workunit.client.0.smithi027.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-29T08:57:30.917 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-29T08:57:30.917 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-29T08:57:30.917 INFO:tasks.workunit.client.0.smithi027.stderr:+++ LANG=en_US.UTF-8 2023-11-29T08:57:30.917 INFO:tasks.workunit.client.0.smithi027.stderr:+++ unset LANG_backup config 2023-11-29T08:57:30.918 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n '' ']' 2023-11-29T08:57:30.918 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-29T08:57:30.918 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' dumb = linux ']' 2023-11-29T08:57:30.918 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.918 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-29T08:57:30.918 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.918 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/less.sh 2023-11-29T08:57:30.918 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-29T08:57:30.918 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.918 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-29T08:57:30.918 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.918 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/which2.sh 2023-11-29T08:57:30.918 INFO:tasks.workunit.client.0.smithi027.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-29T08:57:30.918 INFO:tasks.workunit.client.0.smithi027.stderr:+++++ readlink /proc/85035/exe 2023-11-29T08:57:30.919 INFO:tasks.workunit.client.0.smithi027.stderr:+ ceph_test_rados_open_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-open_pools_parallel.xml 2023-11-29T08:57:30.919 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-29T08:57:30.919 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-29T08:57:30.919 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-29T08:57:30.919 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.919 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-29T08:57:30.919 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.919 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-29T08:57:30.919 INFO:tasks.workunit.client.0.smithi027.stderr:++++ basename /usr/bin/bash 2023-11-29T08:57:30.919 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-29T08:57:30.919 INFO:tasks.workunit.client.0.smithi027.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-29T08:57:30.919 INFO:tasks.workunit.client.0.smithi027.stderr:+++ which_declare='declare -f' 2023-11-29T08:57:30.919 INFO:tasks.workunit.client.0.smithi027.stderr:+++ which_opt=-f 2023-11-29T08:57:30.919 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export which_declare 2023-11-29T08:57:30.919 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export -f which 2023-11-29T08:57:30.919 INFO:tasks.workunit.client.0.smithi027.stderr:++ unset i 2023-11-29T08:57:30.920 INFO:tasks.workunit.client.0.smithi027.stderr:++ unset -f pathmunge 2023-11-29T08:57:30.920 INFO:tasks.workunit.client.0.smithi027.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-29T08:57:30.920 INFO:tasks.workunit.client.0.smithi027.stderr:+ export PATH 2023-11-29T08:57:30.920 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-29T08:57:30.920 INFO:tasks.workunit.client.0.smithi027.stderr:+ unset rc 2023-11-29T08:57:30.920 INFO:tasks.workunit.client.0.smithi027.stderr:+ sed 's/^/ list_parallel: /' 2023-11-29T08:57:30.920 INFO:tasks.workunit.client.0.smithi027.stderr:+ ceph_test_rados_list_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-list_parallel.xml 2023-11-29T08:57:30.920 INFO:tasks.workunit.client.0.smithi027.stderr:+ tee ceph_test_rados_list_parallel.log 2023-11-29T08:57:30.920 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-29T08:57:30.920 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-29T08:57:30.920 INFO:tasks.workunit.client.0.smithi027.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-29T08:57:30.920 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.920 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-29T08:57:30.920 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.920 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-29T08:57:30.921 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-29T08:57:30.921 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.921 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-29T08:57:30.921 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.921 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/gawk.sh 2023-11-29T08:57:30.921 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.921 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-29T08:57:30.921 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.921 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/lang.sh 2023-11-29T08:57:30.921 INFO:tasks.workunit.client.0.smithi027.stderr:+++ unset LANG_backup 2023-11-29T08:57:30.921 INFO:tasks.workunit.client.0.smithi027.stderr:++++ /usr/bin/locale 2023-11-29T08:57:30.921 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n '' ']' 2023-11-29T08:57:30.921 INFO:tasks.workunit.client.0.smithi027.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-29T08:57:30.921 INFO:tasks.workunit.client.0.smithi027.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-29T08:57:30.922 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-29T08:57:30.922 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-29T08:57:30.922 INFO:tasks.workunit.client.0.smithi027.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-29T08:57:30.922 INFO:tasks.workunit.client.0.smithi027.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-29T08:57:30.922 INFO:tasks.workunit.client.0.smithi027.stderr:++++ export LANG=en_US.UTF-8 2023-11-29T08:57:30.922 INFO:tasks.workunit.client.0.smithi027.stderr:++++ LANG=en_US.UTF-8 2023-11-29T08:57:30.922 INFO:tasks.workunit.client.0.smithi027.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-29T08:57:30.922 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-29T08:57:30.922 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-29T08:57:30.922 INFO:tasks.workunit.client.0.smithi027.stderr:+++ LANG=en_US.UTF-8 2023-11-29T08:57:30.922 INFO:tasks.workunit.client.0.smithi027.stderr:+++ unset LANG_backup config 2023-11-29T08:57:30.922 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n '' ']' 2023-11-29T08:57:30.922 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-29T08:57:30.922 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' dumb = linux ']' 2023-11-29T08:57:30.923 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.923 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-29T08:57:30.923 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.923 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/less.sh 2023-11-29T08:57:30.923 INFO:tasks.workunit.client.0.smithi027.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-29T08:57:30.923 INFO:tasks.workunit.client.0.smithi027.stderr:++ for i in /etc/profile.d/*.sh 2023-11-29T08:57:30.923 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-29T08:57:30.923 INFO:tasks.workunit.client.0.smithi027.stderr:++ '[' '' ']' 2023-11-29T08:57:30.923 INFO:tasks.workunit.client.0.smithi027.stderr:++ . /etc/profile.d/which2.sh 2023-11-29T08:57:30.923 INFO:tasks.workunit.client.0.smithi027.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-29T08:57:30.923 INFO:tasks.workunit.client.0.smithi027.stderr:+++++ readlink /proc/85073/exe 2023-11-29T08:57:30.923 INFO:tasks.workunit.client.0.smithi027.stderr:++++ basename /usr/bin/bash 2023-11-29T08:57:30.923 INFO:tasks.workunit.client.0.smithi027.stderr:+++ which_declare='declare -f' 2023-11-29T08:57:30.923 INFO:tasks.workunit.client.0.smithi027.stderr:+++ which_opt=-f 2023-11-29T08:57:30.923 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export which_declare 2023-11-29T08:57:30.923 INFO:tasks.workunit.client.0.smithi027.stderr:+++ export -f which 2023-11-29T08:57:30.924 INFO:tasks.workunit.client.0.smithi027.stderr:++ unset i 2023-11-29T08:57:30.924 INFO:tasks.workunit.client.0.smithi027.stderr:++ unset -f pathmunge 2023-11-29T08:57:30.924 INFO:tasks.workunit.client.0.smithi027.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-29T08:57:30.924 INFO:tasks.workunit.client.0.smithi027.stderr:+ export PATH 2023-11-29T08:57:30.924 INFO:tasks.workunit.client.0.smithi027.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-29T08:57:30.924 INFO:tasks.workunit.client.0.smithi027.stderr:+ unset rc 2023-11-29T08:57:30.924 INFO:tasks.workunit.client.0.smithi027.stderr:+ sed 's/^/ delete_pools_parallel: /' 2023-11-29T08:57:30.924 INFO:tasks.workunit.client.0.smithi027.stderr:+ tee ceph_test_rados_delete_pools_parallel.log 2023-11-29T08:57:30.924 INFO:tasks.workunit.client.0.smithi027.stderr:+ ceph_test_rados_delete_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-delete_pools_parallel.xml 2023-11-29T08:57:30.924 INFO:tasks.workunit.client.0.smithi027.stdout: api_cls_remote_reads: [==========] Running 1 test from 1 test suite. 2023-11-29T08:57:30.924 INFO:tasks.workunit.client.0.smithi027.stdout: api_cls_remote_reads: [----------] Global test environment set-up. 2023-11-29T08:57:30.924 INFO:tasks.workunit.client.0.smithi027.stdout: api_cls_remote_reads: [----------] 1 test from ClsTestRemoteReads 2023-11-29T08:57:30.925 INFO:tasks.workunit.client.0.smithi027.stdout: api_cls_remote_reads: [ RUN ] ClsTestRemoteReads.TestGather 2023-11-29T08:57:30.925 INFO:tasks.workunit.client.0.smithi027.stdout: api_cls_remote_reads: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/cls_remote_reads.cc:13: Skipped 2023-11-29T08:57:30.925 INFO:tasks.workunit.client.0.smithi027.stdout: api_cls_remote_reads: Not supported by crimson yet. Skipped 2023-11-29T08:57:30.925 INFO:tasks.workunit.client.0.smithi027.stdout: api_cls_remote_reads: [ SKIPPED ] ClsTestRemoteReads.TestGather (0 ms) 2023-11-29T08:57:30.925 INFO:tasks.workunit.client.0.smithi027.stdout: api_cls_remote_reads: [----------] 1 test from ClsTestRemoteReads (0 ms total) 2023-11-29T08:57:30.925 INFO:tasks.workunit.client.0.smithi027.stdout: api_cls_remote_reads: 2023-11-29T08:57:30.925 INFO:tasks.workunit.client.0.smithi027.stdout: api_cls_remote_reads: [----------] Global test environment tear-down 2023-11-29T08:57:30.925 INFO:tasks.workunit.client.0.smithi027.stdout: api_cls_remote_reads: [==========] 1 test from 1 test suite ran. (0 ms total) 2023-11-29T08:57:30.925 INFO:tasks.workunit.client.0.smithi027.stdout: api_cls_remote_reads: [ PASSED ] 0 tests. 2023-11-29T08:57:30.925 INFO:tasks.workunit.client.0.smithi027.stdout: api_cls_remote_reads: [ SKIPPED ] 1 test, listed below: 2023-11-29T08:57:30.925 INFO:tasks.workunit.client.0.smithi027.stdout: api_cls_remote_reads: [ SKIPPED ] ClsTestRemoteReads.TestGather 2023-11-29T08:57:30.925 INFO:tasks.workunit.client.0.smithi027.stdout: api_cls_remote_reads: 2023-11-29T08:57:30.737+0000 7f182e232640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:57:30.925 INFO:tasks.workunit.client.0.smithi027.stdout: api_cls_remote_reads: 2023-11-29T08:57:30.737+0000 7f182e232640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:57:30.925 INFO:tasks.workunit.client.0.smithi027.stdout: api_cls_remote_reads: 2023-11-29T08:57:30.737+0000 7f182e232640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:57:34.141 INFO:tasks.workunit.client.0.smithi027.stdout:[v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7fa3340361d0 0x7fa3340386e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:57:34.141 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:30.612+0000 7fa3437fe640 1 -- 172.21.15.27:0/2308983894 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2672+0+0 (crc 0 0 0) 0x7fa34c046c40 con 0x55dcc32e9d10 2023-11-29T08:57:34.141 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:30.613+0000 7fa359258640 1 -- 172.21.15.27:0/2308983894 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x55dcc31df620 con 0x55dcc32e9d10 2023-11-29T08:57:34.141 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:30.613+0000 7fa351b99640 1 --2- 172.21.15.27:0/2308983894 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7fa3340361d0 0x7fa3340386e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T08:57:34.141 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:30.614+0000 7fa351b99640 1 --2- 172.21.15.27:0/2308983894 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7fa3340361d0 0x7fa3340386e0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:57:34.141 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:30.694+0000 7fa3437fe640 1 -- 172.21.15.27:0/2308983894 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (crc 0 0 0) 0x7fa34c00fe20 con 0x55dcc32e9d10 2023-11-29T08:57:34.141 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:30.694+0000 7fa359258640 1 -- 172.21.15.27:0/2308983894 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- pool_op(create pool 0 tid 1 name ceph_test_rados_api_asio v0) v4 -- 0x55dcc31f06d0 con 0x55dcc32e9d10 2023-11-29T08:57:34.142 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:30.873+0000 7fa3437fe640 1 -- 172.21.15.27:0/2308983894 <== mon.0 v2:172.21.15.27:3300/0 7 ==== pool_op_reply(tid 1 (0) Success v16) v1 ==== 43+0+0 (crc 0 0 0) 0x7fa34c00fa30 con 0x55dcc32e9d10 2023-11-29T08:57:34.142 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:30.873+0000 7fa3437fe640 1 -- 172.21.15.27:0/2308983894 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=16}) v3 -- 0x7fa33403aaf0 con 0x55dcc32e9d10 2023-11-29T08:57:34.142 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:31.001+0000 7fa3437fe640 1 -- 172.21.15.27:0/2308983894 <== mon.0 v2:172.21.15.27:3300/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 4340+0+0 (crc 0 0 0) 0x7fa34c00fc10 con 0x55dcc32e9d10 2023-11-29T08:57:34.142 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:31.001+0000 7fa359258640 1 --2- 172.21.15.27:0/2308983894 >> v2:172.21.15.27:6800/601592489 conn(0x55dcc338ed00 0x55dcc3391120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T08:57:34.142 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:31.001+0000 7fa359258640 1 -- 172.21.15.27:0/2308983894 --> v2:172.21.15.27:6800/601592489 -- osd_op(unknown.0.0:2 10.1 10:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16) v8 -- 0x55dcc32db380 con 0x55dcc338ed00 2023-11-29T08:57:34.142 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:31.002+0000 7fa352b9b640 1 --2- 172.21.15.27:0/2308983894 >> v2:172.21.15.27:6800/601592489 conn(0x55dcc338ed00 0x55dcc3391120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-29T08:57:34.142 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:31.012+0000 7fa352b9b640 1 --2- 172.21.15.27:0/2308983894 >> v2:172.21.15.27:6800/601592489 conn(0x55dcc338ed00 0x55dcc3391120 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T08:57:34.142 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:34.140+0000 7fa352b9b640 1 -- 172.21.15.27:0/2308983894 <== osd.0 v2:172.21.15.27:6800/601592489 1 ==== osd_op_reply(2 exist [writefull 0~5] v17'1 uv1 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fa34400c430 con 0x55dcc338ed00 2023-11-29T08:57:34.142 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: [ RUN ] AsioRados.AsyncReadCallback 2023-11-29T08:57:35.905 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [==========] Running 77 tests from 4 test suites. 2023-11-29T08:57:35.905 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [----------] Global test environment set-up. 2023-11-29T08:57:35.905 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [----------] 3 tests from LibRadosTierPP 2023-11-29T08:57:35.905 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: seed 84625 2023-11-29T08:57:35.905 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: 2023-11-29T08:57:30.539+0000 7fac4b846940 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:57:35.905 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: 2023-11-29T08:57:30.539+0000 7fac4b846940 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:57:35.905 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: 2023-11-29T08:57:30.539+0000 7fac4b846940 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:57:35.905 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.Dirty 2023-11-29T08:57:35.906 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:287: Skipped 2023-11-29T08:57:35.906 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.906 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierPP.Dirty (0 ms) 2023-11-29T08:57:35.906 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.FlushWriteRaces 2023-11-29T08:57:35.906 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:2182: Skipped 2023-11-29T08:57:35.906 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.906 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierPP.FlushWriteRaces (0 ms) 2023-11-29T08:57:35.906 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.HitSetNone 2023-11-29T08:57:35.906 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:2561: Skipped 2023-11-29T08:57:35.906 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.906 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierPP.HitSetNone (0 ms) 2023-11-29T08:57:35.906 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [----------] 3 tests from LibRadosTierPP (0 ms total) 2023-11-29T08:57:35.906 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: 2023-11-29T08:57:35.906 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [----------] 48 tests from LibRadosTwoPoolsPP 2023-11-29T08:57:35.907 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Overlay 2023-11-29T08:57:35.907 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:223: Skipped 2023-11-29T08:57:35.907 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.907 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:233: Skipped 2023-11-29T08:57:35.907 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.907 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.Overlay (0 ms) 2023-11-29T08:57:35.907 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Promote 2023-11-29T08:57:35.907 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:223: Skipped 2023-11-29T08:57:35.907 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.907 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:233: Skipped 2023-11-29T08:57:35.907 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.907 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.Promote (0 ms) 2023-11-29T08:57:35.907 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnap 2023-11-29T08:57:35.907 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:223: Skipped 2023-11-29T08:57:35.908 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.908 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:233: Skipped 2023-11-29T08:57:35.908 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.908 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnap (0 ms) 2023-11-29T08:57:35.908 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnapScrub 2023-11-29T08:57:35.908 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:223: Skipped 2023-11-29T08:57:35.908 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.908 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:233: Skipped 2023-11-29T08:57:35.908 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.908 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapScrub (0 ms) 2023-11-29T08:57:35.908 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnapTrimRace 2023-11-29T08:57:35.908 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:223: Skipped 2023-11-29T08:57:35.908 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.908 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:233: Skipped 2023-11-29T08:57:35.909 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.909 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapTrimRace (0 ms) 2023-11-29T08:57:35.909 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Whiteout 2023-11-29T08:57:35.909 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:223: Skipped 2023-11-29T08:57:35.909 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.909 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:233: Skipped 2023-11-29T08:57:35.909 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.909 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.Whiteout (0 ms) 2023-11-29T08:57:35.909 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate 2023-11-29T08:57:35.909 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:223: Skipped 2023-11-29T08:57:35.909 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.910 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:233: Skipped 2023-11-29T08:57:35.910 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.910 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate (0 ms) 2023-11-29T08:57:35.910 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Evict 2023-11-29T08:57:35.910 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:223: Skipped 2023-11-29T08:57:35.910 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.910 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:233: Skipped 2023-11-29T08:57:35.910 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.910 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.Evict (0 ms) 2023-11-29T08:57:35.910 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnap 2023-11-29T08:57:35.910 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:223: Skipped 2023-11-29T08:57:35.910 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.910 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:233: Skipped 2023-11-29T08:57:35.911 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.911 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap (0 ms) 2023-11-29T08:57:35.911 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnap2 2023-11-29T08:57:35.911 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:223: Skipped 2023-11-29T08:57:35.911 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.911 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:233: Skipped 2023-11-29T08:57:35.911 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.911 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap2 (0 ms) 2023-11-29T08:57:35.911 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ListSnap 2023-11-29T08:57:35.911 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:223: Skipped 2023-11-29T08:57:35.911 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.911 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:233: Skipped 2023-11-29T08:57:35.911 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.911 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ListSnap (0 ms) 2023-11-29T08:57:35.911 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace 2023-11-29T08:57:35.912 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:223: Skipped 2023-11-29T08:57:35.912 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.912 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:233: Skipped 2023-11-29T08:57:35.912 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.912 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace (0 ms) 2023-11-29T08:57:35.912 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TryFlush 2023-11-29T08:57:35.912 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:223: Skipped 2023-11-29T08:57:35.912 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.912 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:233: Skipped 2023-11-29T08:57:35.912 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.912 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.TryFlush (0 ms) 2023-11-29T08:57:35.912 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Flush 2023-11-29T08:57:35.912 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:223: Skipped 2023-11-29T08:57:35.912 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.912 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:233: Skipped 2023-11-29T08:57:35.912 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.913 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.Flush (0 ms) 2023-11-29T08:57:35.913 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.FlushSnap 2023-11-29T08:57:35.913 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:223: Skipped 2023-11-29T08:57:35.913 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.913 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:233: Skipped 2023-11-29T08:57:35.913 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.913 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.FlushSnap (0 ms) 2023-11-29T08:57:35.913 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.FlushTryFlushRaces 2023-11-29T08:57:35.913 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:223: Skipped 2023-11-29T08:57:35.913 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.913 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:233: Skipped 2023-11-29T08:57:35.913 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.913 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.FlushTryFlushRaces (0 ms) 2023-11-29T08:57:35.913 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TryFlushReadRace 2023-11-29T08:57:35.913 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:223: Skipped 2023-11-29T08:57:35.914 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.914 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:233: Skipped 2023-11-29T08:57:35.914 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.914 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.TryFlushReadRace (0 ms) 2023-11-29T08:57:35.914 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetRead 2023-11-29T08:57:35.914 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:223: Skipped 2023-11-29T08:57:35.914 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.914 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:233: Skipped 2023-11-29T08:57:35.914 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.914 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.HitSetRead (0 ms) 2023-11-29T08:57:35.914 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetWrite 2023-11-29T08:57:35.914 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:223: Skipped 2023-11-29T08:57:35.914 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.914 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:233: Skipped 2023-11-29T08:57:35.915 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.915 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.HitSetWrite (0 ms) 2023-11-29T08:57:35.915 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetTrim 2023-11-29T08:57:35.915 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:223: Skipped 2023-11-29T08:57:35.915 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.915 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:233: Skipped 2023-11-29T08:57:35.915 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.915 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.HitSetTrim (0 ms) 2023-11-29T08:57:35.915 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteOn2ndRead 2023-11-29T08:57:35.915 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:223: Skipped 2023-11-29T08:57:35.915 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.915 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:233: Skipped 2023-11-29T08:57:35.915 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.915 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.PromoteOn2ndRead (0 ms) 2023-11-29T08:57:35.915 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ProxyRead 2023-11-29T08:57:35.915 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:223: Skipped 2023-11-29T08:57:35.916 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.916 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:233: Skipped 2023-11-29T08:57:35.916 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.916 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ProxyRead (0 ms) 2023-11-29T08:57:35.916 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.CachePin 2023-11-29T08:57:35.916 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:223: Skipped 2023-11-29T08:57:35.916 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.916 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:233: Skipped 2023-11-29T08:57:35.916 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.916 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.CachePin (0 ms) 2023-11-29T08:57:35.916 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.SetRedirectRead 2023-11-29T08:57:35.916 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:223: Skipped 2023-11-29T08:57:35.916 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.916 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:233: Skipped 2023-11-29T08:57:35.916 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.917 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.SetRedirectRead (0 ms) 2023-11-29T08:57:35.917 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestPromoteRead 2023-11-29T08:57:35.917 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:223: Skipped 2023-11-29T08:57:35.917 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.917 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:233: Skipped 2023-11-29T08:57:35.917 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.917 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestPromoteRead (0 ms) 2023-11-29T08:57:35.917 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRefRead 2023-11-29T08:57:35.917 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:223: Skipped 2023-11-29T08:57:35.917 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.917 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:233: Skipped 2023-11-29T08:57:35.917 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.917 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestRefRead (0 ms) 2023-11-29T08:57:35.917 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestUnset 2023-11-29T08:57:35.917 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:223: Skipped 2023-11-29T08:57:35.917 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.918 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:233: Skipped 2023-11-29T08:57:35.918 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.918 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestUnset (0 ms) 2023-11-29T08:57:35.918 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestDedupRefRead 2023-11-29T08:57:35.918 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:223: Skipped 2023-11-29T08:57:35.918 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.918 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:233: Skipped 2023-11-29T08:57:35.918 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.918 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestDedupRefRead (0 ms) 2023-11-29T08:57:35.918 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount 2023-11-29T08:57:35.918 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:223: Skipped 2023-11-29T08:57:35.918 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.918 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:233: Skipped 2023-11-29T08:57:35.918 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.918 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount (0 ms) 2023-11-29T08:57:35.919 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 2023-11-29T08:57:35.919 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:223: Skipped 2023-11-29T08:57:35.919 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.919 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:233: Skipped 2023-11-29T08:57:35.919 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.919 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 (0 ms) 2023-11-29T08:57:35.919 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestTestSnapCreate 2023-11-29T08:57:35.919 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:223: Skipped 2023-11-29T08:57:35.919 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.919 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:233: Skipped 2023-11-29T08:57:35.919 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.919 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestTestSnapCreate (0 ms) 2023-11-29T08:57:35.919 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote 2023-11-29T08:57:35.919 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:223: Skipped 2023-11-29T08:57:35.919 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.920 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:233: Skipped 2023-11-29T08:57:35.920 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.920 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote (0 ms) 2023-11-29T08:57:35.920 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification 2023-11-29T08:57:35.920 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:223: Skipped 2023-11-29T08:57:35.920 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.920 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:233: Skipped 2023-11-29T08:57:35.920 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.920 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification (0 ms) 2023-11-29T08:57:35.920 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapIncCount 2023-11-29T08:57:35.920 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:223: Skipped 2023-11-29T08:57:35.920 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.920 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:233: Skipped 2023-11-29T08:57:35.920 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.920 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapIncCount (0 ms) 2023-11-29T08:57:35.920 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvict 2023-11-29T08:57:35.921 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:223: Skipped 2023-11-29T08:57:35.921 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.921 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:233: Skipped 2023-11-29T08:57:35.921 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.921 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvict (0 ms) 2023-11-29T08:57:35.921 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvictPromote 2023-11-29T08:57:35.921 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:223: Skipped 2023-11-29T08:57:35.921 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.921 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:233: Skipped 2023-11-29T08:57:35.921 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.921 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictPromote (0 ms) 2023-11-29T08:57:35.921 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch 2023-11-29T08:57:35.921 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:223: Skipped 2023-11-29T08:57:35.921 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.921 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:233: Skipped 2023-11-29T08:57:35.922 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.922 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch (0 ms) 2023-11-29T08:57:35.922 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.DedupFlushRead 2023-11-29T08:57:35.922 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:223: Skipped 2023-11-29T08:57:35.922 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.922 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:233: Skipped 2023-11-29T08:57:35.922 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.922 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.DedupFlushRead (0 ms) 2023-11-29T08:57:35.922 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestFlushSnap 2023-11-29T08:57:35.922 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:223: Skipped 2023-11-29T08:57:35.922 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.922 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:233: Skipped 2023-11-29T08:57:35.922 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.922 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushSnap (0 ms) 2023-11-29T08:57:35.923 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestFlushDupCount 2023-11-29T08:57:35.923 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:223: Skipped 2023-11-29T08:57:35.923 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.923 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:233: Skipped 2023-11-29T08:57:35.923 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.923 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushDupCount (0 ms) 2023-11-29T08:57:35.923 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TierFlushDuringFlush 2023-11-29T08:57:35.923 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:223: Skipped 2023-11-29T08:57:35.923 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.923 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:233: Skipped 2023-11-29T08:57:35.923 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.923 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringFlush (0 ms) 2023-11-29T08:57:35.923 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapHasChunk 2023-11-29T08:57:35.923 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:223: Skipped 2023-11-29T08:57:35.923 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.923 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:233: Skipped 2023-11-29T08:57:35.924 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.924 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapHasChunk (0 ms) 2023-11-29T08:57:35.924 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRollback 2023-11-29T08:57:35.924 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:223: Skipped 2023-11-29T08:57:35.924 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.924 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:233: Skipped 2023-11-29T08:57:35.924 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.924 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollback (0 ms) 2023-11-29T08:57:35.924 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRollbackRefcount 2023-11-29T08:57:35.924 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:223: Skipped 2023-11-29T08:57:35.924 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.924 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:233: Skipped 2023-11-29T08:57:35.924 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:35.924 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollbackRefcount (0 ms) 2023-11-29T08:57:35.924 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvictRollback 2023-11-29T08:57:35.924 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:223: Skipped 2023-11-29T08:57:35.924 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:36.904 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:233: Skipped 2023-11-29T08:57:36.904 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:36.904 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictRollback (0 ms) 2023-11-29T08:57:36.904 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PropagateBaseTierError 2023-11-29T08:57:36.905 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:223: Skipped 2023-11-29T08:57:36.905 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:36.905 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:233: Skipped 2023-11-29T08:57:36.905 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:36.905 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.PropagateBaseTierError (0 ms) 2023-11-29T08:57:36.905 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HelloWriteReturn 2023-11-29T08:57:36.905 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:223: Skipped 2023-11-29T08:57:36.905 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:36.905 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:233: Skipped 2023-11-29T08:57:36.905 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:36.905 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.HelloWriteReturn (0 ms) 2023-11-29T08:57:36.905 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier 2023-11-29T08:57:36.905 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:223: Skipped 2023-11-29T08:57:36.905 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:36.906 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:233: Skipped 2023-11-29T08:57:36.906 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:36.906 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier (0 ms) 2023-11-29T08:57:36.906 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [----------] 48 tests from LibRadosTwoPoolsPP (0 ms total) 2023-11-29T08:57:36.906 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: 2023-11-29T08:57:36.906 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [----------] 4 tests from LibRadosTierECPP 2023-11-29T08:57:36.906 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:373: Skipped 2023-11-29T08:57:36.906 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:36.906 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.Dirty 2023-11-29T08:57:36.906 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:387: Skipped 2023-11-29T08:57:36.906 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:36.906 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:400: Skipped 2023-11-29T08:57:36.906 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:36.906 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierECPP.Dirty (0 ms) 2023-11-29T08:57:36.907 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.FlushWriteRaces 2023-11-29T08:57:36.907 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:387: Skipped 2023-11-29T08:57:36.907 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:36.907 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:400: Skipped 2023-11-29T08:57:36.907 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:36.907 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierECPP.FlushWriteRaces (0 ms) 2023-11-29T08:57:36.907 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.CallForcesPromote 2023-11-29T08:57:36.907 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:387: Skipped 2023-11-29T08:57:36.907 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:36.907 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:400: Skipped 2023-11-29T08:57:36.907 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:36.907 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierECPP.CallForcesPromote (0 ms) 2023-11-29T08:57:36.907 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.HitSetNone 2023-11-29T08:57:36.907 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:387: Skipped 2023-11-29T08:57:36.907 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:36.908 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:400: Skipped 2023-11-29T08:57:36.908 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:36.908 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierECPP.HitSetNone (0 ms) 2023-11-29T08:57:36.908 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:381: Skipped 2023-11-29T08:57:36.908 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:36.908 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [----------] 4 tests from LibRadosTierECPP (0 ms total) 2023-11-29T08:57:36.908 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: 2023-11-29T08:57:36.908 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [----------] 22 tests from LibRadosTwoPoolsECPP 2023-11-29T08:57:36.908 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:6267: Skipped 2023-11-29T08:57:36.908 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:36.908 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Overlay 2023-11-29T08:57:36.908 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:6278: Skipped 2023-11-29T08:57:36.908 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:36.908 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:6288: Skipped 2023-11-29T08:57:36.909 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:36.909 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.Overlay (0 ms) 2023-11-29T08:57:36.909 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Promote 2023-11-29T08:57:36.909 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:6278: Skipped 2023-11-29T08:57:36.909 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:36.909 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:6288: Skipped 2023-11-29T08:57:36.909 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:36.909 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.Promote (1 ms) 2023-11-29T08:57:36.909 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteSnap 2023-11-29T08:57:36.909 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:6278: Skipped 2023-11-29T08:57:36.909 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:36.909 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:6288: Skipped 2023-11-29T08:57:36.909 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:36.909 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnap (0 ms) 2023-11-29T08:57:36.909 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace 2023-11-29T08:57:36.910 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:6278: Skipped 2023-11-29T08:57:36.910 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:36.910 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:6288: Skipped 2023-11-29T08:57:36.910 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:36.910 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace (0 ms) 2023-11-29T08:57:36.910 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Whiteout 2023-11-29T08:57:36.910 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:6278: Skipped 2023-11-29T08:57:36.910 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:36.910 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:6288: Skipped 2023-11-29T08:57:36.910 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:36.910 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.Whiteout (0 ms) 2023-11-29T08:57:36.910 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Evict 2023-11-29T08:57:36.910 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:6278: Skipped 2023-11-29T08:57:36.911 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:36.911 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:6288: Skipped 2023-11-29T08:57:36.911 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:36.911 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.Evict (0 ms) 2023-11-29T08:57:36.911 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.EvictSnap 2023-11-29T08:57:36.911 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:6278: Skipped 2023-11-29T08:57:36.911 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:36.911 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:6288: Skipped 2023-11-29T08:57:36.911 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:36.911 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.EvictSnap (0 ms) 2023-11-29T08:57:36.911 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TryFlush 2023-11-29T08:57:36.911 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:6278: Skipped 2023-11-29T08:57:36.911 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:36.911 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:6288: Skipped 2023-11-29T08:57:36.911 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:36.912 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.TryFlush (0 ms) 2023-11-29T08:57:36.912 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FailedFlush 2023-11-29T08:57:36.912 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:6278: Skipped 2023-11-29T08:57:36.912 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:36.912 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:6288: Skipped 2023-11-29T08:57:36.912 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:36.912 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.FailedFlush (0 ms) 2023-11-29T08:57:36.912 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Flush 2023-11-29T08:57:36.912 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:6278: Skipped 2023-11-29T08:57:36.912 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:36.912 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:6288: Skipped 2023-11-29T08:57:36.912 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:36.912 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.Flush (0 ms) 2023-11-29T08:57:36.912 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FlushSnap 2023-11-29T08:57:36.912 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:6278: Skipped 2023-11-29T08:57:36.912 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:36.913 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:6288: Skipped 2023-11-29T08:57:36.913 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:36.913 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.FlushSnap (0 ms) 2023-11-29T08:57:36.913 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FlushTryFlushRaces 2023-11-29T08:57:36.913 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:6278: Skipped 2023-11-29T08:57:36.913 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:36.913 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:6288: Skipped 2023-11-29T08:57:36.913 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:36.913 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.FlushTryFlushRaces (0 ms) 2023-11-29T08:57:36.913 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TryFlushReadRace 2023-11-29T08:57:36.913 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:6278: Skipped 2023-11-29T08:57:36.913 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:36.913 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:6288: Skipped 2023-11-29T08:57:36.913 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:36.913 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.TryFlushReadRace (0 ms) 2023-11-29T08:57:36.914 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.HitSetRead 2023-11-29T08:57:36.914 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:6278: Skipped 2023-11-29T08:57:36.914 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:36.914 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:6288: Skipped 2023-11-29T08:57:36.914 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:36.914 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.HitSetRead (0 ms) 2023-11-29T08:57:36.914 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.HitSetTrim 2023-11-29T08:57:36.914 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:6278: Skipped 2023-11-29T08:57:36.914 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:36.914 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:6288: Skipped 2023-11-29T08:57:36.914 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:36.914 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.HitSetTrim (0 ms) 2023-11-29T08:57:36.914 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteOn2ndRead 2023-11-29T08:57:36.914 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:6278: Skipped 2023-11-29T08:57:36.915 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:36.915 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:6288: Skipped 2023-11-29T08:57:36.915 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:36.915 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.PromoteOn2ndRead (0 ms) 2023-11-29T08:57:36.915 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.ProxyRead 2023-11-29T08:57:36.915 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:6278: Skipped 2023-11-29T08:57:36.915 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:36.915 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:6288: Skipped 2023-11-29T08:57:36.915 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:36.915 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.ProxyRead (0 ms) 2023-11-29T08:57:36.915 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.CachePin 2023-11-29T08:57:36.915 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:6278: Skipped 2023-11-29T08:57:36.915 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:36.915 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:6288: Skipped 2023-11-29T08:57:36.915 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:36.916 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.CachePin (0 ms) 2023-11-29T08:57:36.916 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.SetRedirectRead 2023-11-29T08:57:36.916 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:6278: Skipped 2023-11-29T08:57:36.916 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:36.916 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:6288: Skipped 2023-11-29T08:57:36.916 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:36.916 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.SetRedirectRead (0 ms) 2023-11-29T08:57:36.916 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.SetChunkRead 2023-11-29T08:57:36.916 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:6278: Skipped 2023-11-29T08:57:36.917 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:36.917 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:6288: Skipped 2023-11-29T08:57:36.917 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:36.917 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.SetChunkRead (0 ms) 2023-11-29T08:57:36.917 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.ManifestPromoteRead 2023-11-29T08:57:36.917 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:6278: Skipped 2023-11-29T08:57:36.917 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:36.918 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:6288: Skipped 2023-11-29T08:57:36.918 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:36.918 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.ManifestPromoteRead (0 ms) 2023-11-29T08:57:36.918 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TrySetDedupTier 2023-11-29T08:57:36.918 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:6278: Skipped 2023-11-29T08:57:36.918 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:36.918 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:6288: Skipped 2023-11-29T08:57:36.918 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:36.918 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.TrySetDedupTier (0 ms) 2023-11-29T08:57:36.918 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/tier_cxx.cc:6272: Skipped 2023-11-29T08:57:36.918 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:36.918 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [----------] 22 tests from LibRadosTwoPoolsECPP (1 ms total) 2023-11-29T08:57:36.918 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: 2023-11-29T08:57:36.918 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [----------] Global test environment tear-down 2023-11-29T08:57:36.919 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [==========] 77 tests from 4 test suites ran. (6364 ms total) 2023-11-29T08:57:36.919 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ PASSED ] 0 tests. 2023-11-29T08:57:36.919 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] 77 tests, listed below: 2023-11-29T08:57:36.919 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierPP.Dirty 2023-11-29T08:57:36.919 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierPP.FlushWriteRaces 2023-11-29T08:57:36.919 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierPP.HitSetNone 2023-11-29T08:57:36.919 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.Overlay 2023-11-29T08:57:36.919 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.Promote 2023-11-29T08:57:36.919 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnap 2023-11-29T08:57:36.919 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapScrub 2023-11-29T08:57:36.919 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapTrimRace 2023-11-29T08:57:36.919 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.Whiteout 2023-11-29T08:57:36.919 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate 2023-11-29T08:57:36.919 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.Evict 2023-11-29T08:57:36.919 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap 2023-11-29T08:57:36.919 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap2 2023-11-29T08:57:36.920 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ListSnap 2023-11-29T08:57:36.920 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace 2023-11-29T08:57:36.920 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.TryFlush 2023-11-29T08:57:36.920 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.Flush 2023-11-29T08:57:36.920 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.FlushSnap 2023-11-29T08:57:36.920 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.FlushTryFlushRaces 2023-11-29T08:57:36.920 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.TryFlushReadRace 2023-11-29T08:57:36.920 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.HitSetRead 2023-11-29T08:57:36.920 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.HitSetWrite 2023-11-29T08:57:36.920 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.HitSetTrim 2023-11-29T08:57:36.920 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.PromoteOn2ndRead 2023-11-29T08:57:36.920 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ProxyRead 2023-11-29T08:57:36.920 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.CachePin 2023-11-29T08:57:36.920 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.SetRedirectRead 2023-11-29T08:57:36.920 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestPromoteRead 2023-11-29T08:57:36.920 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestRefRead 2023-11-29T08:57:36.921 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestUnset 2023-11-29T08:57:36.921 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestDedupRefRead 2023-11-29T08:57:36.921 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount 2023-11-29T08:57:36.921 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 2023-11-29T08:57:36.921 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestTestSnapCreate 2023-11-29T08:57:36.921 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote 2023-11-29T08:57:36.921 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification 2023-11-29T08:57:36.921 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapIncCount 2023-11-29T08:57:36.921 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvict 2023-11-29T08:57:36.921 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictPromote 2023-11-29T08:57:36.921 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch 2023-11-29T08:57:36.921 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.DedupFlushRead 2023-11-29T08:57:36.921 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushSnap 2023-11-29T08:57:36.921 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushDupCount 2023-11-29T08:57:36.921 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringFlush 2023-11-29T08:57:36.922 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapHasChunk 2023-11-29T08:57:36.922 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollback 2023-11-29T08:57:36.922 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollbackRefcount 2023-11-29T08:57:36.922 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictRollback 2023-11-29T08:57:36.922 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.PropagateBaseTierError 2023-11-29T08:57:36.922 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.HelloWriteReturn 2023-11-29T08:57:36.922 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier 2023-11-29T08:57:36.922 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierECPP.Dirty 2023-11-29T08:57:36.922 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierECPP.FlushWriteRaces 2023-11-29T08:57:36.922 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierECPP.CallForcesPromote 2023-11-29T08:57:36.922 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierECPP.HitSetNone 2023-11-29T08:57:36.922 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.Overlay 2023-11-29T08:57:36.922 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.Promote 2023-11-29T08:57:36.922 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnap 2023-11-29T08:57:36.922 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace 2023-11-29T08:57:36.923 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.Whiteout 2023-11-29T08:57:36.923 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.Evict 2023-11-29T08:57:36.923 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.EvictSnap 2023-11-29T08:57:36.923 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.TryFlush 2023-11-29T08:57:36.923 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.FailedFlush 2023-11-29T08:57:36.923 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.Flush 2023-11-29T08:57:36.923 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.FlushSnap 2023-11-29T08:57:36.923 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.FlushTryFlushRaces 2023-11-29T08:57:36.923 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.TryFlushReadRace 2023-11-29T08:57:36.923 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.HitSetRead 2023-11-29T08:57:36.923 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.HitSetTrim 2023-11-29T08:57:36.923 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.PromoteOn2ndRead 2023-11-29T08:57:36.923 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.ProxyRead 2023-11-29T08:57:36.923 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.CachePin 2023-11-29T08:57:36.923 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.SetRedirectRead 2023-11-29T08:57:36.923 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.SetChunkRead 2023-11-29T08:57:36.924 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.ManifestPromoteRead 2023-11-29T08:57:36.924 INFO:tasks.workunit.client.0.smithi027.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.TrySetDedupTier 2023-11-29T08:57:36.924 INFO:tasks.workunit.client.0.smithi027.stderr:+ for t in "${!pids[@]}" 2023-11-29T08:57:36.924 INFO:tasks.workunit.client.0.smithi027.stderr:+ pid=84328 2023-11-29T08:57:36.924 INFO:tasks.workunit.client.0.smithi027.stderr:+ wait 84328 2023-11-29T08:57:42.734 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:34.140+0000 7fa359258640 1 -- 172.21.15.27:0/2308983894 --> v2:172.21.15.27:6800/601592489 -- osd_op(unknown.0.0:3 10.1 10:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e16) v8 -- 0x55dcc32d77a0 con 0x55dcc338ed00 2023-11-29T08:57:42.734 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:34.140+0000 7fa359258640 1 -- 172.21.15.27:0/2308983894 --> v2:172.21.15.27:6800/601592489 -- osd_op(unknown.0.0:4 10.1 10:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e16) v8 -- 0x55dcc32d8090 con 0x55dcc338ed00 2023-11-29T08:57:42.734 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:42.624+0000 7fa352b9b640 1 -- 172.21.15.27:0/2308983894 <== osd.0 v2:172.21.15.27:6800/601592489 2 ==== osd_op_reply(3 exist [read 0~5 out=5b] v17'1 uv1 ondisk = 0) v8 ==== 149+0+5 (crc 0 0 0) 0x7fa34400c430 con 0x55dcc338ed00 2023-11-29T08:57:42.734 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:42.629+0000 7fa352b9b640 1 -- 172.21.15.27:0/2308983894 <== osd.0 v2:172.21.15.27:6800/601592489 3 ==== osd_op_reply(4 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fa34400c430 con 0x55dcc338ed00 2023-11-29T08:57:42.735 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: [ OK ] AsioRados.AsyncReadCallback (8489 ms) 2023-11-29T08:57:42.735 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: [ RUN ] AsioRados.AsyncReadFuture 2023-11-29T08:57:42.735 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:42.629+0000 7fa359258640 1 -- 172.21.15.27:0/2308983894 --> v2:172.21.15.27:6800/601592489 -- osd_op(unknown.0.0:5 10.1 10:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e16) v8 -- 0x55dcc32d8470 con 0x55dcc338ed00 2023-11-29T08:57:42.735 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:42.629+0000 7fa359258640 1 -- 172.21.15.27:0/2308983894 --> v2:172.21.15.27:6800/601592489 -- osd_op(unknown.0.0:6 10.1 10:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e16) v8 -- 0x55dcc3391660 con 0x55dcc338ed00 2023-11-29T08:57:42.735 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:42.682+0000 7fa352b9b640 1 -- 172.21.15.27:0/2308983894 <== osd.0 v2:172.21.15.27:6800/601592489 4 ==== osd_op_reply(5 exist [read 0~5 out=5b] v17'1 uv1 ondisk = 0) v8 ==== 149+0+5 (crc 0 0 0) 0x7fa34400c430 con 0x55dcc338ed00 2023-11-29T08:57:42.735 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:42.712+0000 7fa352b9b640 1 -- 172.21.15.27:0/2308983894 <== osd.0 v2:172.21.15.27:6800/601592489 5 ==== osd_op_reply(6 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fa34400c430 con 0x55dcc338ed00 2023-11-29T08:57:42.735 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: [ OK ] AsioRados.AsyncReadFuture (83 ms) 2023-11-29T08:57:42.735 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: [ RUN ] AsioRados.AsyncReadYield 2023-11-29T08:57:42.735 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:42.712+0000 7fa359258640 1 -- 172.21.15.27:0/2308983894 --> v2:172.21.15.27:6800/601592489 -- osd_op(unknown.0.0:7 10.1 10:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e16) v8 -- 0x55dcc33b19d0 con 0x55dcc338ed00 2023-11-29T08:57:42.735 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:42.712+0000 7fa359258640 1 -- 172.21.15.27:0/2308983894 --> v2:172.21.15.27:6800/601592489 -- osd_op(unknown.0.0:8 10.1 10:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e16) v8 -- 0x55dcc33d21e0 con 0x55dcc338ed00 2023-11-29T08:57:42.735 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:42.733+0000 7fa352b9b640 1 -- 172.21.15.27:0/2308983894 <== osd.0 v2:172.21.15.27:6800/601592489 6 ==== osd_op_reply(8 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fa34400c430 con 0x55dcc338ed00 2023-11-29T08:57:42.735 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:42.733+0000 7fa352b9b640 1 -- 172.21.15.27:0/2308983894 <== osd.0 v2:172.21.15.27:6800/601592489 7 ==== osd_op_reply(7 exist [read 0~5 out=5b] v17'1 uv1 ondisk = 0) v8 ==== 149+0+5 (crc 0 0 0) 0x7fa34400c430 con 0x55dcc338ed00 2023-11-29T08:57:42.735 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: [ OK ] AsioRados.AsyncReadYield (21 ms) 2023-11-29T08:57:42.735 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteCallback 2023-11-29T08:57:48.830 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:42.733+0000 7fa359258640 1 -- 172.21.15.27:0/2308983894 api_stat: Running main() from gmock_main.cc 2023-11-29T08:57:48.830 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat: [==========] Running 9 tests from 2 test suites. 2023-11-29T08:57:48.831 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat: [----------] Global test environment set-up. 2023-11-29T08:57:48.831 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat: [----------] 5 tests from LibRadosStat 2023-11-29T08:57:48.831 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat: [ RUN ] LibRadosStat.Stat 2023-11-29T08:57:48.831 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat: [ OK ] LibRadosStat.Stat (5581 ms) 2023-11-29T08:57:48.831 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat: [ RUN ] LibRadosStat.Stat2 2023-11-29T08:57:48.831 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat: [ OK ] LibRadosStat.Stat2 (1273 ms) 2023-11-29T08:57:48.831 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat: [ RUN ] LibRadosStat.StatNS 2023-11-29T08:57:48.831 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat: [ OK ] LibRadosStat.StatNS (6994 ms) 2023-11-29T08:57:48.831 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat: [ RUN ] LibRadosStat.ClusterStat 2023-11-29T08:57:48.831 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat: [ OK ] LibRadosStat.ClusterStat (0 ms) 2023-11-29T08:57:48.831 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat: [ RUN ] LibRadosStat.PoolStat 2023-11-29T08:57:48.831 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat: [ OK ] LibRadosStat.PoolStat (2916 ms) 2023-11-29T08:57:48.831 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat: [----------] 5 tests from LibRadosStat (16764 ms total) 2023-11-29T08:57:48.831 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat: 2023-11-29T08:57:48.831 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat: [----------] 4 tests from LibRadosStatEC 2023-11-29T08:57:48.832 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:168: Skipped 2023-11-29T08:57:48.832 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat: Not supported by crimson yet. Skipped 2023-11-29T08:57:48.832 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat: [ RUN ] LibRadosStatEC.Stat 2023-11-29T08:57:48.832 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:182: Skipped 2023-11-29T08:57:48.832 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat: Not supported by crimson yet. Skipped 2023-11-29T08:57:48.832 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:196: Skipped 2023-11-29T08:57:48.832 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat: Not supported by crimson yet. Skipped 2023-11-29T08:57:48.832 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat: [ SKIPPED ] LibRadosStatEC.Stat (0 ms) 2023-11-29T08:57:48.832 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat: [ RUN ] LibRadosStatEC.StatNS 2023-11-29T08:57:48.832 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:182: Skipped 2023-11-29T08:57:48.832 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat: Not supported by crimson yet. Skipped 2023-11-29T08:57:48.832 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:196: Skipped 2023-11-29T08:57:48.832 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat: Not supported by crimson yet. Skipped 2023-11-29T08:57:48.832 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat: [ SKIPPED ] LibRadosStatEC.StatNS (0 ms) 2023-11-29T08:57:48.832 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat: [ RUN ] LibRadosStatEC.ClusterStat 2023-11-29T08:57:48.832 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:182: Skipped 2023-11-29T08:57:48.833 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat: Not supported by crimson yet. Skipped 2023-11-29T08:57:48.833 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:196: Skipped 2023-11-29T08:57:48.833 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat: Not supported by crimson yet. Skipped 2023-11-29T08:57:48.833 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat: [ SKIPPED ] LibRadosStatEC.ClusterStat (0 ms) 2023-11-29T08:57:48.833 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat: [ RUN ] LibRadosStatEC.PoolStat 2023-11-29T08:57:48.833 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:182: Skipped 2023-11-29T08:57:48.833 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat: Not supported by crimson yet. Skipped 2023-11-29T08:57:48.833 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:196: Skipped 2023-11-29T08:57:48.833 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat: Not supported by crimson yet. Skipped 2023-11-29T08:57:48.833 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat: [ SKIPPED ] LibRadosStatEC.PoolStat (0 ms) 2023-11-29T08:57:48.834 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:176: Skipped 2023-11-29T08:57:48.834 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat: Not supported by crimson yet. Skipped 2023-11-29T08:57:48.834 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat: [----------] 4 tests from LibRadosStatEC (0 ms total) 2023-11-29T08:57:48.834 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat: 2023-11-29T08:57:48.834 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat: [----------] Global test environment tear-down 2023-11-29T08:57:48.834 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat: [==========] 9 tests from 2 test suites ran. (18283 ms total) 2023-11-29T08:57:48.834 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat: [ PASSED ] 5 tests. 2023-11-29T08:57:48.834 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat: [ SKIPPED ] 4 tests, listed below: 2023-11-29T08:57:48.834 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat: [ SKIPPED ] LibRadosStatEC.Stat 2023-11-29T08:57:48.834 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat: [ SKIPPED ] LibRadosStatEC.StatNS 2023-11-29T08:57:48.834 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat: [ SKIPPED ] LibRadosStatEC.ClusterStat 2023-11-29T08:57:48.834 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat: [ SKIPPED ] LibRadosStatEC.PoolStat 2023-11-29T08:57:50.560 INFO:tasks.workunit.client.0.smithi027.stdout:--> v2:172.21.15.27:6800/601592489 -- osd_op(unknown.0.0:9 10.1 10:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16) v8 -- 0x55dcc32ea660 con 0x55dcc338ed00 2023-11-29T08:57:50.561 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:44.841+0000 7fa352b9b640 1 -- 172.21.15.27:0/2308983894 <== osd.0 v2:172.21.15.27:6800/601592489 8 ==== osd_op_reply(9 exist [write 0~5] v27'2 uv2 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fa34400c430 con 0x55dcc338ed00 2023-11-29T08:57:50.561 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: [ OK ] AsioRados.AsyncWriteCallback (2108 ms) 2023-11-29T08:57:50.561 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteFuture 2023-11-29T08:57:50.561 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:44.842+0000 7fa359258640 1 -- 172.21.15.27:0/2308983894 --> v2:172.21.15.27:6800/601592489 -- osd_op(unknown.0.0:10 10.1 10:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16) v8 -- 0x55dcc32ea660 con 0x55dcc338ed00 2023-11-29T08:57:50.561 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:47.718+0000 7fa352b9b640 1 -- 172.21.15.27:0/2308983894 <== osd.0 v2:172.21.15.27:6800/601592489 9 ==== osd_op_reply(10 exist [write 0~5] v29'3 uv3 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fa34400c430 con 0x55dcc338ed00 2023-11-29T08:57:50.561 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: [ OK ] AsioRados.AsyncWriteFuture (2877 ms) 2023-11-29T08:57:50.561 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteYield 2023-11-29T08:57:50.561 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:47.718+0000 7fa359258640 1 -- 172.21.15.27:0/2308983894 --> v2:172.21.15.27:6800/601592489 -- osd_op(unknown.0.0:11 10.1 10:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16) v8 -- 0x55dcc32d7bd0 con 0x55dcc338ed00 2023-11-29T08:57:50.561 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:50.458+0000 7fa352b9b640 1 -- 172.21.15.27:0/2308983894 <== osd.0 v2:172.21.15.27:6800/601592489 10 ==== osd_op_reply(11 exist [write 0~5] v32'4 uv4 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fa34400c430 con 0x55dcc338ed00 2023-11-29T08:57:50.561 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: [ OK ] AsioRados.AsyncWriteYield (2740 ms) 2023-11-29T08:57:50.561 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationCallback 2023-11-29T08:57:50.561 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:50.458+0000 7fa359258640 1 -- 172.21.15.27:0/2308983894 --> v2:172.21.15.27:6800/601592489 -- osd_op(unknown.0.0:12 10.1 10:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e16) v8 -- 0x55dcc32d7bd0 con 0x55dcc338ed00 2023-11-29T08:57:50.561 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:50.458+0000 7fa359258640 1 -- 172.21.15.27:0/2308983894 --> v2:172.21.15.27:6800/601592489 -- osd_op(unknown.0.0:13 10.1 10:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e16) v8 -- 0x55dcc3391e60 con 0x55dcc338ed00 2023-11-29T08:57:50.561 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:50.512+0000 7fa352b9b640 1 -- 172.21.15.27:0/2308983894 <== osd.0 v2:172.21.15.27:6800/601592489 11 ==== osd_op_reply(13 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fa34400c430 con 0x55dcc338ed00 2023-11-29T08:57:50.561 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:50.512+0000 7fa352b9b640 1 -- 172.21.15.27:0/2308983894 <== osd.0 v2:172.21.15.27:6800/601592489 12 ==== osd_op_reply(12 exist [read 0~5 out=5b] v32'4 uv4 ondisk = 0) v8 ==== 149+0+5 (crc 0 0 0) 0x7fa34400c430 con 0x55dcc338ed00 2023-11-29T08:57:50.561 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationCallback (55 ms) 2023-11-29T08:57:50.562 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationFuture 2023-11-29T08:57:50.562 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:50.512+0000 7fa359258640 1 -- 172.21.15.27:0/2308983894 --> v2:172.21.15.27:6800/601592489 -- osd_op(unknown.0.0:14 10.1 10:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e16) v8 -- 0x55dcc33919c0 con 0x55dcc338ed00 2023-11-29T08:57:50.562 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:50.512+0000 7fa359258640 1 -- 172.21.15.27:0/2308983894 --> v2:172.21.15.27:6800/601592489 -- osd_op(unknown.0.0:15 10.1 10:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e16) v8 -- 0x55dcc3392390 con 0x55dcc338ed00 2023-11-29T08:57:51.855 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-2 api_cmd_pp: Running main() from gmock_main.cc 2023-11-29T08:57:51.855 INFO:tasks.workunit.client.0.smithi027.stdout: api_cmd_pp: [==========] Running 3 tests from 1 test suite. 2023-11-29T08:57:51.855 INFO:tasks.workunit.client.0.smithi027.stdout: api_cmd_pp: [----------] Global test environment set-up. 2023-11-29T08:57:51.855 INFO:tasks.workunit.client.0.smithi027.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd 2023-11-29T08:57:51.855 INFO:tasks.workunit.client.0.smithi027.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.MonDescribePP 2023-11-29T08:57:51.855 INFO:tasks.workunit.client.0.smithi027.stdout: api_cmd_pp: [ OK ] LibRadosCmd.MonDescribePP (442 ms) 2023-11-29T08:57:51.856 INFO:tasks.workunit.client.0.smithi027.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.OSDCmdPP 2023-11-29T08:57:51.856 INFO:tasks.workunit.client.0.smithi027.stdout: api_cmd_pp: [ OK ] LibRadosCmd.OSDCmdPP (256 ms) 2023-11-29T08:57:51.856 INFO:tasks.workunit.client.0.smithi027.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.PGCmdPP 2023-11-29T08:57:51.856 INFO:tasks.workunit.client.0.smithi027.stdout: api_cmd_pp: [ OK ] LibRadosCmd.PGCmdPP (20510 ms) 2023-11-29T08:57:51.856 INFO:tasks.workunit.client.0.smithi027.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd (21208 ms total) 2023-11-29T08:57:51.856 INFO:tasks.workunit.client.0.smithi027.stdout: api_cmd_pp: 2023-11-29T08:57:51.856 INFO:tasks.workunit.client.0.smithi027.stdout: api_cmd_pp: [----------] Global test environment tear-down 2023-11-29T08:57:51.856 INFO:tasks.workunit.client.0.smithi027.stdout: api_cmd_pp: [==========] 3 tests from 1 test suite ran. (21208 ms total) 2023-11-29T08:57:51.856 INFO:tasks.workunit.client.0.smithi027.stdout: api_cmd_pp: [ PASSED ] 3 tests. 2023-11-29T08:57:53.858 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat_pp: Running main() from gmock_main.cc 2023-11-29T08:57:53.858 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat_pp: [==========] Running 9 tests from 2 test suites. 2023-11-29T08:57:53.858 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat_pp: [----------] Global test environment set-up. 2023-11-29T08:57:53.858 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP 2023-11-29T08:57:53.858 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat_pp: seed 84806 2023-11-29T08:57:53.859 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPP 2023-11-29T08:57:53.859 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPP (10871 ms) 2023-11-29T08:57:53.859 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.Stat2Mtime2PP 2023-11-29T08:57:53.859 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat_pp: [ OK ] LibRadosStatPP.Stat2Mtime2PP (159 ms) 2023-11-29T08:57:53.859 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.ClusterStatPP 2023-11-29T08:57:53.859 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat_pp: [ OK ] LibRadosStatPP.ClusterStatPP (0 ms) 2023-11-29T08:57:53.859 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.PoolStatPP 2023-11-29T08:57:53.859 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat_pp: [ OK ] LibRadosStatPP.PoolStatPP (3048 ms) 2023-11-29T08:57:53.859 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPPNS 2023-11-29T08:57:53.859 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPPNS (6852 ms) 2023-11-29T08:57:53.859 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP (20930 ms total) 2023-11-29T08:57:53.859 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat_pp: 2023-11-29T08:57:53.859 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP 2023-11-29T08:57:53.859 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:373: Skipped 2023-11-29T08:57:53.860 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:53.860 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPP 2023-11-29T08:57:53.860 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:387: Skipped 2023-11-29T08:57:53.860 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:53.860 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:400: Skipped 2023-11-29T08:57:53.860 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:53.860 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat_pp: [ SKIPPED ] LibRadosStatECPP.StatPP (0 ms) 2023-11-29T08:57:53.860 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.ClusterStatPP 2023-11-29T08:57:53.860 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:387: Skipped 2023-11-29T08:57:53.860 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:53.860 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:400: Skipped 2023-11-29T08:57:53.860 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:53.860 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat_pp: [ SKIPPED ] LibRadosStatECPP.ClusterStatPP (0 ms) 2023-11-29T08:57:53.860 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.PoolStatPP 2023-11-29T08:57:53.861 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:387: Skipped 2023-11-29T08:57:53.861 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:53.861 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:400: Skipped 2023-11-29T08:57:53.861 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:53.861 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat_pp: [ SKIPPED ] LibRadosStatECPP.PoolStatPP (0 ms) 2023-11-29T08:57:53.861 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPPNS 2023-11-29T08:57:53.861 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:387: Skipped 2023-11-29T08:57:53.861 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:53.861 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:400: Skipped 2023-11-29T08:57:53.861 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:53.862 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat_pp: [ SKIPPED ] LibRadosStatECPP.StatPPNS (0 ms) 2023-11-29T08:57:53.862 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:381: Skipped 2023-11-29T08:57:53.862 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat_pp: Not supported by crimson yet. Skipped 2023-11-29T08:57:53.862 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP (0 ms total) 2023-11-29T08:57:53.862 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat_pp: 2023-11-29T08:57:53.862 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat_pp: [----------] Global test environment tear-down 2023-11-29T08:57:53.862 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat_pp: [==========] 9 tests from 2 test suites ran. (23272 ms total) 2023-11-29T08:57:53.862 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat_pp: [ PASSED ] 5 tests. 2023-11-29T08:57:53.862 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat_pp: [ SKIPPED ] 4 tests, listed below: 2023-11-29T08:57:53.862 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat_pp: [ SKIPPED ] LibRadosStatECPP.StatPP 2023-11-29T08:57:53.862 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat_pp: [ SKIPPED ] LibRadosStatECPP.ClusterStatPP 2023-11-29T08:57:53.862 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat_pp: [ SKIPPED ] LibRadosStatECPP.PoolStatPP 2023-11-29T08:57:53.862 INFO:tasks.workunit.client.0.smithi027.stdout: api_stat_pp: [ SKIPPED ] LibRadosStatECPP.StatPPNS 2023-11-29T08:57:54.780 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: 2023-11-29T08:57:30.502+0000 7f5dd32ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:57:54.780 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: 2023-11-29T08:57:30.503+0000 7f5dd32ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:57:54.780 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: 2023-11-29T08:57:30.503+0000 7f5dd32ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:57:54.780 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: [==========] Running 12 tests from 4 test suites. 2023-11-29T08:57:54.780 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: [----------] Global test environment set-up. 2023-11-29T08:57:54.780 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion 2023-11-29T08:57:54.780 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: [ RUN ] LibRadosMiscVersion.Version 2023-11-29T08:57:54.780 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: [ OK ] LibRadosMiscVersion.Version (0 ms) 2023-11-29T08:57:54.780 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2023-11-29T08:57:54.781 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: 2023-11-29T08:57:54.781 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: [----------] 2 tests from LibRadosMiscConnectFailure 2023-11-29T08:57:54.781 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectFailure 2023-11-29T08:57:54.781 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: unable to get monitor info from DNS SRV with service name: ceph-mon 2023-11-29T08:57:54.781 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: 2023-11-29T08:57:30.714+0000 7f5dd32ed640 -1 failed for service _ceph-mon._tcp 2023-11-29T08:57:54.781 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: 2023-11-29T08:57:30.715+0000 7f5dd32ed640 -1 monclient: get_monmap_and_config cannot identify monitors to contact 2023-11-29T08:57:54.781 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectFailure (212 ms) 2023-11-29T08:57:54.781 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectTimeout 2023-11-29T08:57:54.781 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectTimeout (2012 ms) 2023-11-29T08:57:54.781 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: [----------] 2 tests from LibRadosMiscConnectFailure (2224 ms total) 2023-11-29T08:57:54.781 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: 2023-11-29T08:57:54.781 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: [----------] 1 test from LibRadosMiscPool 2023-11-29T08:57:54.781 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: [ RUN ] LibRadosMiscPool.PoolCreationRace 2023-11-29T08:57:54.781 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: started 0x7f5d9c005d20 2023-11-29T08:57:54.781 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: started 0x7f5db4005de0 2023-11-29T08:57:54.782 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: started 0x5579c3b966a0 2023-11-29T08:57:54.782 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: started 0x5579c3b6af70 2023-11-29T08:57:54.782 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: started 0x5579c3b68150 2023-11-29T08:57:54.782 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: started 0x5579c3eb0e40 2023-11-29T08:57:54.782 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: started 0x5579c3eb18f0 2023-11-29T08:57:54.782 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: started 0x5579c3eb23a0 2023-11-29T08:57:54.782 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: started 0x5579c3e13f60 2023-11-29T08:57:54.782 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: started 0x5579c3eb3270 2023-11-29T08:57:54.782 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: started 0x5579c3eb20f0 2023-11-29T08:57:54.782 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: started 0x5579c3eb41d0 2023-11-29T08:57:54.782 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: started 0x5579c3eb3020 2023-11-29T08:57:54.782 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: started 0x5579c3eb5110 2023-11-29T08:57:54.782 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: started 0x5579c3eb3f30 2023-11-29T08:57:54.782 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: started 15 aios 2023-11-29T08:57:54.782 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: waiting 0x7f5d9c005d20 2023-11-29T08:57:54.783 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: waiting 0x7f5db4005de0 2023-11-29T08:57:54.783 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: waiting 0x5579c3b966a0 2023-11-29T08:57:54.783 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: waiting 0x5579c3b6af70 2023-11-29T08:57:54.783 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: waiting 0x5579c3b68150 2023-11-29T08:57:54.783 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: waiting 0x5579c3eb0e40 2023-11-29T08:57:54.783 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: waiting 0x5579c3eb18f0 2023-11-29T08:57:54.783 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: waiting 0x5579c3eb23a0 2023-11-29T08:57:54.783 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: waiting 0x5579c3e13f60 2023-11-29T08:57:54.783 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: waiting 0x5579c3eb3270 2023-11-29T08:57:54.783 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: waiting 0x5579c3eb20f0 2023-11-29T08:57:54.783 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: waiting 0x5579c3eb41d0 2023-11-29T08:57:54.783 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: waiting 0x5579c3eb3020 2023-11-29T08:57:54.783 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: waiting 0x5579c3eb5110 2023-11-29T08:57:54.783 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: waiting 0x5579c3eb3f30 2023-11-29T08:57:54.783 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: done. 2023-11-29T08:57:54.783 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: [ OK ] LibRadosMiscPool.PoolCreationRace (19125 ms) 2023-11-29T08:57:54.784 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: [----------] 1 test from LibRadosMiscPool (19125 ms total) 2023-11-29T08:57:54.784 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: 2023-11-29T08:57:54.784 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: [----------] 8 tests from LibRadosMisc 2023-11-29T08:57:54.784 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: [ RUN ] LibRadosMisc.ClusterFSID 2023-11-29T08:57:54.784 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: [ OK ] LibRadosMisc.ClusterFSID (0 ms) 2023-11-29T08:57:54.784 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: [ RUN ] LibRadosMisc.Exec 2023-11-29T08:57:54.784 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: [ OK ] LibRadosMisc.Exec (924 ms) 2023-11-29T08:57:58.339 INFO:tasks.workunit.client.0.smithi027.stdout: api_mi api_service: [==========] Running 4 tests from 1 test suite. 2023-11-29T08:57:58.339 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: 2023-11-29T08:57:30.669+0000 7f9e32e3c7c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:57:58.339 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: 2023-11-29T08:57:30.669+0000 7f9e32e3c7c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:57:58.339 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: 2023-11-29T08:57:30.670+0000 7f9e32e3c7c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:57:58.339 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: [----------] Global test environment set-up. 2023-11-29T08:57:58.339 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: [----------] 4 tests from LibRadosService 2023-11-29T08:57:58.339 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: [ RUN ] LibRadosService.RegisterEarly 2023-11-29T08:57:58.339 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: [ OK ] LibRadosService.RegisterEarly (5332 ms) 2023-11-29T08:57:58.340 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: [ RUN ] LibRadosService.RegisterLate 2023-11-29T08:57:58.340 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: [ OK ] LibRadosService.RegisterLate (45 ms) 2023-11-29T08:57:58.340 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: [ RUN ] LibRadosService.StatusFormat 2023-11-29T08:57:58.340 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: cluster: 2023-11-29T08:57:58.340 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: id: ae0bf9e4-fe2e-415c-890c-a9a3fac76480 2023-11-29T08:57:58.340 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: health: HEALTH_WARN 2023-11-29T08:57:58.340 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: 8 pool(s) do not have an application enabled 2023-11-29T08:57:58.340 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: 2023-11-29T08:57:58.340 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: services: 2023-11-29T08:57:58.340 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: mon: 1 daemons, quorum a (age 63s) 2023-11-29T08:57:58.340 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: mgr: x(active, since 59s) 2023-11-29T08:57:58.340 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: osd: 4 osds: 4 up (since 57s), 4 in (since 61s) 2023-11-29T08:57:58.340 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: laundry: 2 daemons active (1 hosts) 2023-11-29T08:57:58.340 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: 2023-11-29T08:57:58.340 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: data: 2023-11-29T08:57:58.341 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: pools: 28 pools, 841 pgs 2023-11-29T08:57:58.341 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: objects: 10 objects, 577 KiB 2023-11-29T08:57:58.341 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: usage: 107 MiB used, 400 GiB / 400 GiB avail 2023-11-29T08:57:58.341 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: pgs: 59.929% pgs unknown 2023-11-29T08:57:58.341 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: 17.241% pgs not active 2023-11-29T08:57:58.341 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: 504 unknown 2023-11-29T08:57:58.341 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: 192 active+clean 2023-11-29T08:57:58.341 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: 114 creating+peering 2023-11-29T08:57:58.341 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: 31 creating+activating 2023-11-29T08:57:58.341 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: 2023-11-29T08:57:58.341 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: io: 2023-11-29T08:57:58.341 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: client: 1.5 KiB/s wr, 0 op/s rd, 1 op/s wr 2023-11-29T08:57:58.341 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: 2023-11-29T08:57:58.341 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: 2023-11-29T08:57:58.341 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: cluster: 2023-11-29T08:57:58.341 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: id: ae0bf9e4-fe2e-415c-890c-a9a3fac76480 2023-11-29T08:57:58.341 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: health: HEALTH_WARN 2023-11-29T08:57:58.341 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: 6 pool(s) do not have an application enabled 2023-11-29T08:57:58.342 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: 2023-11-29T08:57:58.342 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: services: 2023-11-29T08:57:58.342 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: mon: 1 daemons, quorum a (age 65s) 2023-11-29T08:57:58.342 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: mgr: x(active, since 61s) 2023-11-29T08:57:58.342 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: osd: 4 osds: 4 up (since 59s), 4 in (since 63s) 2023-11-29T08:57:58.342 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: foo: 16 portals active (1 hosts, 3 zones) 2023-11-29T08:57:58.342 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: laundry: 1 daemon active (1 hosts) 2023-11-29T08:57:58.342 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: 2023-11-29T08:57:58.342 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: data: 2023-11-29T08:57:58.342 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: pools: 27 pools, 809 pgs 2023-11-29T08:57:58.342 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: objects: 10 objects, 577 KiB 2023-11-29T08:57:58.342 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: usage: 107 MiB used, 400 GiB / 400 GiB avail 2023-11-29T08:57:58.342 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: pgs: 58.344% pgs unknown 2023-11-29T08:57:58.342 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: 17.923% pgs not active 2023-11-29T08:57:58.342 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: 472 unknown 2023-11-29T08:57:58.342 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: 192 active+clean 2023-11-29T08:57:58.343 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: 114 creating+peering 2023-11-29T08:57:58.343 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: 31 creating+activating 2023-11-29T08:57:58.343 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: 2023-11-29T08:57:58.343 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: io: 2023-11-29T08:57:58.343 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: client: 1.5 KiB/s wr, 0 op/s rd, 1 op/s wr 2023-11-29T08:57:58.343 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: 2023-11-29T08:57:58.343 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: 2023-11-29T08:57:58.343 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: [ OK ] LibRadosService.StatusFormat (2250 ms) 2023-11-29T08:57:58.343 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: [ RUN ] LibRadosService.Status 2023-11-29T08:57:58.344 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: [ OK ] LibRadosService.Status (20041 ms) 2023-11-29T08:57:58.344 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: [----------] 4 tests from LibRadosService (27668 ms total) 2023-11-29T08:57:58.344 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: 2023-11-29T08:57:58.344 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: [----------] Global test environment tear-down 2023-11-29T08:57:58.344 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: [==========] 4 tests from 1 test suite ran. (27669 ms total) 2023-11-29T08:57:58.344 INFO:tasks.workunit.client.0.smithi027.stdout: api_service: [ PASSED ] 4 tests. 2023-11-29T08:57:58.772 INFO:tasks.workunit.client.0.smithi027.stdout:9T08:57:50.559+0000 7fa352b9b640 1 -- 172.21.15.27:0/2308983894 <== osd.0 v2:172.21.15.27:6800/601592489 13 ==== osd_op_reply(14 exist [read 0~5 out=5b] v32'4 uv4 ondisk = 0) v8 ==== 149+0+5 (crc 0 0 0) 0x7fa34400c430 con 0x55dcc338ed00 2023-11-29T08:57:58.772 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:50.562+0000 7fa352b9b640 1 -- 172.21.15.27:0/2308983894 <== osd.0 v2:172.21.15.27:6800/601592489 14 ==== osd_op_reply(15 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fa34400c430 con 0x55dcc338ed00 2023-11-29T08:57:58.772 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationFuture (50 ms) 2023-11-29T08:57:58.772 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationYield 2023-11-29T08:57:58.772 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:50.562+0000 7fa359258640 1 -- 172.21.15.27:0/2308983894 --> v2:172.21.15.27:6800/601592489 -- osd_op(unknown.0.0:16 10.1 10:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e16) v8 -- 0x55dcc33919c0 con 0x55dcc338ed00 2023-11-29T08:57:58.772 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:50.562+0000 7fa359258640 1 -- 172.21.15.27:0/2308983894 --> v2:172.21.15.27:6800/601592489 -- osd_op(unknown.0.0:17 10.1 10:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e16) v8 -- 0x55dcc33925a0 con 0x55dcc338ed00 2023-11-29T08:57:58.772 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:50.613+0000 7fa352b9b640 1 -- 172.21.15.27:0/2308983894 <== osd.0 v2:172.21.15.27:6800/601592489 15 ==== osd_op_reply(17 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fa34400c430 con 0x55dcc338ed00 2023-11-29T08:57:58.772 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:50.613+0000 7fa352b9b640 1 -- 172.21.15.27:0/2308983894 <== osd.0 v2:172.21.15.27:6800/601592489 16 ==== osd_op_reply(16 exist [read 0~5 out=5b] v32'4 uv4 ondisk = 0) v8 ==== 149+0+5 (crc 0 0 0) 0x7fa34400c430 con 0x55dcc338ed00 2023-11-29T08:57:58.773 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationYield (51 ms) 2023-11-29T08:57:58.773 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationCallback 2023-11-29T08:57:58.773 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:50.613+0000 7fa359258640 1 -- 172.21.15.27:0/2308983894 --> v2:172.21.15.27:6800/601592489 -- osd_op(unknown.0.0:18 10.1 10:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16) v8 -- 0x55dcc33919c0 con 0x55dcc338ed00 2023-11-29T08:57:58.773 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:53.743+0000 7fa352b9b640 1 -- 172.21.15.27:0/2308983894 <== osd.0 v2:172.21.15.27:6800/601592489 17 ==== osd_op_reply(18 exist [writefull 0~5] v35'5 uv5 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fa34400c430 con 0x55dcc338ed00 2023-11-29T08:57:58.773 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationCallback (3130 ms) 2023-11-29T08:57:58.773 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationFuture 2023-11-29T08:57:58.773 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:53.744+0000 7fa359258640 1 -- 172.21.15.27:0/2308983894 --> v2:172.21.15.27:6800/601592489 -- osd_op(unknown.0.0:19 10.1 10:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16) v8 -- 0x55dcc33919c0 con 0x55dcc338ed00 2023-11-29T08:57:58.773 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:56.718+0000 7fa352b9b640 1 -- 172.21.15.27:0/2308983894 <== osd.0 v2:172.21.15.27:6800/601592489 18 ==== osd_op_reply(19 exist [writefull 0~5] v38'6 uv6 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fa34400c430 con 0x55dcc338ed00 2023-11-29T08:57:58.773 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationFuture (2975 ms) 2023-11-29T08:57:58.773 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationYield 2023-11-29T08:57:58.773 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:56.718+0000 7fa359258640 1 -- 172.21.15.27:0/2308983894 --> v2:172.21.15.27:6800/601592489 -- osd_op(unknown.0.0:20 10.1 10:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16) v8 -- 0x55dcc33919c0 con 0x55dcc338ed00 2023-11-29T08:57:58.775 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:58.770+0000 7fa352b9b640 1 -- 172.21.15.27:0/2308983894 <== osd.0 v2:172.21.15.27:6800/601592489 19 ==== osd_op_reply(20 exist [writefull 0~5] v41'7 uv7 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fa344020040 con 0x55dcc338ed00 2023-11-29T08:57:58.775 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationYield (2052 ms) 2023-11-29T08:57:58.776 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:58.770+0000 7fa359258640 1 -- 172.21.15.27:0/2308983894 >> v2:172.21.15.27:6800/601592489 conn(0x55dcc338ed00 msgr2=0x55dcc3391120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:57:58.776 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:58.770+0000 7fa359258640 1 --2- 172.21.15.27:0/2308983894 >> v2:172.21.15.27:6800/601592489 conn(0x55dcc338ed00 0x55dcc3391120 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:57:58.776 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:58.770+0000 7fa359258640 1 -- 172.21.15.27:0/2308983894 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7fa3340361d0 msgr2=0x7fa3340386e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:57:58.776 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:58.770+0000 7fa359258640 1 --2- 172.21.15.27:0/2308983894 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7fa3340361d0 0x7fa3340386e0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:57:58.776 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:58.770+0000 7fa359258640 1 -- 172.21.15.27:0/2308983894 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dcc32e9d10 msgr2=0x55dcc32ea120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T08:57:58.776 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:58.770+0000 7fa359258640 1 --2- 172.21.15.27:0/2308983894 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dcc32e9d10 0x55dcc32ea120 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:57:58.776 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:58.770+0000 7fa359258640 1 -- 172.21.15.27:0/2308983894 shutdown_connections 2023-11-29T08:57:58.776 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:58.770+0000 7fa359258640 1 --2- 172.21.15.27:0/2308983894 >> v2:172.21.15.27:6800/601592489 conn(0x55dcc338ed00 0x55dcc3391120 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:57:58.776 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:58.770+0000 7fa359258640 1 --2- 172.21.15.27:0/2308983894 >> [v2:172.21.15.139:6800/2461689012,v1:172.21.15.139:6801/2461689012] conn(0x7fa3340361d0 0x7fa3340386e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:57:58.776 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:58.770+0000 7fa359258640 1 --2- 172.21.15.27:0/2308983894 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55dcc32e9d10 0x55dcc32ea120 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T08:57:58.776 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:58.770+0000 7fa359258640 1 -- 172.21.15.27:0/2308983894 >> 172.21.15.27:0/2308983894 conn(0x55dcc315fd80 msgr2=0x55dcc322d380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T08:57:58.776 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:58.771+0000 7fa359258640 1 -- 172.21.15.27:0/2308983894 shutdown_connections 2023-11-29T08:57:58.776 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:58.771+0000 7fa359258640 1 -- 172.21.15.27:0/2308983894 wait complete. 2023-11-29T08:57:58.776 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: [----------] 12 tests from AsioRados (24631 ms total) 2023-11-29T08:57:58.776 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: 2023-11-29T08:57:58.777 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: [----------] Global test environment tear-down 2023-11-29T08:57:58.777 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: [==========] 12 tests from 1 test suite ran. (28288 ms total) 2023-11-29T08:57:58.777 INFO:tasks.workunit.client.0.smithi027.stdout: api_asio: [ PASSED ] 12 tests. 2023-11-29T08:57:58.777 INFO:tasks.workunit.client.0.smithi027.stderr:+ for t in "${!pids[@]}" 2023-11-29T08:57:58.777 INFO:tasks.workunit.client.0.smithi027.stderr:+ pid=84498 2023-11-29T08:57:58.777 INFO:tasks.workunit.client.0.smithi027.stderr:+ wait 84498 2023-11-29T08:58:00.886 INFO:tasks.workunit.client.0.smithi027.stdout: api_pool: Running main() from gmock_main.cc 2023-11-29T08:58:00.886 INFO:tasks.workunit.client.0.smithi027.stdout: api_pool: [==========] Running 9 tests from 1 test suite. 2023-11-29T08:58:00.886 INFO:tasks.workunit.client.0.smithi027.stdout: api_pool: [----------] Global test environment set-up. 2023-11-29T08:58:00.886 INFO:tasks.workunit.client.0.smithi027.stdout: api_pool: [----------] 9 tests from LibRadosPools 2023-11-29T08:58:00.886 INFO:tasks.workunit.client.0.smithi027.stdout: api_pool: [ RUN ] LibRadosPools.PoolList 2023-11-29T08:58:00.886 INFO:tasks.workunit.client.0.smithi027.stdout: api_pool: [ OK ] LibRadosPools.PoolList (3382 ms) 2023-11-29T08:58:00.886 INFO:tasks.workunit.client.0.smithi027.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup 2023-11-29T08:58:00.886 INFO:tasks.workunit.client.0.smithi027.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup (3012 ms) 2023-11-29T08:58:00.886 INFO:tasks.workunit.client.0.smithi027.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup2 2023-11-29T08:58:00.887 INFO:tasks.workunit.client.0.smithi027.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup2 (3005 ms) 2023-11-29T08:58:00.887 INFO:tasks.workunit.client.0.smithi027.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookupOtherInstance 2023-11-29T08:58:00.887 INFO:tasks.workunit.client.0.smithi027.stdout: api_pool: [ OK ] LibRadosPools.PoolLookupOtherInstance (3013 ms) 2023-11-29T08:58:00.887 INFO:tasks.workunit.client.0.smithi027.stdout: api_pool: [ RUN ] LibRadosPools.PoolReverseLookupOtherInstance 2023-11-29T08:58:00.887 INFO:tasks.workunit.client.0.smithi027.stdout: api_pool: [ OK ] LibRadosPools.PoolReverseLookupOtherInstance (3011 ms) 2023-11-29T08:58:00.887 INFO:tasks.workunit.client.0.smithi027.stdout: api_pool: [ RUN ] LibRadosPools.PoolDelete 2023-11-29T08:58:00.887 INFO:tasks.workunit.client.0.smithi027.stdout: api_pool: [ OK ] LibRadosPools.PoolDelete (4909 ms) 2023-11-29T08:58:00.887 INFO:tasks.workunit.client.0.smithi027.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateDelete 2023-11-29T08:58:00.887 INFO:tasks.workunit.client.0.smithi027.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateDelete (5019 ms) 2023-11-29T08:58:00.887 INFO:tasks.workunit.client.0.smithi027.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateWithCrushRule 2023-11-29T08:58:00.887 INFO:tasks.workunit.client.0.smithi027.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateWithCrushRule (5023 ms) 2023-11-29T08:58:00.887 INFO:tasks.workunit.client.0.smithi027.stdout: api_pool: [ RUN ] LibRadosPools.PoolGetBaseTier 2023-11-29T08:58:00.887 INFO:tasks.workunit.client.0.smithi027.stdout: api_pool: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/pool.cc:139: Skipped 2023-11-29T08:58:00.887 INFO:tasks.workunit.client.0.smithi027.stdout: api_pool: Not supported by crimson yet. Skipped 2023-11-29T08:58:00.887 INFO:tasks.workunit.client.0.smithi027.stdout: api_pool: [ SKIPPED ] LibRadosPools.PoolGetBaseTier (0 ms) 2023-11-29T08:58:00.888 INFO:tasks.workunit.client.0.smithi027.stdout: api_pool: [----------] 9 tests from LibRadosPools (30374 ms total) 2023-11-29T08:58:00.888 INFO:tasks.workunit.client.0.smithi027.stdout: api_pool: 2023-11-29T08:58:00.888 INFO:tasks.workunit.client.0.smithi027.stdout: api_pool: [----------] Global test environment tear-down 2023-11-29T08:58:00.888 INFO:tasks.workunit.client.0.smithi027.stdout: api_pool: [==========] 9 tests from 1 test suite ran. (30374 ms total) 2023-11-29T08:58:00.888 INFO:tasks.workunit.client.0.smithi027.stdout: api_pool: [ PASSED ] 8 tests. 2023-11-29T08:58:00.888 INFO:tasks.workunit.client.0.smithi027.stdout: api_pool: [ SKIPPED ] 1 test, listed below: 2023-11-29T08:58:00.888 INFO:tasks.workunit.client.0.smithi027.stdout: api_pool: [ SKIPPED ] LibRadosPools.PoolGetBaseTier 2023-11-29T08:58:01.958 INFO:tasks.workunit.client.0.smithi027.stdout: api_cmd: Running main() from gmock_main.cc 2023-11-29T08:58:01.958 INFO:tasks.workunit.client.0.smithi027.stdout: api_cmd: [==========] Running 4 tests from 1 test suite. 2023-11-29T08:58:01.958 INFO:tasks.workunit.client.0.smithi027.stdout: api_cmd: [----------] Global test environment set-up. 2023-11-29T08:58:01.958 INFO:tasks.workunit.client.0.smithi027.stdout: api_cmd: [----------] 4 tests from LibRadosCmd 2023-11-29T08:58:01.958 INFO:tasks.workunit.client.0.smithi027.stdout: api_cmd: [ RUN ] LibRadosCmd.MonDescribe 2023-11-29T08:58:01.958 INFO:tasks.workunit.client.0.smithi027.stdout: api_cmd: [ OK ] LibRadosCmd.MonDescribe (589 ms) 2023-11-29T08:58:01.959 INFO:tasks.workunit.client.0.smithi027.stdout: api_cmd: [ RUN ] LibRadosCmd.OSDCmd 2023-11-29T08:58:01.959 INFO:tasks.workunit.client.0.smithi027.stdout: api_cmd: [ OK ] LibRadosCmd.OSDCmd (97 ms) 2023-11-29T08:58:01.959 INFO:tasks.workunit.client.0.smithi027.stdout: api_cmd: [ RUN ] LibRadosCmd.PGCmd 2023-11-29T08:58:01.959 INFO:tasks.workunit.client.0.smithi027.stdout: api_cmd: [ OK ] LibRadosCmd.PGCmd (21503 ms) 2023-11-29T08:58:01.959 INFO:tasks.workunit.client.0.smithi027.stdout: api_cmd: [ RUN ] LibRadosCmd.WatchLog 2023-11-29T08:58:01.959 INFO:tasks.workunit.client.0.smithi027.stdout: api_cmd: got: 2023-11-29T08:57:51.850949+0000 mon.a [INF] from='client.? 172.21.15.27:0/120977054' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi027-84643-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2023-11-29T08:58:01.959 INFO:tasks.workunit.client.0.smithi027.stdout: api_cmd: got: 2023-11-29T08:57:52.821775+0000 mon.a [WRN] Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-11-29T08:58:01.959 INFO:tasks.workunit.client.0.smithi027.stdout: api_cmd: got: 2023-11-29T08:57:52.845854+0000 mon.a [INF] from='client.? 172.21.15.27:0/120977054' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi027-84643-7","app": "rados","yes_i_really_mean_it": true}]': finished 2023-11-29T08:58:01.959 INFO:tasks.workunit.client.0.smithi027.stdout: api_cmd: got: 2023-11-29T08:57:52.854566+0000 mon.a [INF] from='client.? 172.21.15.27:0/377430917' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi027-84517-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2023-11-29T08:58:01.959 INFO:tasks.workunit.client.0.smithi027.stdout: api_cmd: got: 2023-11-29T08:57:52.892074+0000 client.admin [INF] onexx 2023-11-29T08:58:01.959 INFO:tasks.workunit.client.0.smithi027.stdout: api_cmd: got: 2023-11-29T08:57:52.892277+0000 mon.a [INF] from='client.? 172.21.15.27:0/357879142' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2023-11-29T08:58:01.959 INFO:tasks.workunit.client.0.smithi027.stdout: api_cmd: got: 2023-11-29T08:57:55.864393+0000 mon.a [INF] from='client.? 172.21.15.27:0/357879142' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2023-11-29T08:58:01.959 INFO:tasks.workunit.client.0.smithi027.stdout: api_cmd: got: 2023-11-29T08:57:56.875173+0000 mon.a [INF] from='client.? 172.21.15.27:0/458302042' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi027-84643-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2023-11-29T08:58:01.959 INFO:tasks.workunit.client.0.smithi027.stdout: api_cmd: got: 2023-11-29T08:57:57.864852+0000 client.admin [INF] threexx 2023-11-29T08:58:01.960 INFO:tasks.workunit.client.0.smithi027.stdout: api_cmd: got: 2023-11-29T08:57:57.865250+0000 mon.a [INF] from='client.? 172.21.15.27:0/357879142' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2023-11-29T08:58:01.960 INFO:tasks.workunit.client.0.smithi027.stdout: api_cmd: [ OK ] LibRadosCmd.WatchLog (9104 ms) 2023-11-29T08:58:01.960 INFO:tasks.workunit.client.0.smithi027.stdout: api_cmd: [----------] 4 tests from LibRadosCmd (31293 ms total) 2023-11-29T08:58:01.960 INFO:tasks.workunit.client.0.smithi027.stdout: api_cmd: 2023-11-29T08:58:01.960 INFO:tasks.workunit.client.0.smithi027.stdout: api_cmd: [----------] Global test environment tear-down 2023-11-29T08:58:01.960 INFO:tasks.workunit.client.0.smithi027.stdout: api_cmd: [==========] 4 tests from 1 test suite ran. (31293 ms total) 2023-11-29T08:58:01.960 INFO:tasks.workunit.client.0.smithi027.stdout: api_cmd: [ PASSED ] 4 tests. 2023-11-29T08:58:02.731 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: Running main() from gmock_main.cc 2023-11-29T08:58:02.731 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: [==========] Running 16 tests from 2 test suites. 2023-11-29T08:58:02.731 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: [----------] Global test environment set-up. 2023-11-29T08:58:02.731 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP 2023-11-29T08:58:02.731 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:373: Skipped 2023-11-29T08:58:02.731 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: Not supported by crimson yet. Skipped 2023-11-29T08:58:02.731 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotify 2023-11-29T08:58:02.731 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:387: Skipped 2023-11-29T08:58:02.732 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: Not supported by crimson yet. Skipped 2023-11-29T08:58:02.732 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:400: Skipped 2023-11-29T08:58:02.732 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: Not supported by crimson yet. Skipped 2023-11-29T08:58:02.732 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: [ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotify (0 ms) 2023-11-29T08:58:02.732 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotifyTimeout 2023-11-29T08:58:02.732 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:387: Skipped 2023-11-29T08:58:02.732 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: Not supported by crimson yet. Skipped 2023-11-29T08:58:02.732 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:400: Skipped 2023-11-29T08:58:02.732 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: Not supported by crimson yet. Skipped 2023-11-29T08:58:02.732 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: [ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotifyTimeout (1 ms) 2023-11-29T08:58:02.732 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:381: Skipped 2023-11-29T08:58:02.732 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: Not supported by crimson yet. Skipped 2023-11-29T08:58:02.732 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP (1 ms total) 2023-11-29T08:58:02.732 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: 2023-11-29T08:58:02.732 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP 2023-11-29T08:58:02.733 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 2023-11-29T08:58:02.733 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: notify 2023-11-29T08:58:02.733 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 (15696 ms) 2023-11-29T08:58:02.733 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 2023-11-29T08:58:02.733 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: notify 2023-11-29T08:58:02.733 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 (8229 ms) 2023-11-29T08:58:02.733 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 2023-11-29T08:58:02.733 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 (1882 ms) 2023-11-29T08:58:02.733 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 2023-11-29T08:58:02.733 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 (1088 ms) 2023-11-29T08:58:02.733 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 2023-11-29T08:58:06.273 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: handle_notify cookie 9 api_service_pp: [==========] Running 4 tests from 1 test suite. 2023-11-29T08:58:06.273 INFO:tasks.workunit.client.0.smithi027.stdout: api_service_pp: [----------] Global test environment set-up. 2023-11-29T08:58:06.273 INFO:tasks.workunit.client.0.smithi027.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP 2023-11-29T08:58:06.273 INFO:tasks.workunit.client.0.smithi027.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterEarly 2023-11-29T08:58:06.273 INFO:tasks.workunit.client.0.smithi027.stdout: api_service_pp: 2023-11-29T08:57:30.680+0000 7f4ee48727c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:58:06.273 INFO:tasks.workunit.client.0.smithi027.stdout: api_service_pp: 2023-11-29T08:57:30.680+0000 7f4ee48727c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:58:06.274 INFO:tasks.workunit.client.0.smithi027.stdout: api_service_pp: 2023-11-29T08:57:30.680+0000 7f4ee48727c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:58:06.274 INFO:tasks.workunit.client.0.smithi027.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterEarly (5322 ms) 2023-11-29T08:58:06.274 INFO:tasks.workunit.client.0.smithi027.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterLate 2023-11-29T08:58:06.274 INFO:tasks.workunit.client.0.smithi027.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterLate (52 ms) 2023-11-29T08:58:06.274 INFO:tasks.workunit.client.0.smithi027.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Status 2023-11-29T08:58:06.274 INFO:tasks.workunit.client.0.smithi027.stdout: api_service_pp: [ OK ] LibRadosServicePP.Status (20038 ms) 2023-11-29T08:58:06.274 INFO:tasks.workunit.client.0.smithi027.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Close 2023-11-29T08:58:06.274 INFO:tasks.workunit.client.0.smithi027.stdout: api_service_pp: attempt 0 of 20 2023-11-29T08:58:06.275 INFO:tasks.workunit.client.0.smithi027.stdout: api_service_pp: failed to deregister: 2023-11-29T08:58:06.275 INFO:tasks.workunit.client.0.smithi027.stdout: api_service_pp: { 2023-11-29T08:58:06.275 INFO:tasks.workunit.client.0.smithi027.stdout: api_service_pp: "epoch": 6, 2023-11-29T08:58:06.275 INFO:tasks.workunit.client.0.smithi027.stdout: api_service_pp: "modified": "2023-11-29T08:57:59.052147+0000", 2023-11-29T08:58:06.275 INFO:tasks.workunit.client.0.smithi027.stdout: api_service_pp: "services": { 2023-11-29T08:58:06.275 INFO:tasks.workunit.client.0.smithi027.stdout: api_service_pp: "laundry": { 2023-11-29T08:58:06.275 INFO:tasks.workunit.client.0.smithi027.stdout: api_service_pp: "daemons": { 2023-11-29T08:58:06.275 INFO:tasks.workunit.client.0.smithi027.stdout: api_service_pp: "summary": "", 2023-11-29T08:58:06.275 INFO:tasks.workunit.client.0.smithi027.stdout: api_service_pp: "close-test-pid84926": { 2023-11-29T08:58:06.276 INFO:tasks.workunit.client.0.smithi027.stdout: api_service_pp: "start_epoch": 5, 2023-11-29T08:58:06.276 INFO:tasks.workunit.client.0.smithi027.stdout: api_service_pp: "start_stamp": "2023-11-29T08:57:56.128982+0000", 2023-11-29T08:58:06.276 INFO:tasks.workunit.client.0.smithi027.stdout: api_service_pp: "gid": 4380, 2023-11-29T08:58:06.276 INFO:tasks.workunit.client.0.smithi027.stdout: api_service_pp: "addr": "172.21.15.27:0/3461699364", 2023-11-29T08:58:06.276 INFO:tasks.workunit.client.0.smithi027.stdout: api_service_pp: "metadata": { 2023-11-29T08:58:06.276 INFO:tasks.workunit.client.0.smithi027.stdout: api_service_pp: "arch": "x86_64", 2023-11-29T08:58:06.276 INFO:tasks.workunit.client.0.smithi027.stdout: api_service_pp: "ceph_release": "reef", 2023-11-29T08:58:06.276 INFO:tasks.workunit.client.0.smithi027.stdout: api_service_pp: "ceph_version": "ceph version 18.0.0-7483-g412bfade (412bfade5c44735b71d7c14eb55649269cd32a35) reef (dev)", 2023-11-29T08:58:06.276 INFO:tasks.workunit.client.0.smithi027.stdout: api_service_pp: "ceph_version_short": "18.0.0-7483-g412bfade", 2023-11-29T08:58:06.277 INFO:tasks.workunit.client.0.smithi027.stdout: api_service_pp: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", 2023-11-29T08:58:06.277 INFO:tasks.workunit.client.0.smithi027.stdout: api_service_pp: "distro": "centos", 2023-11-29T08:58:06.277 INFO:tasks.workunit.client.0.smithi027.stdout: api_service_pp: "distro_description": "CentOS Stream 9", 2023-11-29T08:58:06.277 INFO:tasks.workunit.client.0.smithi027.stdout: api_service_pp: "distro_version": "9", 2023-11-29T08:58:06.277 INFO:tasks.workunit.client.0.smithi027.stdout: api_service_pp: "foo": "bar", 2023-11-29T08:58:06.277 INFO:tasks.workunit.client.0.smithi027.stdout: api_service_pp: "hostname": "smithi027", 2023-11-29T08:58:06.277 INFO:tasks.workunit.client.0.smithi027.stdout: api_service_pp: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023", 2023-11-29T08:58:06.277 INFO:tasks.workunit.client.0.smithi027.stdout: api_service_pp: "kernel_version": "5.14.0-388.el9.x86_64", 2023-11-29T08:58:06.277 INFO:tasks.workunit.client.0.smithi027.stdout: api_service_pp: "mem_swap_kb": "0", 2023-11-29T08:58:06.278 INFO:tasks.workunit.client.0.smithi027.stdout: api_service_pp: "mem_total_kb": "32488496", 2023-11-29T08:58:06.278 INFO:tasks.workunit.client.0.smithi027.stdout: api_service_pp: "os": "Linux", 2023-11-29T08:58:06.278 INFO:tasks.workunit.client.0.smithi027.stdout: api_service_pp: "this": "that" 2023-11-29T08:58:06.278 INFO:tasks.workunit.client.0.smithi027.stdout: api_service_pp: }, 2023-11-29T08:58:06.278 INFO:tasks.workunit.client.0.smithi027.stdout: api_service_pp: "task_status": {} 2023-11-29T08:58:06.278 INFO:tasks.workunit.client.0.smithi027.stdout: api_service_pp: } 2023-11-29T08:58:06.278 INFO:tasks.workunit.client.0.smithi027.stdout: api_service_pp: } 2023-11-29T08:58:06.278 INFO:tasks.workunit.client.0.smithi027.stdout: api_service_pp: } 2023-11-29T08:58:06.279 INFO:tasks.workunit.client.0.smithi027.stdout: api_service_pp: } 2023-11-29T08:58:06.279 INFO:tasks.workunit.client.0.smithi027.stdout: api_service_pp: } 2023-11-29T08:58:06.279 INFO:tasks.workunit.client.0.smithi027.stdout: api_service_pp: 2023-11-29T08:58:06.279 INFO:tasks.workunit.client.0.smithi027.stdout: api_service_pp: attempt 1 of 20 2023-11-29T08:58:06.279 INFO:tasks.workunit.client.0.smithi027.stdout: api_service_pp: [ OK ] LibRadosServicePP.Close (10179 ms) 2023-11-29T08:58:06.279 INFO:tasks.workunit.client.0.smithi027.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP (35591 ms total) 2023-11-29T08:58:06.279 INFO:tasks.workunit.client.0.smithi027.stdout: api_service_pp: 2023-11-29T08:58:06.279 INFO:tasks.workunit.client.0.smithi027.stdout: api_service_pp: [----------] Global test environment tear-down 2023-11-29T08:58:06.302 INFO:tasks.workunit.client.0.smithi027.stdout: api_service_pp: [==========] 4 tests from 1 test suite ran. (35591 ms total) 2023-11-29T08:58:06.302 INFO:tasks.workunit.client.0.smithi027.stdout: api_service_pp: [ PASSED ] 4 tests. 2023-11-29T08:58:18.123 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: Running main() from gmock_main.cc 2023-11-29T08:58:18.123 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: [==========] Running 16 tests from 2 test suites. 2023-11-29T08:58:18.123 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: [----------] Global test environment set-up. 2023-11-29T08:58:18.123 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP 2023-11-29T08:58:18.123 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: seed 84473 2023-11-29T08:58:18.123 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusivePP 2023-11-29T08:58:18.123 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusivePP (5503 ms) 2023-11-29T08:58:18.124 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedPP 2023-11-29T08:58:18.124 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedPP (4023 ms) 2023-11-29T08:58:18.124 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusiveDurPP 2023-11-29T08:58:18.124 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusiveDurPP (4129 ms) 2023-11-29T08:58:18.124 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedDurPP 2023-11-29T08:58:18.124 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedDurPP (3055 ms) 2023-11-29T08:58:18.124 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockMayRenewPP 2023-11-29T08:58:18.124 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockMayRenewPP (8200 ms) 2023-11-29T08:58:18.124 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.UnlockPP 2023-11-29T08:58:18.124 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: [ OK ] LibRadosLockPP.UnlockPP (1044 ms) 2023-11-29T08:58:18.124 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.ListLockersPP 2023-11-29T08:58:18.124 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: [ OK ] LibRadosLockPP.ListLockersPP (992 ms) 2023-11-29T08:58:18.124 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.BreakLockPP 2023-11-29T08:58:18.124 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: [ OK ] LibRadosLockPP.BreakLockPP (18867 ms) 2023-11-29T08:58:18.125 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP (45813 ms total) 2023-11-29T08:58:18.125 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: 2023-11-29T08:58:18.125 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP 2023-11-29T08:58:18.125 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:373: Skipped 2023-11-29T08:58:18.125 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: Not supported by crimson yet. Skipped 2023-11-29T08:58:18.125 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusivePP 2023-11-29T08:58:18.125 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:387: Skipped 2023-11-29T08:58:18.125 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: Not supported by crimson yet. Skipped 2023-11-29T08:58:18.125 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:400: Skipped 2023-11-29T08:58:18.125 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: Not supported by crimson yet. Skipped 2023-11-29T08:58:18.125 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: [ SKIPPED ] LibRadosLockECPP.LockExclusivePP (0 ms) 2023-11-29T08:58:18.125 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedPP 2023-11-29T08:58:18.126 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:387: Skipped 2023-11-29T08:58:18.126 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: Not supported by crimson yet. Skipped 2023-11-29T08:58:18.126 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:400: Skipped 2023-11-29T08:58:18.126 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: Not supported by crimson yet. Skipped 2023-11-29T08:58:18.126 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: [ SKIPPED ] LibRadosLockECPP.LockSharedPP (0 ms) 2023-11-29T08:58:18.126 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusiveDurPP 2023-11-29T08:58:18.126 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:387: Skipped 2023-11-29T08:58:18.126 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: Not supported by crimson yet. Skipped 2023-11-29T08:58:18.126 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:400: Skipped 2023-11-29T08:58:18.126 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: Not supported by crimson yet. Skipped 2023-11-29T08:58:18.126 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: [ SKIPPED ] LibRadosLockECPP.LockExclusiveDurPP (0 ms) 2023-11-29T08:58:18.126 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedDurPP 2023-11-29T08:58:18.126 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:387: Skipped 2023-11-29T08:58:18.127 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: Not supported by crimson yet. Skipped 2023-11-29T08:58:18.127 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:400: Skipped 2023-11-29T08:58:18.127 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: Not supported by crimson yet. Skipped 2023-11-29T08:58:18.127 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: [ SKIPPED ] LibRadosLockECPP.LockSharedDurPP (0 ms) 2023-11-29T08:58:18.127 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockMayRenewPP 2023-11-29T08:58:18.127 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:387: Skipped 2023-11-29T08:58:18.127 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: Not supported by crimson yet. Skipped 2023-11-29T08:58:18.127 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:400: Skipped 2023-11-29T08:58:18.127 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: Not supported by crimson yet. Skipped 2023-11-29T08:58:18.127 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: [ SKIPPED ] LibRadosLockECPP.LockMayRenewPP (0 ms) 2023-11-29T08:58:18.127 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.UnlockPP 2023-11-29T08:58:18.127 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:387: Skipped 2023-11-29T08:58:18.127 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: Not supported by crimson yet. Skipped 2023-11-29T08:58:18.127 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:400: Skipped 2023-11-29T08:58:18.127 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: Not supported by crimson yet. Skipped 2023-11-29T08:58:18.128 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: [ SKIPPED ] LibRadosLockECPP.UnlockPP (0 ms) 2023-11-29T08:58:18.128 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.ListLockersPP 2023-11-29T08:58:18.128 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:387: Skipped 2023-11-29T08:58:18.128 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: Not supported by crimson yet. Skipped 2023-11-29T08:58:18.128 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:400: Skipped 2023-11-29T08:58:18.128 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: Not supported by crimson yet. Skipped 2023-11-29T08:58:18.128 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: [ SKIPPED ] LibRadosLockECPP.ListLockersPP (0 ms) 2023-11-29T08:58:18.128 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.BreakLockPP 2023-11-29T08:58:18.128 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:387: Skipped 2023-11-29T08:58:18.128 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: Not supported by crimson yet. Skipped 2023-11-29T08:58:18.129 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:400: Skipped 2023-11-29T08:58:18.129 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: Not supported by crimson yet. Skipped 2023-11-29T08:58:18.129 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: [ SKIPPED ] LibRadosLockECPP.BreakLockPP (0 ms) 2023-11-29T08:58:18.129 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:381: Skipped 2023-11-29T08:58:18.129 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: Not supported by crimson yet. Skipped 2023-11-29T08:58:18.129 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP (0 ms total) 2023-11-29T08:58:18.129 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: 2023-11-29T08:58:18.129 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: [----------] Global test environment tear-down 2023-11-29T08:58:18.129 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: [==========] 16 tests from 2 test suites ran. (47688 ms total) 2023-11-29T08:58:18.129 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: [ PASSED ] 8 tests. 2023-11-29T08:58:18.129 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: [ SKIPPED ] 8 tests, listed below: 2023-11-29T08:58:18.129 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: [ SKIPPED ] LibRadosLockECPP.LockExclusivePP 2023-11-29T08:58:18.129 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: [ SKIPPED ] LibRadosLockECPP.LockSharedPP 2023-11-29T08:58:18.129 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: [ SKIPPED ] LibRadosLockECPP.LockExclusiveDurPP 2023-11-29T08:58:18.129 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: [ SKIPPED ] LibRadosLockECPP.LockSharedDurPP 2023-11-29T08:58:18.130 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: [ SKIPPED ] LibRadosLockECPP.LockMayRenewPP 2023-11-29T08:58:18.130 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: [ SKIPPED ] LibRadosLockECPP.UnlockPP 2023-11-29T08:58:18.130 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: [ SKIPPED ] LibRadosLockECPP.ListLockersPP 2023-11-29T08:58:18.130 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock_pp: [ SKIPPED ] LibRadosLockECPP.BreakLockPP 2023-11-29T08:58:30.859 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: Running main() from gmock_main.cc 2023-11-29T08:58:30.859 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [==========] Running 37 tests from 2 test suites. 2023-11-29T08:58:30.859 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [----------] Global test environment set-up. 2023-11-29T08:58:30.859 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [----------] 20 tests from LibRadosIoPP 2023-11-29T08:58:30.859 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: seed 84415 2023-11-29T08:58:30.859 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TooBigPP 2023-11-29T08:58:30.859 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ OK ] LibRadosIoPP.TooBigPP (0 ms) 2023-11-29T08:58:30.859 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SimpleWritePP 2023-11-29T08:58:30.859 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ OK ] LibRadosIoPP.SimpleWritePP (2892 ms) 2023-11-29T08:58:30.859 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadOpPP 2023-11-29T08:58:30.859 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadOpPP (4801 ms) 2023-11-29T08:58:30.859 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SparseReadOpPP 2023-11-29T08:58:30.860 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ OK ] LibRadosIoPP.SparseReadOpPP (6250 ms) 2023-11-29T08:58:30.860 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP 2023-11-29T08:58:30.860 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP (1015 ms) 2023-11-29T08:58:30.860 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP2 2023-11-29T08:58:30.860 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP2 (2647 ms) 2023-11-29T08:58:30.860 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ RUN ] LibRadosIoPP.Checksum 2023-11-29T08:58:30.860 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ OK ] LibRadosIoPP.Checksum (1196 ms) 2023-11-29T08:58:30.860 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadIntoBufferlist 2023-11-29T08:58:30.860 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadIntoBufferlist (2095 ms) 2023-11-29T08:58:30.860 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ RUN ] LibRadosIoPP.OverlappingWriteRoundTripPP 2023-11-29T08:58:30.860 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ OK ] LibRadosIoPP.OverlappingWriteRoundTripPP (2074 ms) 2023-11-29T08:58:30.860 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP 2023-11-29T08:58:30.860 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP (797 ms) 2023-11-29T08:58:30.860 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP2 2023-11-29T08:58:30.861 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP2 (24 ms) 2023-11-29T08:58:30.861 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ RUN ] LibRadosIoPP.AppendRoundTripPP 2023-11-29T08:58:30.861 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ OK ] LibRadosIoPP.AppendRoundTripPP (71 ms) 2023-11-29T08:58:30.861 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TruncTestPP 2023-11-29T08:58:30.861 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ OK ] LibRadosIoPP.TruncTestPP (1109 ms) 2023-11-29T08:58:30.861 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RemoveTestPP 2023-11-29T08:58:30.861 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ OK ] LibRadosIoPP.RemoveTestPP (977 ms) 2023-11-29T08:58:30.861 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrsRoundTripPP 2023-11-29T08:58:30.861 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrsRoundTripPP (2850 ms) 2023-11-29T08:58:30.861 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RmXattrPP 2023-11-29T08:58:30.861 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ OK ] LibRadosIoPP.RmXattrPP (186 ms) 2023-11-29T08:58:30.861 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrListPP 2023-11-29T08:58:30.861 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrListPP (1936 ms) 2023-11-29T08:58:30.862 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtPP 2023-11-29T08:58:30.862 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtPP (27810 ms) 2023-11-29T08:58:30.862 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtDNEPP 2023-11-29T08:58:30.862 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtDNEPP (15 ms) 2023-11-29T08:58:30.862 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtMismatchPP 2023-11-29T08:58:30.862 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtMismatchPP (21 ms) 2023-11-29T08:58:30.862 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [----------] 20 tests from LibRadosIoPP (58766 ms total) 2023-11-29T08:58:30.862 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: 2023-11-29T08:58:30.862 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [----------] 17 tests from LibRadosIoECPP 2023-11-29T08:58:30.862 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:373: Skipped 2023-11-29T08:58:30.862 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-11-29T08:58:30.862 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SimpleWritePP 2023-11-29T08:58:30.862 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:387: Skipped 2023-11-29T08:58:30.862 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-11-29T08:58:30.863 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:400: Skipped 2023-11-29T08:58:30.863 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-11-29T08:58:30.863 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.SimpleWritePP (0 ms) 2023-11-29T08:58:30.863 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.ReadOpPP 2023-11-29T08:58:30.863 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:387: Skipped 2023-11-29T08:58:30.863 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-11-29T08:58:30.863 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:400: Skipped 2023-11-29T08:58:30.863 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-11-29T08:58:30.863 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.ReadOpPP (0 ms) 2023-11-29T08:58:30.863 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SparseReadOpPP 2023-11-29T08:58:30.863 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:387: Skipped 2023-11-29T08:58:30.863 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-11-29T08:58:30.863 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:400: Skipped 2023-11-29T08:58:30.863 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-11-29T08:58:30.863 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.SparseReadOpPP (0 ms) 2023-11-29T08:58:30.864 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP 2023-11-29T08:58:30.864 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:387: Skipped 2023-11-29T08:58:30.864 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-11-29T08:58:30.864 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:400: Skipped 2023-11-29T08:58:30.864 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-11-29T08:58:30.864 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.RoundTripPP (0 ms) 2023-11-29T08:58:30.864 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP2 2023-11-29T08:58:30.864 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:387: Skipped 2023-11-29T08:58:30.864 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-11-29T08:58:30.864 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:400: Skipped 2023-11-29T08:58:30.864 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-11-29T08:58:30.864 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.RoundTripPP2 (0 ms) 2023-11-29T08:58:30.864 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.OverlappingWriteRoundTripPP 2023-11-29T08:58:30.864 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:387: Skipped 2023-11-29T08:58:30.864 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-11-29T08:58:30.865 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:400: Skipped 2023-11-29T08:58:30.865 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-11-29T08:58:30.865 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.OverlappingWriteRoundTripPP (1 ms) 2023-11-29T08:58:30.865 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP 2023-11-29T08:58:30.865 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:387: Skipped 2023-11-29T08:58:30.865 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-11-29T08:58:30.865 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:400: Skipped 2023-11-29T08:58:30.865 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-11-29T08:58:30.865 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP (0 ms) 2023-11-29T08:58:30.865 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP2 2023-11-29T08:58:30.865 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:387: Skipped 2023-11-29T08:58:30.865 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-11-29T08:58:30.865 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:400: Skipped 2023-11-29T08:58:30.865 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-11-29T08:58:30.865 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP2 (0 ms) 2023-11-29T08:58:30.866 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.AppendRoundTripPP 2023-11-29T08:58:30.866 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:387: Skipped 2023-11-29T08:58:30.866 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-11-29T08:58:30.866 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:400: Skipped 2023-11-29T08:58:30.866 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-11-29T08:58:30.866 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.AppendRoundTripPP (0 ms) 2023-11-29T08:58:30.866 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.TruncTestPP 2023-11-29T08:58:30.866 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:387: Skipped 2023-11-29T08:58:30.866 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-11-29T08:58:30.866 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:400: Skipped 2023-11-29T08:58:30.866 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-11-29T08:58:30.866 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.TruncTestPP (0 ms) 2023-11-29T08:58:30.866 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RemoveTestPP 2023-11-29T08:58:30.866 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:387: Skipped 2023-11-29T08:58:30.867 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-11-29T08:58:30.867 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:400: Skipped 2023-11-29T08:58:30.867 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-11-29T08:58:30.867 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.RemoveTestPP (0 ms) 2023-11-29T08:58:30.867 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrsRoundTripPP 2023-11-29T08:58:30.867 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:387: Skipped 2023-11-29T08:58:30.867 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-11-29T08:58:30.867 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:400: Skipped 2023-11-29T08:58:30.867 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-11-29T08:58:30.867 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.XattrsRoundTripPP (0 ms) 2023-11-29T08:58:30.867 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RmXattrPP 2023-11-29T08:58:30.867 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:387: Skipped 2023-11-29T08:58:30.867 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-11-29T08:58:30.867 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:400: Skipped 2023-11-29T08:58:30.867 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-11-29T08:58:30.867 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.RmXattrPP (0 ms) 2023-11-29T08:58:30.868 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrListPP 2023-11-29T08:58:30.868 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:387: Skipped 2023-11-29T08:58:30.868 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-11-29T08:58:30.868 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:400: Skipped 2023-11-29T08:58:30.868 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-11-29T08:58:30.868 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.XattrListPP (0 ms) 2023-11-29T08:58:30.868 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtPP 2023-11-29T08:58:30.868 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:387: Skipped 2023-11-29T08:58:30.868 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-11-29T08:58:30.868 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:400: Skipped 2023-11-29T08:58:30.868 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-11-29T08:58:30.869 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.CmpExtPP (0 ms) 2023-11-29T08:58:30.869 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtDNEPP 2023-11-29T08:58:30.869 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:387: Skipped 2023-11-29T08:58:30.869 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-11-29T08:58:30.869 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:400: Skipped 2023-11-29T08:58:30.869 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-11-29T08:58:30.869 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.CmpExtDNEPP (0 ms) 2023-11-29T08:58:30.869 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtMismatchPP 2023-11-29T08:58:30.869 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:387: Skipped 2023-11-29T08:58:30.869 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-11-29T08:58:30.869 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:400: Skipped 2023-11-29T08:58:30.869 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-11-29T08:58:30.869 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.CmpExtMismatchPP (0 ms) 2023-11-29T08:58:30.869 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:381: Skipped 2023-11-29T08:58:30.870 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-11-29T08:58:30.870 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [----------] 17 tests from LibRadosIoECPP (1 ms total) 2023-11-29T08:58:30.870 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: 2023-11-29T08:58:30.870 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [----------] Global test environment tear-down 2023-11-29T08:58:30.870 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [==========] 37 tests from 2 test suites ran. (60452 ms total) 2023-11-29T08:58:30.870 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ PASSED ] 20 tests. 2023-11-29T08:58:30.870 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ SKIPPED ] 17 tests, listed below: 2023-11-29T08:58:30.870 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.SimpleWritePP 2023-11-29T08:58:30.870 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.ReadOpPP 2023-11-29T08:58:30.870 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.SparseReadOpPP 2023-11-29T08:58:30.870 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.RoundTripPP 2023-11-29T08:58:30.870 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.RoundTripPP2 2023-11-29T08:58:30.870 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.OverlappingWriteRoundTripPP 2023-11-29T08:58:30.870 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP 2023-11-29T08:58:30.871 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP2 2023-11-29T08:58:30.871 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.AppendRoundTripPP 2023-11-29T08:58:30.871 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.TruncTestPP 2023-11-29T08:58:30.871 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.RemoveTestPP 2023-11-29T08:58:30.871 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.XattrsRoundTripPP 2023-11-29T08:58:30.871 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.RmXattrPP 2023-11-29T08:58:30.871 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.XattrListPP 2023-11-29T08:58:30.871 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.CmpExtPP 2023-11-29T08:58:30.871 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.CmpExtDNEPP 2023-11-29T08:58:30.871 INFO:tasks.workunit.client.0.smithi027.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.CmpExtMismatchPP 2023-11-29T08:58:33.877 INFO:tasks.workunit.client.0.smithi027.stdout:sc: [ RUN ] LibRadosMisc.WriteSame 2023-11-29T08:58:33.877 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: [ OK ] LibRadosMisc.WriteSame (2900 ms) 2023-11-29T08:58:33.877 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: [ RUN ] LibRadosMisc.CmpExt 2023-11-29T08:58:33.877 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: [ OK ] LibRadosMisc.CmpExt (191 ms) 2023-11-29T08:58:33.877 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: [ RUN ] LibRadosMisc.Applications 2023-11-29T08:58:33.878 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: [ OK ] LibRadosMisc.Applications (5016 ms) 2023-11-29T08:58:33.878 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatOSD 2023-11-29T08:58:33.878 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatOSD (0 ms) 2023-11-29T08:58:33.878 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatClient 2023-11-29T08:58:33.878 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatClient (0 ms) 2023-11-29T08:58:33.878 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: [ RUN ] LibRadosMisc.ShutdownRace 2023-11-29T08:58:33.878 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: [ OK ] LibRadosMisc.ShutdownRace (30546 ms) 2023-11-29T08:58:33.878 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: [----------] 8 tests from LibRadosMisc (39577 ms total) 2023-11-29T08:58:33.878 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: 2023-11-29T08:58:33.878 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: [----------] Global test environment tear-down 2023-11-29T08:58:33.878 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: [==========] 12 tests from 4 test suites ran. (63362 ms total) 2023-11-29T08:58:33.878 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc: [ PASSED ] 12 tests. 2023-11-29T08:58:52.861 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: Running main() from gmock_main.cc 2023-11-29T08:58:52.861 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: [==========] Running 24 tests from 2 test suites. 2023-11-29T08:58:52.861 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: [----------] Global test environment set-up. 2023-11-29T08:58:52.861 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: [----------] 14 tests from LibRadosIo 2023-11-29T08:58:52.861 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: [ RUN ] LibRadosIo.SimpleWrite 2023-11-29T08:58:52.861 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: [ OK ] LibRadosIo.SimpleWrite (3564 ms) 2023-11-29T08:58:52.861 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: [ RUN ] LibRadosIo.TooBig 2023-11-29T08:58:52.862 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: [ OK ] LibRadosIo.TooBig (0 ms) 2023-11-29T08:58:52.862 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: [ RUN ] LibRadosIo.ReadTimeout 2023-11-29T08:58:52.862 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: no timeout :/ 2023-11-29T08:58:52.862 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: no timeout :/ 2023-11-29T08:58:52.862 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: no timeout :/ 2023-11-29T08:58:52.862 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: no timeout :/ 2023-11-29T08:58:52.862 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: no timeout :/ 2023-11-29T08:58:52.862 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: [ OK ] LibRadosIo.ReadTimeout (2050 ms) 2023-11-29T08:58:52.862 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: [ RUN ] LibRadosIo.RoundTrip 2023-11-29T08:58:52.862 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: [ OK ] LibRadosIo.RoundTrip (3007 ms) 2023-11-29T08:58:52.862 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: [ RUN ] LibRadosIo.Checksum 2023-11-29T08:58:52.862 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: [ OK ] LibRadosIo.Checksum (1993 ms) 2023-11-29T08:58:52.863 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: [ RUN ] LibRadosIo.OverlappingWriteRoundTrip 2023-11-29T08:58:52.863 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: [ OK ] LibRadosIo.OverlappingWriteRoundTrip (3073 ms) 2023-11-29T08:58:52.863 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: [ RUN ] LibRadosIo.WriteFullRoundTrip 2023-11-29T08:58:52.863 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: [ OK ] LibRadosIo.WriteFullRoundTrip (5968 ms) 2023-11-29T08:58:52.863 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: [ RUN ] LibRadosIo.AppendRoundTrip 2023-11-29T08:58:52.863 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: [ OK ] LibRadosIo.AppendRoundTrip (200 ms) 2023-11-29T08:58:52.863 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: [ RUN ] LibRadosIo.ZeroLenZero 2023-11-29T08:58:52.863 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: [ OK ] LibRadosIo.ZeroLenZero (3 ms) 2023-11-29T08:58:52.863 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: [ RUN ] LibRadosIo.TruncTest 2023-11-29T08:58:52.863 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: [ OK ] LibRadosIo.TruncTest (3917 ms) 2023-11-29T08:58:52.863 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: [ RUN ] LibRadosIo.RemoveTest 2023-11-29T08:58:52.864 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: [ OK ] LibRadosIo.RemoveTest (4954 ms) 2023-11-29T08:58:52.864 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: [ RUN ] LibRadosIo.XattrsRoundTrip 2023-11-29T08:58:52.864 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: [ OK ] LibRadosIo.XattrsRoundTrip (3677 ms) 2023-11-29T08:58:52.864 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: [ RUN ] LibRadosIo.RmXattr 2023-11-29T08:58:52.864 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: [ OK ] LibRadosIo.RmXattr (42413 ms) 2023-11-29T08:58:52.864 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: [ RUN ] LibRadosIo.XattrIter 2023-11-29T08:58:52.864 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: [ OK ] LibRadosIo.XattrIter (5999 ms) 2023-11-29T08:58:52.864 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: [----------] 14 tests from LibRadosIo (80818 ms total) 2023-11-29T08:58:52.864 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: 2023-11-29T08:58:52.864 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: [----------] 10 tests from LibRadosIoEC 2023-11-29T08:58:52.864 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:168: Skipped 2023-11-29T08:58:52.864 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: Not supported by crimson yet. Skipped 2023-11-29T08:58:52.864 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: [ RUN ] LibRadosIoEC.SimpleWrite 2023-11-29T08:58:52.864 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:182: Skipped 2023-11-29T08:58:52.865 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: Not supported by crimson yet. Skipped 2023-11-29T08:58:52.865 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:196: Skipped 2023-11-29T08:58:52.865 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: Not supported by crimson yet. Skipped 2023-11-29T08:58:52.865 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: [ SKIPPED ] LibRadosIoEC.SimpleWrite (0 ms) 2023-11-29T08:58:52.865 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: [ RUN ] LibRadosIoEC.RoundTrip 2023-11-29T08:58:52.865 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:182: Skipped 2023-11-29T08:58:52.865 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: Not supported by crimson yet. Skipped 2023-11-29T08:58:52.865 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:196: Skipped 2023-11-29T08:58:52.865 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: Not supported by crimson yet. Skipped 2023-11-29T08:58:52.865 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: [ SKIPPED ] LibRadosIoEC.RoundTrip (0 ms) 2023-11-29T08:58:52.865 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: [ RUN ] LibRadosIoEC.OverlappingWriteRoundTrip 2023-11-29T08:58:52.865 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:182: Skipped 2023-11-29T08:58:52.865 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: Not supported by crimson yet. Skipped 2023-11-29T08:58:52.865 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:196: Skipped 2023-11-29T08:58:52.865 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: Not supported by crimson yet. Skipped 2023-11-29T08:58:52.866 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: [ SKIPPED ] LibRadosIoEC.OverlappingWriteRoundTrip (0 ms) 2023-11-29T08:58:52.866 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: [ RUN ] LibRadosIoEC.WriteFullRoundTrip 2023-11-29T08:58:52.866 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:182: Skipped 2023-11-29T08:58:52.866 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: Not supported by crimson yet. Skipped 2023-11-29T08:58:52.866 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:196: Skipped 2023-11-29T08:58:52.866 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: Not supported by crimson yet. Skipped 2023-11-29T08:58:52.866 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: [ SKIPPED ] LibRadosIoEC.WriteFullRoundTrip (0 ms) 2023-11-29T08:58:52.866 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: [ RUN ] LibRadosIoEC.AppendRoundTrip 2023-11-29T08:58:52.866 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:182: Skipped 2023-11-29T08:58:52.866 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: Not supported by crimson yet. Skipped 2023-11-29T08:58:52.866 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:196: Skipped 2023-11-29T08:58:52.866 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: Not supported by crimson yet. Skipped 2023-11-29T08:58:52.866 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: [ SKIPPED ] LibRadosIoEC.AppendRoundTrip (0 ms) 2023-11-29T08:58:52.866 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: [ RUN ] LibRadosIoEC.TruncTest 2023-11-29T08:58:52.867 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:182: Skipped 2023-11-29T08:58:52.867 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: Not supported by crimson yet. Skipped 2023-11-29T08:58:52.867 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:196: Skipped 2023-11-29T08:58:52.867 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: Not supported by crimson yet. Skipped 2023-11-29T08:58:52.867 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: [ SKIPPED ] LibRadosIoEC.TruncTest (0 ms) 2023-11-29T08:58:52.867 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: [ RUN ] LibRadosIoEC.RemoveTest 2023-11-29T08:58:52.868 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:182: Skipped 2023-11-29T08:58:52.868 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: Not supported by crimson yet. Skipped 2023-11-29T08:58:52.868 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:196: Skipped 2023-11-29T08:58:52.868 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: Not supported by crimson yet. Skipped 2023-11-29T08:58:52.868 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: [ SKIPPED ] LibRadosIoEC.RemoveTest (0 ms) 2023-11-29T08:58:52.868 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: [ RUN ] LibRadosIoEC.XattrsRoundTrip 2023-11-29T08:58:52.868 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:182: Skipped 2023-11-29T08:58:52.868 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: Not supported by crimson yet. Skipped 2023-11-29T08:58:52.869 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:196: Skipped 2023-11-29T08:58:52.869 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: Not supported by crimson yet. Skipped 2023-11-29T08:58:52.869 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: [ SKIPPED ] LibRadosIoEC.XattrsRoundTrip (0 ms) 2023-11-29T08:58:52.869 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: [ RUN ] LibRadosIoEC.RmXattr 2023-11-29T08:58:52.869 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:182: Skipped 2023-11-29T08:58:52.869 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: Not supported by crimson yet. Skipped 2023-11-29T08:58:52.869 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:196: Skipped 2023-11-29T08:58:52.869 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: Not supported by crimson yet. Skipped 2023-11-29T08:58:52.869 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: [ SKIPPED ] LibRadosIoEC.RmXattr (0 ms) 2023-11-29T08:58:52.869 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: [ RUN ] LibRadosIoEC.XattrIter 2023-11-29T08:58:52.869 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:182: Skipped 2023-11-29T08:58:52.869 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: Not supported by crimson yet. Skipped 2023-11-29T08:58:52.869 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:196: Skipped 2023-11-29T08:58:52.870 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: Not supported by crimson yet. Skipped 2023-11-29T08:58:52.870 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: [ SKIPPED ] LibRadosIoEC.XattrIter (0 ms) 2023-11-29T08:58:52.870 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:176: Skipped 2023-11-29T08:58:52.870 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: Not supported by crimson yet. Skipped 2023-11-29T08:58:52.870 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: [----------] 10 tests from LibRadosIoEC (0 ms total) 2023-11-29T08:58:52.870 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: 2023-11-29T08:58:52.870 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: [----------] Global test environment tear-down 2023-11-29T08:58:52.870 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: [==========] 24 tests from 2 test suites ran. (82465 ms total) 2023-11-29T08:58:52.870 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: [ PASSED ] 14 tests. 2023-11-29T08:58:52.870 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: [ SKIPPED ] 10 tests, listed below: 2023-11-29T08:58:52.870 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: [ SKIPPED ] LibRadosIoEC.SimpleWrite 2023-11-29T08:58:52.870 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: [ SKIPPED ] LibRadosIoEC.RoundTrip 2023-11-29T08:58:52.871 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: [ SKIPPED ] LibRadosIoEC.OverlappingWriteRoundTrip 2023-11-29T08:58:52.871 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: [ SKIPPED ] LibRadosIoEC.WriteFullRoundTrip 2023-11-29T08:58:52.871 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: [ SKIPPED ] LibRadosIoEC.AppendRoundTrip 2023-11-29T08:58:52.871 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: [ SKIPPED ] LibRadosIoEC.TruncTest 2023-11-29T08:58:52.871 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: [ SKIPPED ] LibRadosIoEC.RemoveTest 2023-11-29T08:58:52.871 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: [ SKIPPED ] LibRadosIoEC.XattrsRoundTrip 2023-11-29T08:58:52.871 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: [ SKIPPED ] LibRadosIoEC.RmXattr 2023-11-29T08:58:52.871 INFO:tasks.workunit.client.0.smithi027.stdout: api_io: [ SKIPPED ] LibRadosIoEC.XattrIter 2023-11-29T08:58:55.894 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: Running main() from gmock_main.cc 2023-11-29T08:58:55.894 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: [==========] Running 16 tests from 2 test suites. 2023-11-29T08:58:55.894 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: [----------] Global test environment set-up. 2023-11-29T08:58:55.894 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: [----------] 8 tests from LibRadosLock 2023-11-29T08:58:55.895 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusive 2023-11-29T08:58:55.895 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: [ OK ] LibRadosLock.LockExclusive (2474 ms) 2023-11-29T08:58:55.895 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: [ RUN ] LibRadosLock.LockShared 2023-11-29T08:58:55.895 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: [ OK ] LibRadosLock.LockShared (14328 ms) 2023-11-29T08:58:55.895 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusiveDur 2023-11-29T08:58:55.895 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: [ OK ] LibRadosLock.LockExclusiveDur (2844 ms) 2023-11-29T08:58:55.895 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: [ RUN ] LibRadosLock.LockSharedDur 2023-11-29T08:58:55.895 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: [ OK ] LibRadosLock.LockSharedDur (6218 ms) 2023-11-29T08:58:55.895 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: [ RUN ] LibRadosLock.LockMayRenew 2023-11-29T08:58:55.895 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: [ OK ] LibRadosLock.LockMayRenew (1088 ms) 2023-11-29T08:58:55.895 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: [ RUN ] LibRadosLock.Unlock 2023-11-29T08:58:55.895 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: [ OK ] LibRadosLock.Unlock (22728 ms) 2023-11-29T08:58:55.895 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: [ RUN ] LibRadosLock.ListLockers 2023-11-29T08:58:55.895 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: [ OK ] LibRadosLock.ListLockers (30267 ms) 2023-11-29T08:58:55.896 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: [ RUN ] LibRadosLock.BreakLock 2023-11-29T08:58:55.896 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: [ OK ] LibRadosLock.BreakLock (4003 ms) 2023-11-29T08:58:55.896 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: [----------] 8 tests from LibRadosLock (83950 ms total) 2023-11-29T08:58:55.896 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: 2023-11-29T08:58:55.896 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: [----------] 8 tests from LibRadosLockEC 2023-11-29T08:58:55.896 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:168: Skipped 2023-11-29T08:58:55.896 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: Not supported by crimson yet. Skipped 2023-11-29T08:58:55.896 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusive 2023-11-29T08:58:55.896 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:182: Skipped 2023-11-29T08:58:55.896 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: Not supported by crimson yet. Skipped 2023-11-29T08:58:55.896 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:196: Skipped 2023-11-29T08:58:55.896 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: Not supported by crimson yet. Skipped 2023-11-29T08:58:55.896 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: [ SKIPPED ] LibRadosLockEC.LockExclusive (0 ms) 2023-11-29T08:58:55.896 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: [ RUN ] LibRadosLockEC.LockShared 2023-11-29T08:58:55.896 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:182: Skipped 2023-11-29T08:58:55.897 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: Not supported by crimson yet. Skipped 2023-11-29T08:58:55.897 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:196: Skipped 2023-11-29T08:58:55.897 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: Not supported by crimson yet. Skipped 2023-11-29T08:58:55.897 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: [ SKIPPED ] LibRadosLockEC.LockShared (0 ms) 2023-11-29T08:58:55.897 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusiveDur 2023-11-29T08:58:55.897 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:182: Skipped 2023-11-29T08:58:55.897 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: Not supported by crimson yet. Skipped 2023-11-29T08:58:55.897 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:196: Skipped 2023-11-29T08:58:55.897 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: Not supported by crimson yet. Skipped 2023-11-29T08:58:55.897 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: [ SKIPPED ] LibRadosLockEC.LockExclusiveDur (0 ms) 2023-11-29T08:58:55.897 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: [ RUN ] LibRadosLockEC.LockSharedDur 2023-11-29T08:58:55.897 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:182: Skipped 2023-11-29T08:58:55.897 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: Not supported by crimson yet. Skipped 2023-11-29T08:58:55.897 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:196: Skipped 2023-11-29T08:58:55.897 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: Not supported by crimson yet. Skipped 2023-11-29T08:58:55.898 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: [ SKIPPED ] LibRadosLockEC.LockSharedDur (0 ms) 2023-11-29T08:58:55.898 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: [ RUN ] LibRadosLockEC.LockMayRenew 2023-11-29T08:58:55.898 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:182: Skipped 2023-11-29T08:58:55.898 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: Not supported by crimson yet. Skipped 2023-11-29T08:58:55.898 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:196: Skipped 2023-11-29T08:58:55.898 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: Not supported by crimson yet. Skipped 2023-11-29T08:58:55.898 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: [ SKIPPED ] LibRadosLockEC.LockMayRenew (0 ms) 2023-11-29T08:58:55.898 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: [ RUN ] LibRadosLockEC.Unlock 2023-11-29T08:58:55.898 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:182: Skipped 2023-11-29T08:58:55.898 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: Not supported by crimson yet. Skipped 2023-11-29T08:58:55.898 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:196: Skipped 2023-11-29T08:58:55.899 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: Not supported by crimson yet. Skipped 2023-11-29T08:58:55.899 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: [ SKIPPED ] LibRadosLockEC.Unlock (0 ms) 2023-11-29T08:58:55.899 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: [ RUN ] LibRadosLockEC.ListLockers 2023-11-29T08:58:55.899 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:182: Skipped 2023-11-29T08:58:55.899 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: Not supported by crimson yet. Skipped 2023-11-29T08:58:55.899 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:196: Skipped 2023-11-29T08:58:55.899 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: Not supported by crimson yet. Skipped 2023-11-29T08:58:55.899 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: [ SKIPPED ] LibRadosLockEC.ListLockers (0 ms) 2023-11-29T08:58:55.899 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: [ RUN ] LibRadosLockEC.BreakLock 2023-11-29T08:58:55.899 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:182: Skipped 2023-11-29T08:58:55.899 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: Not supported by crimson yet. Skipped 2023-11-29T08:58:55.900 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:196: Skipped 2023-11-29T08:58:55.900 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: Not supported by crimson yet. Skipped 2023-11-29T08:58:55.900 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: [ SKIPPED ] LibRadosLockEC.BreakLock (0 ms) 2023-11-29T08:58:55.900 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:176: Skipped 2023-11-29T08:58:55.900 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: Not supported by crimson yet. Skipped 2023-11-29T08:58:55.900 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: [----------] 8 tests from LibRadosLockEC (0 ms total) 2023-11-29T08:58:55.900 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: 2023-11-29T08:58:55.900 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: [----------] Global test environment tear-down 2023-11-29T08:58:55.900 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: [==========] 16 tests from 2 test suites ran. (85435 ms total) 2023-11-29T08:58:55.900 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: [ PASSED ] 8 tests. 2023-11-29T08:58:55.900 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: [ SKIPPED ] 8 tests, listed below: 2023-11-29T08:58:55.900 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: [ SKIPPED ] LibRadosLockEC.LockExclusive 2023-11-29T08:58:55.900 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: [ SKIPPED ] LibRadosLockEC.LockShared 2023-11-29T08:58:55.901 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: [ SKIPPED ] LibRadosLockEC.LockExclusiveDur 2023-11-29T08:58:55.901 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: [ SKIPPED ] LibRadosLockEC.LockSharedDur 2023-11-29T08:58:55.901 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: [ SKIPPED ] LibRadosLockEC.LockMayRenew 2023-11-29T08:58:55.901 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: [ SKIPPED ] LibRadosLockEC.Unlock 2023-11-29T08:58:55.901 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: [ SKIPPED ] LibRadosLockEC.ListLockers 2023-11-29T08:58:55.901 INFO:tasks.workunit.client.0.smithi027.stdout: api_lock: [ SKIPPED ] LibRadosLockEC.BreakLock 2023-11-29T08:59:16.871 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: Running main() from gmock_main.cc 2023-11-29T08:59:16.872 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: [==========] Running 13 tests from 4 test suites. 2023-11-29T08:59:16.872 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: [----------] Global test environment set-up. 2023-11-29T08:59:16.872 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots 2023-11-29T08:59:16.872 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapList 2023-11-29T08:59:16.872 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapList (6021 ms) 2023-11-29T08:59:16.872 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapRemove 2023-11-29T08:59:16.872 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapRemove (8026 ms) 2023-11-29T08:59:16.872 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.Rollback 2023-11-29T08:59:16.872 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: [ OK ] LibRadosSnapshots.Rollback (9939 ms) 2023-11-29T08:59:16.872 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapGetName 2023-11-29T08:59:16.873 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapGetName (4009 ms) 2023-11-29T08:59:16.873 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots (27995 ms total) 2023-11-29T08:59:16.873 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: 2023-11-29T08:59:16.873 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: [----------] 3 tests from LibRadosSnapshotsSelfManaged 2023-11-29T08:59:16.873 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Snap 2023-11-29T08:59:16.873 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Snap (47929 ms) 2023-11-29T08:59:16.873 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Rollback 2023-11-29T08:59:16.873 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Rollback (9897 ms) 2023-11-29T08:59:16.873 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.FutureSnapRollback 2023-11-29T08:59:16.873 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.FutureSnapRollback (15107 ms) 2023-11-29T08:59:16.873 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: [----------] 3 tests from LibRadosSnapshotsSelfManaged (72933 ms total) 2023-11-29T08:59:16.873 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: 2023-11-29T08:59:16.873 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC 2023-11-29T08:59:16.873 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:168: Skipped 2023-11-29T08:59:16.873 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: Not supported by crimson yet. Skipped 2023-11-29T08:59:16.874 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapList 2023-11-29T08:59:16.874 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:182: Skipped 2023-11-29T08:59:16.874 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: Not supported by crimson yet. Skipped 2023-11-29T08:59:16.874 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:196: Skipped 2023-11-29T08:59:16.874 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: Not supported by crimson yet. Skipped 2023-11-29T08:59:16.874 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: [ SKIPPED ] LibRadosSnapshotsEC.SnapList (0 ms) 2023-11-29T08:59:16.874 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapRemove 2023-11-29T08:59:16.874 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:182: Skipped 2023-11-29T08:59:16.874 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: Not supported by crimson yet. Skipped 2023-11-29T08:59:16.874 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:196: Skipped 2023-11-29T08:59:16.874 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: Not supported by crimson yet. Skipped 2023-11-29T08:59:16.874 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: [ SKIPPED ] LibRadosSnapshotsEC.SnapRemove (0 ms) 2023-11-29T08:59:16.874 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.Rollback 2023-11-29T08:59:16.874 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:182: Skipped 2023-11-29T08:59:16.875 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: Not supported by crimson yet. Skipped 2023-11-29T08:59:16.875 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:196: Skipped 2023-11-29T08:59:16.875 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: Not supported by crimson yet. Skipped 2023-11-29T08:59:16.875 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: [ SKIPPED ] LibRadosSnapshotsEC.Rollback (0 ms) 2023-11-29T08:59:16.875 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapGetName 2023-11-29T08:59:16.875 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:182: Skipped 2023-11-29T08:59:16.875 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: Not supported by crimson yet. Skipped 2023-11-29T08:59:16.875 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:196: Skipped 2023-11-29T08:59:16.875 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: Not supported by crimson yet. Skipped 2023-11-29T08:59:16.875 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: [ SKIPPED ] LibRadosSnapshotsEC.SnapGetName (0 ms) 2023-11-29T08:59:16.875 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:176: Skipped 2023-11-29T08:59:16.875 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: Not supported by crimson yet. Skipped 2023-11-29T08:59:16.875 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC (0 ms total) 2023-11-29T08:59:16.875 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: 2023-11-29T08:59:16.875 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC 2023-11-29T08:59:16.877 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:168: Skipped 2023-11-29T08:59:16.877 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: Not supported by crimson yet. Skipped 2023-11-29T08:59:16.877 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Snap 2023-11-29T08:59:16.877 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:182: Skipped 2023-11-29T08:59:16.877 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: Not supported by crimson yet. Skipped 2023-11-29T08:59:16.877 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:196: Skipped 2023-11-29T08:59:16.877 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: Not supported by crimson yet. Skipped 2023-11-29T08:59:16.878 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: [ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Snap (0 ms) 2023-11-29T08:59:16.878 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Rollback 2023-11-29T08:59:16.878 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:182: Skipped 2023-11-29T08:59:16.878 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: Not supported by crimson yet. Skipped 2023-11-29T08:59:16.878 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:196: Skipped 2023-11-29T08:59:16.878 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: Not supported by crimson yet. Skipped 2023-11-29T08:59:16.878 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: [ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Rollback (0 ms) 2023-11-29T08:59:16.878 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:176: Skipped 2023-11-29T08:59:16.879 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: Not supported by crimson yet. Skipped 2023-11-29T08:59:16.879 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC (0 ms total) 2023-11-29T08:59:16.879 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: 2023-11-29T08:59:16.879 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: [----------] Global test environment tear-down 2023-11-29T08:59:16.879 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: [==========] 13 tests from 4 test suites ran. (106353 ms total) 2023-11-29T08:59:16.879 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: [ PASSED ] 7 tests. 2023-11-29T08:59:16.879 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: [ SKIPPED ] 6 tests, listed below: 2023-11-29T08:59:16.879 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: [ SKIPPED ] LibRadosSnapshotsEC.SnapList 2023-11-29T08:59:16.879 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: [ SKIPPED ] LibRadosSnapshotsEC.SnapRemove 2023-11-29T08:59:16.879 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: [ SKIPPED ] LibRadosSnapshotsEC.Rollback 2023-11-29T08:59:16.879 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: [ SKIPPED ] LibRadosSnapshotsEC.SnapGetName 2023-11-29T08:59:16.879 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: [ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Snap 2023-11-29T08:59:16.879 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots: [ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Rollback 2023-11-29T08:59:16.880 INFO:tasks.workunit.client.0.smithi027.stderr:+ for t in "${!pids[@]}" 2023-11-29T08:59:16.880 INFO:tasks.workunit.client.0.smithi027.stderr:+ pid=85073 2023-11-29T08:59:16.880 INFO:tasks.workunit.client.0.smithi027.stderr:+ wait 85073 2023-11-29T08:59:22.640 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2023-11-29T08:59:25.862 INFO:tasks.workunit.client.0.smithi027.stdout: api_c_read_operations: Running main() from gmock_main.cc 2023-11-29T08:59:25.862 INFO:tasks.workunit.client.0.smithi027.stdout: api_c_read_operations: [==========] Running 17 tests from 1 test suite. 2023-11-29T08:59:25.862 INFO:tasks.workunit.client.0.smithi027.stdout: api_c_read_operations: [----------] Global test environment set-up. 2023-11-29T08:59:25.862 INFO:tasks.workunit.client.0.smithi027.stdout: api_c_read_operations: [----------] 17 tests from CReadOpsTest 2023-11-29T08:59:25.862 INFO:tasks.workunit.client.0.smithi027.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.NewDelete 2023-11-29T08:59:25.863 INFO:tasks.workunit.client.0.smithi027.stdout: api_c_read_operations: [ OK ] CReadOpsTest.NewDelete (0 ms) 2023-11-29T08:59:25.863 INFO:tasks.workunit.client.0.smithi027.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.SetOpFlags 2023-11-29T08:59:25.863 INFO:tasks.workunit.client.0.smithi027.stdout: api_c_read_operations: [ OK ] CReadOpsTest.SetOpFlags (8928 ms) 2023-11-29T08:59:25.863 INFO:tasks.workunit.client.0.smithi027.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertExists 2023-11-29T08:59:25.863 INFO:tasks.workunit.client.0.smithi027.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertExists (867 ms) 2023-11-29T08:59:25.863 INFO:tasks.workunit.client.0.smithi027.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertVersion 2023-11-29T08:59:25.863 INFO:tasks.workunit.client.0.smithi027.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertVersion (7774 ms) 2023-11-29T08:59:25.863 INFO:tasks.workunit.client.0.smithi027.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpXattr 2023-11-29T08:59:25.863 INFO:tasks.workunit.client.0.smithi027.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpXattr (5403 ms) 2023-11-29T08:59:25.863 INFO:tasks.workunit.client.0.smithi027.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Read 2023-11-29T08:59:25.863 INFO:tasks.workunit.client.0.smithi027.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Read (996 ms) 2023-11-29T08:59:25.863 INFO:tasks.workunit.client.0.smithi027.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Checksum 2023-11-29T08:59:25.863 INFO:tasks.workunit.client.0.smithi027.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Checksum (1760 ms) 2023-11-29T08:59:25.863 INFO:tasks.workunit.client.0.smithi027.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.RWOrderedRead 2023-11-29T08:59:25.863 INFO:tasks.workunit.client.0.smithi027.stdout: api_c_read_operations: [ OK ] CReadOpsTest.RWOrderedRead (1159 ms) 2023-11-29T08:59:25.864 INFO:tasks.workunit.client.0.smithi027.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ShortRead 2023-11-29T08:59:25.864 INFO:tasks.workunit.client.0.smithi027.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ShortRead (2970 ms) 2023-11-29T08:59:25.864 INFO:tasks.workunit.client.0.smithi027.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Exec 2023-11-29T08:59:25.864 INFO:tasks.workunit.client.0.smithi027.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Exec (8226 ms) 2023-11-29T08:59:25.864 INFO:tasks.workunit.client.0.smithi027.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ExecUserBuf 2023-11-29T08:59:25.864 INFO:tasks.workunit.client.0.smithi027.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ExecUserBuf (28761 ms) 2023-11-29T08:59:25.864 INFO:tasks.workunit.client.0.smithi027.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Stat 2023-11-29T08:59:25.864 INFO:tasks.workunit.client.0.smithi027.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Stat (16104 ms) 2023-11-29T08:59:25.864 INFO:tasks.workunit.client.0.smithi027.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Stat2 2023-11-29T08:59:25.864 INFO:tasks.workunit.client.0.smithi027.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Stat2 (2679 ms) 2023-11-29T08:59:25.864 INFO:tasks.workunit.client.0.smithi027.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Omap 2023-11-29T08:59:25.864 INFO:tasks.workunit.client.0.smithi027.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Omap (20933 ms) 2023-11-29T08:59:25.864 INFO:tasks.workunit.client.0.smithi027.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.OmapNuls 2023-11-29T08:59:25.865 INFO:tasks.workunit.client.0.smithi027.stdout: api_c_read_operations: [ OK ] CReadOpsTest.OmapNuls (5734 ms) 2023-11-29T08:59:25.865 INFO:tasks.workunit.client.0.smithi027.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.GetXattrs 2023-11-29T08:59:25.865 INFO:tasks.workunit.client.0.smithi027.stdout: api_c_read_operations: [ OK ] CReadOpsTest.GetXattrs (50 ms) 2023-11-29T08:59:25.865 INFO:tasks.workunit.client.0.smithi027.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpExt 2023-11-29T08:59:25.865 INFO:tasks.workunit.client.0.smithi027.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpExt (24 ms) 2023-11-29T08:59:25.865 INFO:tasks.workunit.client.0.smithi027.stdout: api_c_read_operations: [----------] 17 tests from CReadOpsTest (112368 ms total) 2023-11-29T08:59:25.865 INFO:tasks.workunit.client.0.smithi027.stdout: api_c_read_operations: 2023-11-29T08:59:25.865 INFO:tasks.workunit.client.0.smithi027.stdout: api_c_read_operations: [----------] Global test environment tear-down 2023-11-29T08:59:25.865 INFO:tasks.workunit.client.0.smithi027.stdout: api_c_read_operations: [==========] 17 tests from 1 test suite ran. (115127 ms total) 2023-11-29T08:59:25.866 INFO:tasks.workunit.client.0.smithi027.stdout: api_c_read_operations: [ PASSED ] 17 tests. 2023-11-29T08:59:28.145 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~6s 2023-11-29T08:59:33.650 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~11s 2023-11-29T08:59:34.954 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [==========] Running 31 tests from 7 test suites. 2023-11-29T08:59:34.954 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [----------] Global test environment set-up. 2023-11-29T08:59:34.954 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion 2023-11-29T08:59:34.954 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [ RUN ] LibRadosMiscVersion.VersionPP 2023-11-29T08:59:34.955 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [ OK ] LibRadosMiscVersion.VersionPP (0 ms) 2023-11-29T08:59:34.955 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2023-11-29T08:59:34.955 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: 2023-11-29T08:59:34.955 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [----------] 22 tests from LibRadosMiscPP 2023-11-29T08:59:34.955 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: seed 84575 2023-11-29T08:59:34.955 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: 2023-11-29T08:57:30.506+0000 7fc908c337c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:59:34.955 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: 2023-11-29T08:57:30.506+0000 7fc908c337c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:59:34.955 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: 2023-11-29T08:57:30.506+0000 7fc908c337c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T08:59:34.955 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WaitOSDMapPP 2023-11-29T08:59:34.955 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WaitOSDMapPP (2 ms) 2023-11-29T08:59:34.955 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNamePP 2023-11-29T08:59:34.955 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNamePP (13913 ms) 2023-11-29T08:59:34.955 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongLocatorPP 2023-11-29T08:59:34.955 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongLocatorPP (4835 ms) 2023-11-29T08:59:34.955 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNSpacePP 2023-11-29T08:59:34.956 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNSpacePP (5045 ms) 2023-11-29T08:59:34.956 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongAttrNamePP 2023-11-29T08:59:34.956 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongAttrNamePP (40898 ms) 2023-11-29T08:59:34.956 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.ExecPP 2023-11-29T08:59:34.956 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.ExecPP (3067 ms) 2023-11-29T08:59:34.956 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BadFlagsPP 2023-11-29T08:59:34.956 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BadFlagsPP (1058 ms) 2023-11-29T08:59:34.956 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate1PP 2023-11-29T08:59:34.956 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate1PP (6130 ms) 2023-11-29T08:59:34.956 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate2PP 2023-11-29T08:59:34.956 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate2PP (2037 ms) 2023-11-29T08:59:34.956 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigObjectPP 2023-11-29T08:59:34.956 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigObjectPP (8564 ms) 2023-11-29T08:59:34.956 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AioOperatePP 2023-11-29T08:59:34.956 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AioOperatePP (406 ms) 2023-11-29T08:59:34.956 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertExistsPP 2023-11-29T08:59:34.957 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertExistsPP (3893 ms) 2023-11-29T08:59:34.957 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertVersionPP 2023-11-29T08:59:34.957 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertVersionPP (148 ms) 2023-11-29T08:59:34.957 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigAttrPP 2023-11-29T08:59:34.957 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: osd_max_attr_size = 0 2023-11-29T08:59:34.957 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: osd_max_attr_size == 0; skipping test 2023-11-29T08:59:34.957 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigAttrPP (33068 ms) 2023-11-29T08:59:34.957 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyPP 2023-11-29T08:59:34.957 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/misc_cxx.cc:386: Skipped 2023-11-29T08:59:34.957 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: Not supported by crimson yet. Skipped 2023-11-29T08:59:34.957 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [ SKIPPED ] LibRadosMiscPP.CopyPP (0 ms) 2023-11-29T08:59:34.957 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyScrubPP 2023-11-29T08:59:34.957 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/misc_cxx.cc:549: Skipped 2023-11-29T08:59:34.957 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: Not supported by crimson yet. Skipped 2023-11-29T08:59:39.154 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~17s 2023-11-29T08:59:44.658 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~22s 2023-11-29T08:59:46.900 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: Running main() from gmock_main.cc 2023-11-29T08:59:46.900 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: [==========] Running 19 tests from 4 test suites. 2023-11-29T08:59:46.900 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: [----------] Global test environment set-up. 2023-11-29T08:59:46.900 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP 2023-11-29T08:59:46.900 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: seed 84681 2023-11-29T08:59:46.900 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapListPP 2023-11-29T08:59:46.900 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapListPP (7020 ms) 2023-11-29T08:59:46.900 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapRemovePP 2023-11-29T08:59:46.900 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapRemovePP (4015 ms) 2023-11-29T08:59:46.900 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.RollbackPP 2023-11-29T08:59:46.901 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.RollbackPP (2008 ms) 2023-11-29T08:59:46.901 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapGetNamePP 2023-11-29T08:59:46.901 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapGetNamePP (4905 ms) 2023-11-29T08:59:46.901 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapCreateRemovePP 2023-11-29T08:59:46.901 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapCreateRemovePP (8042 ms) 2023-11-29T08:59:46.901 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP (25990 ms total) 2023-11-29T08:59:46.901 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: 2023-11-29T08:59:46.901 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: [----------] 7 tests from LibRadosSnapshotsSelfManagedPP 2023-11-29T08:59:46.901 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapPP 2023-11-29T08:59:46.901 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapPP (38856 ms) 2023-11-29T08:59:46.901 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.RollbackPP 2023-11-29T08:59:46.901 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/snapshots_cxx.cc:156: Skipped 2023-11-29T08:59:46.901 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: Not supported by crimson yet. Skipped 2023-11-29T08:59:46.901 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.RollbackPP (0 ms) 2023-11-29T08:59:46.902 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP 2023-11-29T08:59:46.902 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/snapshots_cxx.cc:242: Skipped 2023-11-29T08:59:46.902 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: Not supported by crimson yet. Skipped 2023-11-29T08:59:46.902 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP (0 ms) 2023-11-29T08:59:46.902 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.Bug11677 2023-11-29T08:59:46.902 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.Bug11677 (4163 ms) 2023-11-29T08:59:46.902 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.OrderSnap 2023-11-29T08:59:46.902 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.OrderSnap (6930 ms) 2023-11-29T08:59:46.902 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2023-11-29T08:59:46.902 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/snapshots_cxx.cc:463: Skipped 2023-11-29T08:59:46.902 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: 2023-11-29T08:59:46.902 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback (0 ms) 2023-11-29T08:59:46.902 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap 2023-11-29T08:59:46.902 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: deleting snap 13 in pool LibRadosSnapshotsSelfManagedPP_smithi027-84681-7 2023-11-29T08:59:46.903 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: waiting for snaps to purge 2023-11-29T08:59:46.903 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap (55528 ms) 2023-11-29T08:59:46.903 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: [----------] 7 tests from LibRadosSnapshotsSelfManagedPP (105477 ms total) 2023-11-29T08:59:46.903 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: 2023-11-29T08:59:46.903 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP 2023-11-29T08:59:46.903 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:373: Skipped 2023-11-29T08:59:46.903 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: Not supported by crimson yet. Skipped 2023-11-29T08:59:46.903 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapListPP 2023-11-29T08:59:46.903 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:387: Skipped 2023-11-29T08:59:46.903 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: Not supported by crimson yet. Skipped 2023-11-29T08:59:46.903 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:400: Skipped 2023-11-29T08:59:46.903 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: Not supported by crimson yet. Skipped 2023-11-29T08:59:46.903 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsECPP.SnapListPP (0 ms) 2023-11-29T08:59:46.903 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapRemovePP 2023-11-29T08:59:46.904 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:387: Skipped 2023-11-29T08:59:46.904 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: Not supported by crimson yet. Skipped 2023-11-29T08:59:46.904 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:400: Skipped 2023-11-29T08:59:46.904 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: Not supported by crimson yet. Skipped 2023-11-29T08:59:46.904 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsECPP.SnapRemovePP (0 ms) 2023-11-29T08:59:46.904 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.RollbackPP 2023-11-29T08:59:46.904 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:387: Skipped 2023-11-29T08:59:46.904 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: Not supported by crimson yet. Skipped 2023-11-29T08:59:46.904 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:400: Skipped 2023-11-29T08:59:46.904 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: Not supported by crimson yet. Skipped 2023-11-29T08:59:46.904 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsECPP.RollbackPP (0 ms) 2023-11-29T08:59:46.904 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapGetNamePP 2023-11-29T08:59:46.904 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:387: Skipped 2023-11-29T08:59:46.904 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: Not supported by crimson yet. Skipped 2023-11-29T08:59:46.904 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:400: Skipped 2023-11-29T08:59:46.905 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: Not supported by crimson yet. Skipped 2023-11-29T08:59:46.905 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsECPP.SnapGetNamePP (0 ms) 2023-11-29T08:59:46.905 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:381: Skipped 2023-11-29T08:59:46.905 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: Not supported by crimson yet. Skipped 2023-11-29T08:59:46.905 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP (0 ms total) 2023-11-29T08:59:46.905 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: 2023-11-29T08:59:46.905 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP 2023-11-29T08:59:46.905 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:373: Skipped 2023-11-29T08:59:46.905 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: Not supported by crimson yet. Skipped 2023-11-29T08:59:46.905 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2023-11-29T08:59:46.905 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:387: Skipped 2023-11-29T08:59:46.905 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: Not supported by crimson yet. Skipped 2023-11-29T08:59:46.905 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:400: Skipped 2023-11-29T08:59:46.905 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: Not supported by crimson yet. Skipped 2023-11-29T08:59:46.905 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.SnapPP (0 ms) 2023-11-29T08:59:46.906 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2023-11-29T08:59:46.906 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:387: Skipped 2023-11-29T08:59:46.906 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: Not supported by crimson yet. Skipped 2023-11-29T08:59:46.906 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:400: Skipped 2023-11-29T08:59:46.906 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: Not supported by crimson yet. Skipped 2023-11-29T08:59:46.906 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.RollbackPP (0 ms) 2023-11-29T08:59:46.906 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2023-11-29T08:59:46.906 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:387: Skipped 2023-11-29T08:59:46.906 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: Not supported by crimson yet. Skipped 2023-11-29T08:59:46.906 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:400: Skipped 2023-11-29T08:59:46.906 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: Not supported by crimson yet. Skipped 2023-11-29T08:59:46.906 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.Bug11677 (0 ms) 2023-11-29T08:59:46.906 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:381: Skipped 2023-11-29T08:59:46.907 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: Not supported by crimson yet. Skipped 2023-11-29T08:59:46.907 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP (0 ms total) 2023-11-29T08:59:46.907 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: 2023-11-29T08:59:46.907 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: [----------] Global test environment tear-down 2023-11-29T08:59:46.907 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: [==========] 19 tests from 4 test suites ran. (136353 ms total) 2023-11-29T08:59:46.907 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: [ PASSED ] 9 tests. 2023-11-29T08:59:46.907 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: [ SKIPPED ] 10 tests, listed below: 2023-11-29T08:59:46.907 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.RollbackPP 2023-11-29T08:59:46.907 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP 2023-11-29T08:59:46.907 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2023-11-29T08:59:46.908 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsECPP.SnapListPP 2023-11-29T08:59:46.908 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsECPP.SnapRemovePP 2023-11-29T08:59:46.908 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsECPP.RollbackPP 2023-11-29T08:59:46.908 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsECPP.SnapGetNamePP 2023-11-29T08:59:46.908 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2023-11-29T08:59:46.908 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2023-11-29T08:59:46.908 INFO:tasks.workunit.client.0.smithi027.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2023-11-29T08:59:50.162 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~28s 2023-11-29T08:59:51.942 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify: Running main() from gmock_main.cc 2023-11-29T08:59:51.942 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify: [==========] Running 11 tests from 2 test suites. 2023-11-29T08:59:51.942 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify: [----------] Global test environment set-up. 2023-11-29T08:59:51.942 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify 2023-11-29T08:59:51.942 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify 2023-11-29T08:59:51.942 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify: watch_notify_test_cb 2023-11-29T08:59:51.943 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify (10762 ms) 2023-11-29T08:59:51.943 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch2Delete 2023-11-29T08:59:51.943 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2023-11-29T08:59:51.943 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94128908376144 err -107 2023-11-29T08:59:51.943 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch2Delete (3052 ms) 2023-11-29T08:59:51.943 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete 2023-11-29T08:59:51.943 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2023-11-29T08:59:51.943 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94128908398752 err -107 2023-11-29T08:59:51.943 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete (5040 ms) 2023-11-29T08:59:51.943 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2 2023-11-29T08:59:51.943 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify: watch_notify2_test_cb from 4235 notify_id 154618822657 cookie 94128908398752 2023-11-29T08:59:51.943 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2 (64 ms) 2023-11-29T08:59:51.943 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchNotify2 2023-11-29T08:59:51.943 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify: watch_notify2_test_cb from 4235 notify_id 167503724546 cookie 94128908398752 2023-11-29T08:59:51.944 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchNotify2 (3864 ms) 2023-11-29T08:59:51.944 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioNotify 2023-11-29T08:59:51.944 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify: watch_notify2_test_cb from 4235 notify_id 171798691841 cookie 94128908422976 2023-11-29T08:59:51.944 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioNotify (117 ms) 2023-11-29T08:59:51.944 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Multi 2023-11-29T08:59:51.944 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify: watch_notify2_test_cb from 4235 notify_id 197568495618 cookie 94128908405088 2023-11-29T08:59:51.944 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify: watch_notify2_test_cb from 4235 notify_id 197568495618 cookie 94128908435408 2023-11-29T08:59:51.944 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Multi (43654 ms) 2023-11-29T08:59:51.944 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Timeout 2023-11-29T08:59:51.944 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify: watch_notify2_test_cb from 4235 notify_id 360777252867 cookie 94128908405088 2023-11-29T08:59:51.944 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify: watch_notify2_test_cb from 4235 notify_id 360777252868 cookie 94128908405088 2023-11-29T08:59:51.944 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Timeout (17197 ms) 2023-11-29T08:59:51.944 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch3Timeout 2023-11-29T08:59:51.944 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify: waiting up to 1024 for osd to time us out ... 2023-11-29T08:59:51.944 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94128908405088 err -107 2023-11-29T08:59:51.944 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify: watch_notify2_test_cb from 4235 notify_id 420906795014 cookie 94128908405088 2023-11-29T08:59:51.945 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch3Timeout (18232 ms) 2023-11-29T08:59:51.945 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete2 2023-11-29T08:59:51.945 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify: waiting up to 30 for disconnect notification ... 2023-11-29T08:59:51.945 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94128908404912 err -107 2023-11-29T08:59:51.945 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete2 (36758 ms) 2023-11-29T08:59:51.945 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify (138740 ms total) 2023-11-29T08:59:51.945 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify: 2023-11-29T08:59:51.945 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC 2023-11-29T08:59:51.945 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:168: Skipped 2023-11-29T08:59:51.945 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify: Not supported by crimson yet. Skipped 2023-11-29T08:59:51.945 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotifyEC.WatchNotify 2023-11-29T08:59:51.946 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:182: Skipped 2023-11-29T08:59:51.946 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify: Not supported by crimson yet. Skipped 2023-11-29T08:59:51.946 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:196: Skipped 2023-11-29T08:59:51.946 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify: Not supported by crimson yet. Skipped 2023-11-29T08:59:51.946 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify: [ SKIPPED ] LibRadosWatchNotifyEC.WatchNotify (0 ms) 2023-11-29T08:59:51.946 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/TestCase.cc:176: Skipped 2023-11-29T08:59:51.946 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify: Not supported by crimson yet. Skipped 2023-11-29T08:59:51.946 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC (0 ms total) 2023-11-29T08:59:51.946 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify: 2023-11-29T08:59:51.946 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify: [----------] Global test environment tear-down 2023-11-29T08:59:51.946 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify: [==========] 11 tests from 2 test suites ran. (141328 ms total) 2023-11-29T08:59:51.946 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify: [ PASSED ] 10 tests. 2023-11-29T08:59:51.946 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify: [ SKIPPED ] 1 test, listed below: 2023-11-29T08:59:51.946 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify: [ SKIPPED ] LibRadosWatchNotifyEC.WatchNotify 2023-11-29T08:59:55.667 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~33s 2023-11-29T09:00:01.171 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~39s 2023-11-29T09:00:06.676 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~44s 2023-11-29T09:00:06.922 INFO:tasks.workunit.client.0.smithi027.stdout:4662118990352 notify_id 107374182400 notifier_gid 4234 2023-11-29T09:00:06.922 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 (11096 ms) 2023-11-29T09:00:06.922 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 2023-11-29T09:00:06.923 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: handle_notify cookie 94662118990352 notify_id 300647710721 notifier_gid 4234 2023-11-29T09:00:06.923 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 (32012 ms) 2023-11-29T09:00:06.923 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 2023-11-29T09:00:06.923 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: handle_notify cookie 94662118990352 notify_id 360777252867 notifier_gid 4234 2023-11-29T09:00:06.923 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 (10857 ms) 2023-11-29T09:00:06.923 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 2023-11-29T09:00:06.923 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: handle_notify cookie 94662118990352 notify_id 360777252865 notifier_gid 4234 2023-11-29T09:00:06.923 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 (3684 ms) 2023-11-29T09:00:06.923 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 2023-11-29T09:00:06.923 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: handle_notify cookie 94662118990352 notify_id 403726925829 notifier_gid 4234 2023-11-29T09:00:06.923 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 (6369 ms) 2023-11-29T09:00:06.923 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 2023-11-29T09:00:06.923 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: handle_notify cookie 94662118990352 notify_id 403726925829 notifier_gid 4234 2023-11-29T09:00:06.923 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 (9081 ms) 2023-11-29T09:00:06.924 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 2023-11-29T09:00:06.924 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: trying... 2023-11-29T09:00:06.924 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: handle_notify cookie 94662118994416 notify_id 511101108230 notifier_gid 4234 2023-11-29T09:00:06.924 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: timed out 2023-11-29T09:00:06.924 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: flushing 2023-11-29T09:00:06.924 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: flushed 2023-11-29T09:00:06.924 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 (38355 ms) 2023-11-29T09:00:06.924 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 2023-11-29T09:00:06.924 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: trying... 2023-11-29T09:00:06.924 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: handle_notify cookie 94662118994416 notify_id 511101108226 notifier_gid 4234 2023-11-29T09:00:06.924 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: timed out 2023-11-29T09:00:06.924 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: flushing 2023-11-29T09:00:06.924 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: flushed 2023-11-29T09:00:06.924 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 (4205 ms) 2023-11-29T09:00:06.924 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 2023-11-29T09:00:06.924 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: List watches 2023-11-29T09:00:06.925 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: notify2 2023-11-29T09:00:06.925 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: handle_notify cookie 94662118994416 notify_id 511101108231 notifier_gid 4234 2023-11-29T09:00:06.925 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: notify2 done 2023-11-29T09:00:06.925 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: watch_check 2023-11-29T09:00:06.925 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: unwatch2 2023-11-29T09:00:06.925 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: flushing 2023-11-29T09:00:06.925 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: done 2023-11-29T09:00:06.925 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 (6133 ms) 2023-11-29T09:00:06.925 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 2023-11-29T09:00:06.925 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: List watches 2023-11-29T09:00:06.925 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: notify2 2023-11-29T09:00:06.925 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: handle_notify cookie 94662118994416 notify_id 575525617667 notifier_gid 4234 2023-11-29T09:00:06.925 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: notify2 done 2023-11-29T09:00:06.925 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: watch_check 2023-11-29T09:00:06.925 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: unwatch2 2023-11-29T09:00:06.925 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: flushing 2023-11-29T09:00:06.925 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: done 2023-11-29T09:00:06.926 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 (5310 ms) 2023-11-29T09:00:06.926 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP (153997 ms total) 2023-11-29T09:00:06.926 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: 2023-11-29T09:00:06.926 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: [----------] Global test environment tear-down 2023-11-29T09:00:06.926 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: [==========] 16 tests from 2 test suites ran. (156315 ms total) 2023-11-29T09:00:06.926 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: [ PASSED ] 14 tests. 2023-11-29T09:00:06.926 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: [ SKIPPED ] 2 tests, listed below: 2023-11-29T09:00:06.926 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: [ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotify 2023-11-29T09:00:06.926 INFO:tasks.workunit.client.0.smithi027.stdout: api_watch_notify_pp: [ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotifyTimeout 2023-11-29T09:00:12.181 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~50s 2023-11-29T09:00:17.684 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~55s 2023-11-29T09:00:23.189 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~61s 2023-11-29T09:00:28.695 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~66s 2023-11-29T09:00:33.881 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [ SKIPPED ] LibRadosMiscPP.CopyScrubPP (0 ms) 2023-11-29T09:00:33.881 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WriteSamePP 2023-11-29T09:00:33.881 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WriteSamePP (13638 ms) 2023-11-29T09:00:33.881 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CmpExtPP 2023-11-29T09:00:33.881 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CmpExtPP (1998 ms) 2023-11-29T09:00:33.881 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Applications 2023-11-29T09:00:33.881 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Applications (4368 ms) 2023-11-29T09:00:33.881 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatOSD 2023-11-29T09:00:33.881 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatOSD (0 ms) 2023-11-29T09:00:33.882 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatClient 2023-11-29T09:00:33.882 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatClient (0 ms) 2023-11-29T09:00:33.882 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Conf 2023-11-29T09:00:33.882 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Conf (0 ms) 2023-11-29T09:00:33.882 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [----------] 22 tests from LibRadosMiscPP (143069 ms total) 2023-11-29T09:00:33.882 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: 2023-11-29T09:00:33.882 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP 2023-11-29T09:00:33.882 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/misc_cxx.cc:476: Skipped 2023-11-29T09:00:33.882 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: Not supported by crimson yet. Skipped 2023-11-29T09:00:33.882 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [ RUN ] LibRadosTwoPoolsECPP.CopyFrom 2023-11-29T09:00:33.882 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/misc_cxx.cc:498: Skipped 2023-11-29T09:00:33.882 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: Not supported by crimson yet. Skipped 2023-11-29T09:00:33.882 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/misc_cxx.cc:504: Skipped 2023-11-29T09:00:33.883 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: Not supported by crimson yet. Skipped 2023-11-29T09:00:33.883 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.CopyFrom (0 ms) 2023-11-29T09:00:33.883 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/misc_cxx.cc:491: Skipped 2023-11-29T09:00:33.883 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: Not supported by crimson yet. Skipped 2023-11-29T09:00:33.883 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP (0 ms total) 2023-11-29T09:00:33.883 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: 2023-11-29T09:00:33.883 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)0, Checksummer::xxhash32, ceph_le > 2023-11-29T09:00:33.883 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Subset 2023-11-29T09:00:33.883 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Subset (528 ms) 2023-11-29T09:00:33.883 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Chunked 2023-11-29T09:00:33.883 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Chunked (23602 ms) 2023-11-29T09:00:33.883 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0 (24130 ms total) 2023-11-29T09:00:33.883 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: 2023-11-29T09:00:33.883 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)1, Checksummer::xxhash64, ceph_le > 2023-11-29T09:00:33.884 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Subset 2023-11-29T09:00:33.884 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Subset (8831 ms) 2023-11-29T09:00:33.884 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Chunked 2023-11-29T09:00:33.884 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Chunked (11 ms) 2023-11-29T09:00:33.884 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1 (8842 ms total) 2023-11-29T09:00:33.884 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: 2023-11-29T09:00:34.198 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~72s 2023-11-29T09:00:39.703 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~77s 2023-11-29T09:00:41.925 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)2, Checksummer::crc32c, ceph_le > 2023-11-29T09:00:41.925 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Subset 2023-11-29T09:00:41.925 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Subset (4408 ms) 2023-11-29T09:00:41.925 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Chunked 2023-11-29T09:00:41.925 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Chunked (1456 ms) 2023-11-29T09:00:41.925 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2 (5864 ms total) 2023-11-29T09:00:41.925 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: 2023-11-29T09:00:41.926 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP 2023-11-29T09:00:41.926 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:373: Skipped 2023-11-29T09:00:41.926 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: Not supported by crimson yet. Skipped 2023-11-29T09:00:41.926 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [ RUN ] LibRadosMiscECPP.CompareExtentRange 2023-11-29T09:00:41.926 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:387: Skipped 2023-11-29T09:00:41.926 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: Not supported by crimson yet. Skipped 2023-11-29T09:00:41.926 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:400: Skipped 2023-11-29T09:00:41.926 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: Not supported by crimson yet. Skipped 2023-11-29T09:00:41.926 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [ SKIPPED ] LibRadosMiscECPP.CompareExtentRange (0 ms) 2023-11-29T09:00:41.926 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/testcase_cxx.cc:381: Skipped 2023-11-29T09:00:41.926 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: Not supported by crimson yet. Skipped 2023-11-29T09:00:41.926 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP (0 ms total) 2023-11-29T09:00:41.926 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: 2023-11-29T09:00:41.926 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [----------] Global test environment tear-down 2023-11-29T09:00:41.927 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [==========] 31 tests from 7 test suites ran. (191415 ms total) 2023-11-29T09:00:41.927 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [ PASSED ] 27 tests. 2023-11-29T09:00:41.927 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [ SKIPPED ] 4 tests, listed below: 2023-11-29T09:00:41.927 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [ SKIPPED ] LibRadosMiscPP.CopyPP 2023-11-29T09:00:41.927 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [ SKIPPED ] LibRadosMiscPP.CopyScrubPP 2023-11-29T09:00:41.927 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.CopyFrom 2023-11-29T09:00:41.927 INFO:tasks.workunit.client.0.smithi027.stdout: api_misc_pp: [ SKIPPED ] LibRadosMiscECPP.CompareExtentRange 2023-11-29T09:00:45.207 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~83s 2023-11-29T09:00:50.712 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~88s 2023-11-29T09:00:56.216 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~94s 2023-11-29T09:01:01.721 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~99s 2023-11-29T09:01:07.226 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~105s 2023-11-29T09:01:12.729 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~110s 2023-11-29T09:01:18.234 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~116s 2023-11-29T09:01:23.739 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~121s 2023-11-29T09:01:29.243 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~127s 2023-11-29T09:01:34.748 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~132s 2023-11-29T09:01:40.252 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~138s 2023-11-29T09:01:45.756 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~143s 2023-11-29T09:01:45.907 INFO:tasks.workunit.client.0.smithi027.stdout: delete_pools_parallel: process_1_[85210]: starting. 2023-11-29T09:01:45.907 INFO:tasks.workunit.client.0.smithi027.stdout: delete_pools_parallel: process_1_[85210]: creating pool ceph_test_rados_delete_pools_parallel.smithi027-85178 2023-11-29T09:01:45.907 INFO:tasks.workunit.client.0.smithi027.stdout: delete_pools_parallel: process_1_[85210]: created object 0... 2023-11-29T09:01:45.907 INFO:tasks.workunit.client.0.smithi027.stdout: delete_pools_parallel: process_1_[85210]: created object 25... 2023-11-29T09:01:45.907 INFO:tasks.workunit.client.0.smithi027.stdout: delete_pools_parallel: process_1_[85210]: created object 49... 2023-11-29T09:01:45.907 INFO:tasks.workunit.client.0.smithi027.stdout: delete_pools_parallel: process_1_[85210]: finishing. 2023-11-29T09:01:45.907 INFO:tasks.workunit.client.0.smithi027.stdout: delete_pools_parallel: process_1_[85210]: shutting down. 2023-11-29T09:01:45.908 INFO:tasks.workunit.client.0.smithi027.stdout: delete_pools_parallel: process_2_[85211]: starting. 2023-11-29T09:01:45.908 INFO:tasks.workunit.client.0.smithi027.stdout: delete_pools_parallel: process_2_[85211]: deleting pool ceph_test_rados_delete_pools_parallel.smithi027-85178 2023-11-29T09:01:45.908 INFO:tasks.workunit.client.0.smithi027.stdout: delete_pools_parallel: process_2_[85211]: shutting down. 2023-11-29T09:01:45.908 INFO:tasks.workunit.client.0.smithi027.stdout: delete_pools_parallel: ******************************* 2023-11-29T09:01:45.908 INFO:tasks.workunit.client.0.smithi027.stdout: delete_pools_parallel: process_3_[148134]: starting. 2023-11-29T09:01:45.908 INFO:tasks.workunit.client.0.smithi027.stdout: delete_pools_parallel: process_3_[148134]: creating pool ceph_test_rados_delete_pools_parallel.smithi027-85178 2023-11-29T09:01:45.908 INFO:tasks.workunit.client.0.smithi027.stdout: delete_pools_parallel: process_3_[148134]: created object 0... 2023-11-29T09:01:45.908 INFO:tasks.workunit.client.0.smithi027.stdout: delete_pools_parallel: process_3_[148134]: created object 25... 2023-11-29T09:01:45.908 INFO:tasks.workunit.client.0.smithi027.stdout: delete_pools_parallel: process_3_[148134]: created object 49... 2023-11-29T09:01:45.908 INFO:tasks.workunit.client.0.smithi027.stdout: delete_pools_parallel: process_3_[148134]: finishing. 2023-11-29T09:01:45.908 INFO:tasks.workunit.client.0.smithi027.stdout: delete_pools_parallel: process_3_[148134]: shutting down. 2023-11-29T09:01:45.908 INFO:tasks.workunit.client.0.smithi027.stdout: delete_pools_parallel: ******************************* 2023-11-29T09:01:45.908 INFO:tasks.workunit.client.0.smithi027.stdout: delete_pools_parallel: process_5_[148136]: starting. 2023-11-29T09:01:45.909 INFO:tasks.workunit.client.0.smithi027.stdout: delete_pools_parallel: process_5_[148136]: listing objects. 2023-11-29T09:01:45.909 INFO:tasks.workunit.client.0.smithi027.stdout: delete_pools_parallel: process_5_[148136]: listed object 0... 2023-11-29T09:01:45.909 INFO:tasks.workunit.client.0.smithi027.stdout: delete_pools_parallel: process_5_[148136]: listed object 25... 2023-11-29T09:01:45.909 INFO:tasks.workunit.client.0.smithi027.stdout: delete_pools_parallel: process_5_[148136]: saw 50 objects 2023-11-29T09:01:45.909 INFO:tasks.workunit.client.0.smithi027.stdout: delete_pools_parallel: process_5_[148136]: shutting down. 2023-11-29T09:01:45.909 INFO:tasks.workunit.client.0.smithi027.stdout: delete_pools_parallel: ******************************* 2023-11-29T09:01:45.909 INFO:tasks.workunit.client.0.smithi027.stdout: delete_pools_parallel: process_4_[148135]: starting. 2023-11-29T09:01:45.909 INFO:tasks.workunit.client.0.smithi027.stdout: delete_pools_parallel: process_4_[148135]: deleting pool ceph_test_rados_delete_pools_parallel.smithi027-85178 2023-11-29T09:01:45.909 INFO:tasks.workunit.client.0.smithi027.stdout: delete_pools_parallel: process_4_[148135]: shutting down. 2023-11-29T09:01:45.909 INFO:tasks.workunit.client.0.smithi027.stdout: delete_pools_parallel: ******************************* 2023-11-29T09:01:45.909 INFO:tasks.workunit.client.0.smithi027.stdout: delete_pools_parallel: ******************************* 2023-11-29T09:01:45.909 INFO:tasks.workunit.client.0.smithi027.stdout: delete_pools_parallel: ******* SUCCESS ********** 2023-11-29T09:01:45.909 INFO:tasks.workunit.client.0.smithi027.stdout: open_pools_parallel: process_1_[85175]: starting. 2023-11-29T09:01:45.910 INFO:tasks.workunit.client.0.smithi027.stdout: open_pools_parallel: process_1_[85175]: creating pool ceph_test_rados_open_pools_parallel.smithi027-85129 2023-11-29T09:01:45.910 INFO:tasks.workunit.client.0.smithi027.stdout: open_pools_parallel: process_1_[85175]: created object 0... 2023-11-29T09:01:45.910 INFO:tasks.workunit.client.0.smithi027.stdout: open_pools_parallel: process_1_[85175]: created object 25... 2023-11-29T09:01:45.910 INFO:tasks.workunit.client.0.smithi027.stdout: open_pools_parallel: process_1_[85175]: created object 49... 2023-11-29T09:01:45.910 INFO:tasks.workunit.client.0.smithi027.stdout: open_pools_parallel: process_1_[85175]: finishing. 2023-11-29T09:01:45.910 INFO:tasks.workunit.client.0.smithi027.stdout: open_pools_parallel: process_1_[85175]: shutting down. 2023-11-29T09:01:45.910 INFO:tasks.workunit.client.0.smithi027.stdout: open_pools_parallel: process_2_[85176]: starting. 2023-11-29T09:01:45.910 INFO:tasks.workunit.client.0.smithi027.stdout: open_pools_parallel: process_2_[85176]: rados_pool_create. 2023-11-29T09:01:45.910 INFO:tasks.workunit.client.0.smithi027.stdout: open_pools_parallel: process_2_[85176]: rados_ioctx_create. 2023-11-29T09:01:45.910 INFO:tasks.workunit.client.0.smithi027.stdout: open_pools_parallel: process_2_[85176]: shutting down. 2023-11-29T09:01:45.910 INFO:tasks.workunit.client.0.smithi027.stdout: open_pools_parallel: ******************************* 2023-11-29T09:01:45.910 INFO:tasks.workunit.client.0.smithi027.stdout: open_pools_parallel: process_3_[148204]: starting. 2023-11-29T09:01:45.911 INFO:tasks.workunit.client.0.smithi027.stdout: open_pools_parallel: process_3_[148204]: creating pool ceph_test_rados_open_pools_parallel.smithi027-85129 2023-11-29T09:01:45.911 INFO:tasks.workunit.client.0.smithi027.stdout: open_pools_parallel: process_3_[148204]: created object 0... 2023-11-29T09:01:45.911 INFO:tasks.workunit.client.0.smithi027.stdout: open_pools_parallel: process_3_[148204]: created object 25... 2023-11-29T09:01:45.911 INFO:tasks.workunit.client.0.smithi027.stdout: open_pools_parallel: process_3_[148204]: created object 49... 2023-11-29T09:01:45.911 INFO:tasks.workunit.client.0.smithi027.stdout: open_pools_parallel: process_3_[148204]: finishing. 2023-11-29T09:01:45.911 INFO:tasks.workunit.client.0.smithi027.stdout: open_pools_parallel: process_3_[148204]: shutting down. 2023-11-29T09:01:45.911 INFO:tasks.workunit.client.0.smithi027.stdout: open_pools_parallel: ******************************* 2023-11-29T09:01:45.911 INFO:tasks.workunit.client.0.smithi027.stdout: open_pools_parallel: process_4_[148205]: starting. 2023-11-29T09:01:45.911 INFO:tasks.workunit.client.0.smithi027.stdout: open_pools_parallel: process_4_[148205]: rados_pool_create. 2023-11-29T09:01:45.911 INFO:tasks.workunit.client.0.smithi027.stdout: open_pools_parallel: process_4_[148205]: rados_ioctx_create. 2023-11-29T09:01:45.911 INFO:tasks.workunit.client.0.smithi027.stdout: open_pools_parallel: process_4_[148205]: shutting down. 2023-11-29T09:01:45.911 INFO:tasks.workunit.client.0.smithi027.stdout: open_pools_parallel: ******************************* 2023-11-29T09:01:45.912 INFO:tasks.workunit.client.0.smithi027.stdout: open_pools_parallel: ******************************* 2023-11-29T09:01:45.912 INFO:tasks.workunit.client.0.smithi027.stdout: open_pools_parallel: ******* SUCCESS ********** 2023-11-29T09:01:45.913 INFO:tasks.workunit.client.0.smithi027.stderr:+ for t in "${!pids[@]}" 2023-11-29T09:01:45.913 INFO:tasks.workunit.client.0.smithi027.stderr:+ pid=84816 2023-11-29T09:01:45.913 INFO:tasks.workunit.client.0.smithi027.stderr:+ wait 84816 2023-11-29T09:01:45.914 INFO:tasks.workunit.client.0.smithi027.stderr:+ for t in "${!pids[@]}" 2023-11-29T09:01:45.914 INFO:tasks.workunit.client.0.smithi027.stderr:+ pid=84631 2023-11-29T09:01:45.914 INFO:tasks.workunit.client.0.smithi027.stderr:+ wait 84631 2023-11-29T09:01:45.914 INFO:tasks.workunit.client.0.smithi027.stderr:+ for t in "${!pids[@]}" 2023-11-29T09:01:45.914 INFO:tasks.workunit.client.0.smithi027.stderr:+ pid=84410 2023-11-29T09:01:45.914 INFO:tasks.workunit.client.0.smithi027.stderr:+ wait 84410 2023-11-29T09:01:45.914 INFO:tasks.workunit.client.0.smithi027.stderr:+ for t in "${!pids[@]}" 2023-11-29T09:01:45.914 INFO:tasks.workunit.client.0.smithi027.stderr:+ pid=84713 2023-11-29T09:01:45.914 INFO:tasks.workunit.client.0.smithi027.stderr:+ wait 84713 2023-11-29T09:01:45.914 INFO:tasks.workunit.client.0.smithi027.stderr:+ for t in "${!pids[@]}" 2023-11-29T09:01:45.914 INFO:tasks.workunit.client.0.smithi027.stderr:+ pid=84434 2023-11-29T09:01:45.914 INFO:tasks.workunit.client.0.smithi027.stderr:+ wait 84434 2023-11-29T09:01:45.915 INFO:tasks.workunit.client.0.smithi027.stderr:+ for t in "${!pids[@]}" 2023-11-29T09:01:45.915 INFO:tasks.workunit.client.0.smithi027.stderr:+ pid=85012 2023-11-29T09:01:45.915 INFO:tasks.workunit.client.0.smithi027.stderr:+ wait 85012 2023-11-29T09:01:45.915 INFO:tasks.workunit.client.0.smithi027.stderr:+ for t in "${!pids[@]}" 2023-11-29T09:01:45.915 INFO:tasks.workunit.client.0.smithi027.stderr:+ pid=84302 2023-11-29T09:01:45.915 INFO:tasks.workunit.client.0.smithi027.stderr:+ wait 84302 2023-11-29T09:01:45.915 INFO:tasks.workunit.client.0.smithi027.stderr:+ for t in "${!pids[@]}" 2023-11-29T09:01:45.915 INFO:tasks.workunit.client.0.smithi027.stderr:+ pid=84364 2023-11-29T09:01:45.915 INFO:tasks.workunit.client.0.smithi027.stderr:+ wait 84364 2023-11-29T09:01:45.915 INFO:tasks.workunit.client.0.smithi027.stderr:+ for t in "${!pids[@]}" 2023-11-29T09:01:45.915 INFO:tasks.workunit.client.0.smithi027.stderr:+ pid=85035 2023-11-29T09:01:45.915 INFO:tasks.workunit.client.0.smithi027.stderr:+ wait 85035 2023-11-29T09:01:51.260 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~149s 2023-11-29T09:01:56.765 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~154s 2023-11-29T09:02:02.270 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~160s 2023-11-29T09:02:07.774 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~165s 2023-11-29T09:02:13.278 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~171s 2023-11-29T09:02:18.783 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~176s 2023-11-29T09:02:24.287 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~182s 2023-11-29T09:02:24.610 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: [==========] Running 11 tests from 3 test suites. 2023-11-29T09:02:24.610 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: [----------] Global test environment set-up. 2023-11-29T09:02:24.610 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: [----------] 7 tests from LibRadosList 2023-11-29T09:02:24.610 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: 2023-11-29T08:57:30.453+0000 7f7f2a034940 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T09:02:24.610 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: 2023-11-29T08:57:30.453+0000 7f7f2a034940 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T09:02:24.610 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: 2023-11-29T08:57:30.453+0000 7f7f2a034940 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T09:02:24.610 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: [ RUN ] LibRadosList.ListObjects 2023-11-29T09:02:24.610 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: [ OK ] LibRadosList.ListObjects (17826 ms) 2023-11-29T09:02:24.611 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: [ RUN ] LibRadosList.ListObjectsZeroInName 2023-11-29T09:02:24.611 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: [ OK ] LibRadosList.ListObjectsZeroInName (5912 ms) 2023-11-29T09:02:24.611 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: [ RUN ] LibRadosList.ListObjectsNS 2023-11-29T09:02:24.611 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: myset foo1,foo2,foo3 2023-11-29T09:02:24.611 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: foo1 2023-11-29T09:02:24.611 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: foo2 2023-11-29T09:02:24.611 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: foo3 2023-11-29T09:02:24.611 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: myset foo1,foo4,foo5 2023-11-29T09:02:24.611 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: foo4 2023-11-29T09:02:24.611 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: foo5 2023-11-29T09:02:24.611 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: foo1 2023-11-29T09:02:24.611 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: myset foo6,foo7 2023-11-29T09:02:24.611 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: foo7 2023-11-29T09:02:24.611 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: foo6 2023-11-29T09:02:24.611 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2023-11-29T09:02:24.612 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: ns1:foo4 2023-11-29T09:02:24.612 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: ns1:foo5 2023-11-29T09:02:24.612 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: ns2:foo7 2023-11-29T09:02:24.612 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: ns2:foo6 2023-11-29T09:02:24.612 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: ns1:foo1 2023-11-29T09:02:24.612 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: :foo1 2023-11-29T09:02:24.612 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: :foo2 2023-11-29T09:02:24.612 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: :foo3 2023-11-29T09:02:24.612 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: [ OK ] LibRadosList.ListObjectsNS (71239 ms) 2023-11-29T09:02:24.612 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: [ RUN ] LibRadosList.ListObjectsStart 2023-11-29T09:02:24.612 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: 1 0 2023-11-29T09:02:24.612 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: 10 0 2023-11-29T09:02:24.612 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: 13 0 2023-11-29T09:02:24.612 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: 7 0 2023-11-29T09:02:24.612 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: 14 0 2023-11-29T09:02:24.613 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: 0 0 2023-11-29T09:02:24.613 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: 15 0 2023-11-29T09:02:24.613 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: 11 0 2023-11-29T09:02:24.613 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: 5 0 2023-11-29T09:02:24.613 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: 8 0 2023-11-29T09:02:24.613 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: 6 0 2023-11-29T09:02:24.613 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: 3 0 2023-11-29T09:02:24.613 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: 4 0 2023-11-29T09:02:24.613 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: 12 0 2023-11-29T09:02:24.613 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: 9 0 2023-11-29T09:02:24.613 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: 2 0 2023-11-29T09:02:24.613 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2023-11-29T09:02:24.613 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: [ OK ] LibRadosList.ListObjectsStart (158714 ms) 2023-11-29T09:02:24.613 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: [ RUN ] LibRadosList.ListObjectsCursor 2023-11-29T09:02:24.613 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: x cursor=MIN 2023-11-29T09:02:24.613 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: > oid=1 cursor=8:02547ec2:::1:head 2023-11-29T09:02:24.614 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: > oid=10 cursor=8:52ea6a34:::10:head 2023-11-29T09:02:24.614 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: > oid=13 cursor=8:566253c9:::13:head 2023-11-29T09:02:24.614 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: > oid=7 cursor=8:5c6b0b28:::7:head 2023-11-29T09:02:24.614 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: > oid=14 cursor=8:62a1935d:::14:head 2023-11-29T09:02:24.614 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: > oid=0 cursor=8:6cac518f:::0:head 2023-11-29T09:02:24.614 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: > oid=15 cursor=8:863748b0:::15:head 2023-11-29T09:02:24.614 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: > oid=11 cursor=8:89d3ae78:::11:head 2023-11-29T09:02:24.614 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: > oid=5 cursor=8:b29083e3:::5:head 2023-11-29T09:02:24.614 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: > oid=8 cursor=8:bd63b0f1:::8:head 2023-11-29T09:02:24.614 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: > oid=6 cursor=8:c4fdafeb:::6:head 2023-11-29T09:02:24.614 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: > oid=3 cursor=8:cfc208b3:::3:head 2023-11-29T09:02:24.614 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: > oid=4 cursor=8:d83876eb:::4:head 2023-11-29T09:02:24.614 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: > oid=12 cursor=8:de5d7c5f:::12:head 2023-11-29T09:02:24.614 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: > oid=9 cursor=8:e960b815:::9:head 2023-11-29T09:02:24.614 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: > oid=2 cursor=8:f905c69b:::2:head 2023-11-29T09:02:24.615 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: FIRST> seek to MIN oid=1 2023-11-29T09:02:24.615 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: : oid=1 cursor=8:02547ec2:::1:head 2023-11-29T09:02:24.615 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: : seek to 8:02547ec2:::1:head 2023-11-29T09:02:24.615 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: > 8:02547ec2:::1:head -> 1 2023-11-29T09:02:24.615 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: : oid=10 cursor=8:52ea6a34:::10:head 2023-11-29T09:02:24.615 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: : seek to 8:52ea6a34:::10:head 2023-11-29T09:02:29.792 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~187s 2023-11-29T09:02:35.297 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~193s 2023-11-29T09:02:40.801 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~198s 2023-11-29T09:02:46.306 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~204s 2023-11-29T09:02:51.810 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~209s 2023-11-29T09:02:57.315 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~215s 2023-11-29T09:03:02.820 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~220s 2023-11-29T09:03:08.324 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~226s 2023-11-29T09:03:13.828 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~231s 2023-11-29T09:03:19.333 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~237s 2023-11-29T09:03:24.838 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~242s 2023-11-29T09:03:30.343 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~248s 2023-11-29T09:03:35.848 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~253s 2023-11-29T09:03:41.082 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: > 8:52ea6a34:::10:head -> 10 2023-11-29T09:03:41.083 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: : oid=13 cursor=8:566253c9:::13:head 2023-11-29T09:03:41.083 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: : seek to 8:566253c9:::13:head 2023-11-29T09:03:41.083 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: > 8:566253c9:::13:head -> 13 2023-11-29T09:03:41.083 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: : oid=7 cursor=8:5c6b0b28:::7:head 2023-11-29T09:03:41.083 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: : seek to 8:5c6b0b28:::7:head 2023-11-29T09:03:41.083 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: > 8:5c6b0b28:::7:head -> 7 2023-11-29T09:03:41.083 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: : oid=14 cursor=8:62a1935d:::14:head 2023-11-29T09:03:41.083 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: : seek to 8:62a1935d:::14:head 2023-11-29T09:03:41.083 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: > 8:62a1935d:::14:head -> 14 2023-11-29T09:03:41.083 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: : oid=0 cursor=8:6cac518f:::0:head 2023-11-29T09:03:41.083 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: : seek to 8:6cac518f:::0:head 2023-11-29T09:03:41.083 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: > 8:6cac518f:::0:head -> 0 2023-11-29T09:03:41.083 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: : oid=15 cursor=8:863748b0:::15:head 2023-11-29T09:03:41.083 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: : seek to 8:863748b0:::15:head 2023-11-29T09:03:41.083 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: > 8:863748b0:::15:head -> 15 2023-11-29T09:03:41.084 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: : oid=11 cursor=8:89d3ae78:::11:head 2023-11-29T09:03:41.084 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: : seek to 8:89d3ae78:::11:head 2023-11-29T09:03:41.084 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: > 8:89d3ae78:::11:head -> 11 2023-11-29T09:03:41.084 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: : oid=5 cursor=8:b29083e3:::5:head 2023-11-29T09:03:41.084 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: : seek to 8:b29083e3:::5:head 2023-11-29T09:03:41.084 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: > 8:b29083e3:::5:head -> 5 2023-11-29T09:03:41.084 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: : oid=8 cursor=8:bd63b0f1:::8:head 2023-11-29T09:03:41.084 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: : seek to 8:bd63b0f1:::8:head 2023-11-29T09:03:41.084 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: > 8:bd63b0f1:::8:head -> 8 2023-11-29T09:03:41.084 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: : oid=6 cursor=8:c4fdafeb:::6:head 2023-11-29T09:03:41.084 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: : seek to 8:c4fdafeb:::6:head 2023-11-29T09:03:41.084 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: > 8:c4fdafeb:::6:head -> 6 2023-11-29T09:03:41.084 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: : oid=3 cursor=8:cfc208b3:::3:head 2023-11-29T09:03:41.084 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: : seek to 8:cfc208b3:::3:head 2023-11-29T09:03:41.084 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: > 8:cfc208b3:::3:head -> 3 2023-11-29T09:03:41.084 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: : oid=4 cursor=8:d83876eb:::4:head 2023-11-29T09:03:41.085 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: : seek to 8:d83876eb:::4:head 2023-11-29T09:03:41.085 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: > 8:d83876eb:::4:head -> 4 2023-11-29T09:03:41.085 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: : oid=12 cursor=8:de5d7c5f:::12:head 2023-11-29T09:03:41.085 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: : seek to 8:de5d7c5f:::12:head 2023-11-29T09:03:41.085 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: > 8:de5d7c5f:::12:head -> 12 2023-11-29T09:03:41.085 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: : oid=9 cursor=8:e960b815:::9:head 2023-11-29T09:03:41.085 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: : seek to 8:e960b815:::9:head 2023-11-29T09:03:41.085 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: > 8:e960b815:::9:head -> 9 2023-11-29T09:03:41.085 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: : oid=2 cursor=8:f905c69b:::2:head 2023-11-29T09:03:41.085 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: : seek to 8:f905c69b:::2:head 2023-11-29T09:03:41.085 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: > 8:f905c69b:::2:head -> 2 2023-11-29T09:03:41.085 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: : seek to 8:b29083e3:::5:head 2023-11-29T09:03:41.085 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: : cursor()=8:b29083e3:::5:head expected=8:b29083e3:::5:head 2023-11-29T09:03:41.085 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: > 8:b29083e3:::5:head -> 5 2023-11-29T09:03:41.085 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: : entry=5 expected=5 2023-11-29T09:03:41.085 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: : seek to 8:89d3ae78:::11:head 2023-11-29T09:03:41.086 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: : cursor()=8:89d3ae78:::11:head expected=8:89d3ae78:::11:head 2023-11-29T09:03:41.086 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: > 8:89d3ae78:::11:head -> 11 2023-11-29T09:03:41.086 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: : entry=11 expected=11 2023-11-29T09:03:41.086 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: : seek to 8:863748b0:::15:head 2023-11-29T09:03:41.086 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: : cursor()=8:863748b0:::15:head expected=8:863748b0:::15:head 2023-11-29T09:03:41.086 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: > 8:863748b0:::15:head -> 15 2023-11-29T09:03:41.086 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: : entry=15 expected=15 2023-11-29T09:03:41.086 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: : seek to 8:6cac518f:::0:head 2023-11-29T09:03:41.086 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: : cursor()=8:6cac518f:::0:head expected=8:6cac518f:::0:head 2023-11-29T09:03:41.086 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: > 8:6cac518f:::0:head -> 0 2023-11-29T09:03:41.086 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: : entry=0 expected=0 2023-11-29T09:03:41.086 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: : seek to 8:52ea6a34:::10:head 2023-11-29T09:03:41.086 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: : cursor()=8:52ea6a34:::10:head expected=8:52ea6a34:::10:head 2023-11-29T09:03:41.086 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: > 8:52ea6a34:::10:head -> 10 2023-11-29T09:03:41.086 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: : entry=10 expected=10 2023-11-29T09:03:41.086 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: : seek to 8:f905c69b:::2:head 2023-11-29T09:03:41.087 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: : cursor()=8:f905c69b:::2:head expected=8:f905c69b:::2:head 2023-11-29T09:03:41.087 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: > 8:f905c69b:::2:head -> 2 2023-11-29T09:03:41.087 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: : entry=2 expected=2 2023-11-29T09:03:41.087 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: : seek to 8:e960b815:::9:head 2023-11-29T09:03:41.227 INFO:tasks.workunit.client.0.smithi027.stdout: api_list: : cursor()=8:e960b8 api_aio: Running main() from gmock_main.cc 2023-11-29T09:03:41.227 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [==========] Running 42 tests from 2 test suites. 2023-11-29T09:03:41.227 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [----------] Global test environment set-up. 2023-11-29T09:03:41.227 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [----------] 26 tests from LibRadosAio 2023-11-29T09:03:41.227 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ RUN ] LibRadosAio.TooBig 2023-11-29T09:03:41.227 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ OK ] LibRadosAio.TooBig (2505 ms) 2023-11-29T09:03:41.227 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ RUN ] LibRadosAio.SimpleWrite 2023-11-29T09:03:41.227 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ OK ] LibRadosAio.SimpleWrite (20966 ms) 2023-11-29T09:03:41.227 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ RUN ] LibRadosAio.WaitForSafe 2023-11-29T09:03:41.227 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ OK ] LibRadosAio.WaitForSafe (3018 ms) 2023-11-29T09:03:41.227 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip 2023-11-29T09:03:41.227 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip (5012 ms) 2023-11-29T09:03:41.227 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip2 2023-11-29T09:03:41.228 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip2 (48972 ms) 2023-11-29T09:03:41.228 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip3 2023-11-29T09:03:41.228 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip3 (6035 ms) 2023-11-29T09:03:41.228 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripAppend 2023-11-29T09:03:41.228 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ OK ] LibRadosAio.RoundTripAppend (4967 ms) 2023-11-29T09:03:41.228 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ RUN ] LibRadosAio.RemoveTest 2023-11-29T09:03:41.228 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ OK ] LibRadosAio.RemoveTest (46001 ms) 2023-11-29T09:03:41.228 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ RUN ] LibRadosAio.XattrsRoundTrip 2023-11-29T09:03:41.228 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ OK ] LibRadosAio.XattrsRoundTrip (23077 ms) 2023-11-29T09:03:41.228 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ RUN ] LibRadosAio.RmXattr 2023-11-29T09:03:41.228 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ OK ] LibRadosAio.RmXattr (11933 ms) 2023-11-29T09:03:41.228 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ RUN ] LibRadosAio.XattrIter 2023-11-29T09:03:41.228 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ OK ] LibRadosAio.XattrIter (18045 ms) 2023-11-29T09:03:41.228 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ RUN ] LibRadosAio.IsComplete 2023-11-29T09:03:41.228 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ OK ] LibRadosAio.IsComplete (19079 ms) 2023-11-29T09:03:41.229 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ RUN ] LibRadosAio.IsSafe 2023-11-29T09:03:41.229 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ OK ] LibRadosAio.IsSafe (12891 ms) 2023-11-29T09:03:41.229 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ RUN ] LibRadosAio.ReturnValue 2023-11-29T09:03:41.229 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ OK ] LibRadosAio.ReturnValue (3008 ms) 2023-11-29T09:03:41.229 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ RUN ] LibRadosAio.Flush 2023-11-29T09:03:41.229 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ OK ] LibRadosAio.Flush (10003 ms) 2023-11-29T09:03:41.229 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ RUN ] LibRadosAio.FlushAsync 2023-11-29T09:03:41.229 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ OK ] LibRadosAio.FlushAsync (3017 ms) 2023-11-29T09:03:41.229 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteFull 2023-11-29T09:03:41.229 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteFull (16987 ms) 2023-11-29T09:03:41.229 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteSame 2023-11-29T09:03:41.229 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteSame (16006 ms) 2023-11-29T09:03:41.229 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStat 2023-11-29T09:03:41.229 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ OK ] LibRadosAio.SimpleStat (23031 ms) 2023-11-29T09:03:41.230 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ RUN ] LibRadosAio.OperateMtime 2023-11-29T09:03:41.230 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ OK ] LibRadosAio.OperateMtime (3016 ms) 2023-11-29T09:03:41.230 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ RUN ] LibRadosAio.Operate2Mtime 2023-11-29T09:03:41.230 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ OK ] LibRadosAio.Operate2Mtime (9286 ms) 2023-11-29T09:03:41.230 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStatNS 2023-11-29T09:03:41.230 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ OK ] LibRadosAio.SimpleStatNS (11676 ms) 2023-11-29T09:03:41.230 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ RUN ] LibRadosAio.StatRemove 2023-11-29T09:03:41.230 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ OK ] LibRadosAio.StatRemove (3012 ms) 2023-11-29T09:03:41.230 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ RUN ] LibRadosAio.ExecuteClass 2023-11-29T09:03:41.230 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ OK ] LibRadosAio.ExecuteClass (22016 ms) 2023-11-29T09:03:41.230 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ RUN ] LibRadosAio.MultiWrite 2023-11-29T09:03:41.230 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ OK ] LibRadosAio.MultiWrite (18984 ms) 2023-11-29T09:03:41.230 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ RUN ] LibRadosAio.AioUnlock 2023-11-29T09:03:41.230 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ OK ] LibRadosAio.AioUnlock (8297 ms) 2023-11-29T09:03:41.230 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [----------] 26 tests from LibRadosAio (370841 ms total) 2023-11-29T09:03:41.231 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: 2023-11-29T09:03:41.231 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [----------] 16 tests from LibRadosAioEC 2023-11-29T09:03:41.231 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleWrite 2023-11-29T09:03:41.231 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/aio.cc:1100: Skipped 2023-11-29T09:03:41.231 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: Not supported by crimson yet. Skipped 2023-11-29T09:03:41.231 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.SimpleWrite (0 ms) 2023-11-29T09:03:41.231 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ RUN ] LibRadosAioEC.WaitForComplete 2023-11-29T09:03:41.231 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/aio.cc:1132: Skipped 2023-11-29T09:03:41.231 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: Not supported by crimson yet. Skipped 2023-11-29T09:03:41.231 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.WaitForComplete (0 ms) 2023-11-29T09:03:41.231 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTrip 2023-11-29T09:03:41.231 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/aio.cc:1149: Skipped 2023-11-29T09:03:41.231 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: Not supported by crimson yet. Skipped 2023-11-29T09:03:41.231 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.RoundTrip (0 ms) 2023-11-29T09:03:41.231 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTrip2 2023-11-29T09:03:41.232 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/aio.cc:1182: Skipped 2023-11-29T09:03:41.232 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: Not supported by crimson yet. Skipped 2023-11-29T09:03:41.232 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.RoundTrip2 (0 ms) 2023-11-29T09:03:41.232 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripAppend 2023-11-29T09:03:41.232 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/aio.cc:1215: Skipped 2023-11-29T09:03:41.232 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: Not supported by crimson yet. Skipped 2023-11-29T09:03:41.232 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.RoundTripAppend (0 ms) 2023-11-29T09:03:41.232 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ RUN ] LibRadosAioEC.IsComplete 2023-11-29T09:03:41.232 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/aio.cc:1286: Skipped 2023-11-29T09:03:41.232 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: Not supported by crimson yet. Skipped 2023-11-29T09:03:41.232 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.IsComplete (0 ms) 2023-11-29T09:03:41.232 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ RUN ] LibRadosAioEC.IsSafe 2023-11-29T09:03:41.232 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/aio.cc:1326: Skipped 2023-11-29T09:03:41.232 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: Not supported by crimson yet. Skipped 2023-11-29T09:03:41.232 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.IsSafe (0 ms) 2023-11-29T09:03:41.232 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ RUN ] LibRadosAioEC.ReturnValue 2023-11-29T09:03:41.233 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/aio.cc:1366: Skipped 2023-11-29T09:03:41.233 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: Not supported by crimson yet. Skipped 2023-11-29T09:03:41.233 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.ReturnValue (0 ms) 2023-11-29T09:03:41.233 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ RUN ] LibRadosAioEC.Flush 2023-11-29T09:03:41.233 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/aio.cc:1385: Skipped 2023-11-29T09:03:41.233 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: Not supported by crimson yet. Skipped 2023-11-29T09:03:41.233 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.Flush (0 ms) 2023-11-29T09:03:41.234 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ RUN ] LibRadosAioEC.FlushAsync 2023-11-29T09:03:41.234 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/aio.cc:1415: Skipped 2023-11-29T09:03:41.234 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: Not supported by crimson yet. Skipped 2023-11-29T09:03:41.234 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.FlushAsync (0 ms) 2023-11-29T09:03:41.234 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripWriteFull 2023-11-29T09:03:41.234 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/aio.cc:1454: Skipped 2023-11-29T09:03:41.234 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: Not supported by crimson yet. Skipped 2023-11-29T09:03:41.234 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.RoundTripWriteFull (0 ms) 2023-11-29T09:03:41.234 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStat 2023-11-29T09:03:41.234 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/aio.cc:1498: Skipped 2023-11-29T09:03:41.234 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: Not supported by crimson yet. Skipped 2023-11-29T09:03:41.234 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.SimpleStat (0 ms) 2023-11-29T09:03:41.234 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStatNS 2023-11-29T09:03:41.234 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/aio.cc:1532: Skipped 2023-11-29T09:03:41.234 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: Not supported by crimson yet. Skipped 2023-11-29T09:03:41.235 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.SimpleStatNS (0 ms) 2023-11-29T09:03:41.235 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ RUN ] LibRadosAioEC.StatRemove 2023-11-29T09:03:41.235 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/aio.cc:1593: Skipped 2023-11-29T09:03:41.235 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: Not supported by crimson yet. Skipped 2023-11-29T09:03:41.235 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.StatRemove (0 ms) 2023-11-29T09:03:41.235 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ RUN ] LibRadosAioEC.ExecuteClass 2023-11-29T09:03:41.235 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/aio.cc:1649: Skipped 2023-11-29T09:03:41.235 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: Not supported by crimson yet. Skipped 2023-11-29T09:03:41.235 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.ExecuteClass (0 ms) 2023-11-29T09:03:41.235 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ RUN ] LibRadosAioEC.MultiWrite 2023-11-29T09:03:41.235 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7483-g412bfade/rpm/el9/BUILD/ceph-18.0.0-7483-g412bfade/src/test/librados/aio.cc:1681: Skipped 2023-11-29T09:03:41.235 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: Not supported by crimson yet. Skipped 2023-11-29T09:03:41.235 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.MultiWrite (1 ms) 2023-11-29T09:03:41.235 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [----------] 16 tests from LibRadosAioEC (1 ms total) 2023-11-29T09:03:41.235 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: 2023-11-29T09:03:41.236 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [----------] Global test environment tear-down 2023-11-29T09:03:41.236 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [==========] 42 tests from 2 test suites ran. (370842 ms total) 2023-11-29T09:03:41.236 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ PASSED ] 26 tests. 2023-11-29T09:03:41.236 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ SKIPPED ] 16 tests, listed below: 2023-11-29T09:03:41.236 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.SimpleWrite 2023-11-29T09:03:41.236 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.WaitForComplete 2023-11-29T09:03:41.236 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.RoundTrip 2023-11-29T09:03:41.236 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.RoundTrip2 2023-11-29T09:03:41.236 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.RoundTripAppend 2023-11-29T09:03:41.236 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.IsComplete 2023-11-29T09:03:41.236 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.IsSafe 2023-11-29T09:03:41.236 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.ReturnValue 2023-11-29T09:03:41.236 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.Flush 2023-11-29T09:03:41.236 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.FlushAsync 2023-11-29T09:03:41.236 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.RoundTripWriteFull 2023-11-29T09:03:41.236 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.SimpleStat 2023-11-29T09:03:41.236 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.SimpleStatNS 2023-11-29T09:03:41.237 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.StatRemove 2023-11-29T09:03:41.237 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.ExecuteClass 2023-11-29T09:03:41.237 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.MultiWrite 2023-11-29T09:03:41.351 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~259s 2023-11-29T09:03:46.858 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~264s 2023-11-29T09:03:52.361 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~270s 2023-11-29T09:03:57.865 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~275s 2023-11-29T09:04:00.744 INFO:tasks.workunit.client.0.smithi027.stdout: list_parallel: process_1_[85195]: starting. 2023-11-29T09:04:00.744 INFO:tasks.workunit.client.0.smithi027.stdout: list_parallel: process_1_[85195]: creating pool ceph_test_rados_list_parallel.smithi027-85136 2023-11-29T09:04:00.744 INFO:tasks.workunit.client.0.smithi027.stdout: list_parallel: process_1_[85195]: created object 0... 2023-11-29T09:04:00.744 INFO:tasks.workunit.client.0.smithi027.stdout: list_parallel: process_1_[85195]: created object 25... 2023-11-29T09:04:00.745 INFO:tasks.workunit.client.0.smithi027.stdout: list_parallel: process_1_[85195]: created object 49... 2023-11-29T09:04:00.745 INFO:tasks.workunit.client.0.smithi027.stdout: list_parallel: process_1_[85195]: finishing. 2023-11-29T09:04:00.745 INFO:tasks.workunit.client.0.smithi027.stdout: list_parallel: process_1_[85195]: shutting down. 2023-11-29T09:04:00.745 INFO:tasks.workunit.client.0.smithi027.stdout: list_parallel: process_2_[85196]: starting. 2023-11-29T09:04:00.745 INFO:tasks.workunit.client.0.smithi027.stdout: list_parallel: process_2_[85196]: listing objects. 2023-11-29T09:04:00.745 INFO:tasks.workunit.client.0.smithi027.stdout: list_parallel: process_2_[85196]: listed object 0... 2023-11-29T09:04:00.745 INFO:tasks.workunit.client.0.smithi027.stdout: list_parallel: process_2_[85196]: listed object 25... 2023-11-29T09:04:00.745 INFO:tasks.workunit.client.0.smithi027.stdout: list_parallel: process_2_[85196]: saw 50 objects 2023-11-29T09:04:00.745 INFO:tasks.workunit.client.0.smithi027.stdout: list_parallel: process_2_[85196]: shutting down. 2023-11-29T09:04:00.745 INFO:tasks.workunit.client.0.smithi027.stdout: list_parallel: ******************************* 2023-11-29T09:04:00.745 INFO:tasks.workunit.client.0.smithi027.stdout: list_parallel: process_3_[148259]: starting. 2023-11-29T09:04:00.745 INFO:tasks.workunit.client.0.smithi027.stdout: list_parallel: process_3_[148259]: creating pool ceph_test_rados_list_parallel.smithi027-85136 2023-11-29T09:04:00.745 INFO:tasks.workunit.client.0.smithi027.stdout: list_parallel: process_3_[148259]: created object 0... 2023-11-29T09:04:00.745 INFO:tasks.workunit.client.0.smithi027.stdout: list_parallel: process_3_[148259]: created object 25... 2023-11-29T09:04:00.745 INFO:tasks.workunit.client.0.smithi027.stdout: list_parallel: process_3_[148259]: created object 49... 2023-11-29T09:04:00.745 INFO:tasks.workunit.client.0.smithi027.stdout: list_parallel: process_3_[148259]: finishing. 2023-11-29T09:04:00.746 INFO:tasks.workunit.client.0.smithi027.stdout: list_parallel: process_3_[148259]: shutting down. 2023-11-29T09:04:00.746 INFO:tasks.workunit.client.0.smithi027.stdout: list_parallel: ******************************* 2023-11-29T09:04:00.746 INFO:tasks.workunit.client.0.smithi027.stdout: list_parallel: process_4_[148260]: starting. 2023-11-29T09:04:00.746 INFO:tasks.workunit.client.0.smithi027.stdout: list_parallel: process_4_[148260]: listing objects. 2023-11-29T09:04:00.746 INFO:tasks.workunit.client.0.smithi027.stdout: list_parallel: process_4_[148260]: listed object 0... 2023-11-29T09:04:00.746 INFO:tasks.workunit.client.0.smithi027.stdout: list_parallel: process_4_[148260]: listed object 25... 2023-11-29T09:04:00.746 INFO:tasks.workunit.client.0.smithi027.stdout: list_parallel: process_4_[148260]: saw 41 objects 2023-11-29T09:04:00.746 INFO:tasks.workunit.client.0.smithi027.stdout: list_parallel: process_4_[148260]: shutting down. 2023-11-29T09:04:00.746 INFO:tasks.workunit.client.0.smithi027.stdout: list_parallel: ******************************* 2023-11-29T09:04:00.746 INFO:tasks.workunit.client.0.smithi027.stdout: list_parallel: process_5_[148261]: starting. 2023-11-29T09:04:00.746 INFO:tasks.workunit.client.0.smithi027.stdout: list_parallel: process_5_[148261]: removed 25 objects... 2023-11-29T09:04:00.746 INFO:tasks.workunit.client.0.smithi027.stdout: list_parallel: process_5_[148261]: removed half of the objects 2023-11-29T09:04:00.746 INFO:tasks.workunit.client.0.smithi027.stdout: list_parallel: process_5_[148261]: removed 50 objects... 2023-11-29T09:04:00.746 INFO:tasks.workunit.client.0.smithi027.stdout: list_parallel: process_5_[148261]: removed 50 objects 2023-11-29T09:04:00.746 INFO:tasks.workunit.client.0.smithi027.stdout: list_parallel: process_5_[148261]: shutting down. 2023-11-29T09:04:00.747 INFO:tasks.workunit.client.0.smithi027.stdout: list_parallel: ******************************* 2023-11-29T09:04:00.747 INFO:tasks.workunit.client.0.smithi027.stdout: list_parallel: ******************************* 2023-11-29T09:04:00.747 INFO:tasks.workunit.client.0.smithi027.stdout: list_parallel: process_6_[148665]: starting. 2023-11-29T09:04:00.747 INFO:tasks.workunit.client.0.smithi027.stdout: list_parallel: process_6_[148665]: creating pool ceph_test_rados_list_parallel.smithi027-85136 2023-11-29T09:04:00.747 INFO:tasks.workunit.client.0.smithi027.stdout: list_parallel: process_6_[148665]: created object 0... 2023-11-29T09:04:00.747 INFO:tasks.workunit.client.0.smithi027.stdout: list_parallel: process_6_[148665]: created object 25... 2023-11-29T09:04:00.747 INFO:tasks.workunit.client.0.smithi027.stdout: list_parallel: process_6_[148665]: created object 49... 2023-11-29T09:04:00.747 INFO:tasks.workunit.client.0.smithi027.stdout: list_parallel: process_6_[148665]: finishing. 2023-11-29T09:04:00.747 INFO:tasks.workunit.client.0.smithi027.stdout: list_parallel: process_6_[148665]: shutting down. 2023-11-29T09:04:00.747 INFO:tasks.workunit.client.0.smithi027.stdout: list_parallel: ******************************* 2023-11-29T09:04:00.747 INFO:tasks.workunit.client.0.smithi027.stdout: list_parallel: ******************************* 2023-11-29T09:04:00.747 INFO:tasks.workunit.client.0.smithi027.stdout: list_parallel: process_7_[148666]: starting. 2023-11-29T09:04:00.747 INFO:tasks.workunit.client.0.smithi027.stdout: list_parallel: process_7_[148666]: listing objects. 2023-11-29T09:04:00.747 INFO:tasks.workunit.client.0.smithi027.stdout: list_parallel: process_7_[148666]: listed object 0... 2023-11-29T09:04:00.747 INFO:tasks.workunit.client.0.smithi027.stdout: list_parallel: process_7_[148666]: listed object 25... 2023-11-29T09:04:00.747 INFO:tasks.workunit.client.0.smithi027.stdout: list_parallel: process_7_[148666]: listed object 50... 2023-11-29T09:04:00.747 INFO:tasks.workunit.client.0.smithi027.stdout: list_parallel: process_7_[148666]: saw 56 objects 2023-11-29T09:04:00.748 INFO:tasks.workunit.client.0.smithi027.stdout: list_parallel: process_7_[148666]: shutting down. 2023-11-29T09:04:00.748 INFO:tasks.workunit.client.0.smithi027.stdout: list_parallel: ******************************* 2023-11-29T09:04:00.748 INFO:tasks.workunit.client.0.smithi027.stdout: list_parallel: ******************************* 2023-11-29T09:04:00.748 INFO:tasks.workunit.client.0.smithi027.stdout: list_parallel: process_8_[148667]: starting. 2023-11-29T09:04:00.748 INFO:tasks.workunit.client.0.smithi027.stdout: list_parallel: process_8_[148667]: added 25 objects... 2023-11-29T09:04:00.748 INFO:tasks.workunit.client.0.smithi027.stdout: list_parallel: process_8_[148667]: added half of the objects 2023-11-29T09:04:00.748 INFO:tasks.workunit.client.0.smithi027.stdout: list_parallel: process_8_[148667]: added 50 objects... 2023-11-29T09:04:00.748 INFO:tasks.workunit.client.0.smithi027.stdout: list_parallel: process_8_[148667]: added 50 objects 2023-11-29T09:04:00.748 INFO:tasks.workunit.client.0.smithi027.stdout: list_parallel: process_8_[148667]: shutting down. 2023-11-29T09:04:00.748 INFO:tasks.workunit.client.0.smithi027.stdout: list_parallel: ******************************* 2023-11-29T09:04:00.748 INFO:tasks.workunit.client.0.smithi027.stdout: list_parallel: ******************************* 2023-11-29T09:04:03.369 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~281s 2023-11-29T09:04:08.873 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~286s 2023-11-29T09:04:14.377 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~292s 2023-11-29T09:04:19.881 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~297s 2023-11-29T09:04:25.386 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~303s 2023-11-29T09:04:25.386 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2023-11-29T09:04:25.890 INFO:tasks.ceph.osd.0:Sent signal 15 2023-11-29T09:04:25.891 INFO:tasks.ceph.osd.2:Sent signal 15 2023-11-29T09:04:25.891 INFO:tasks.ceph.osd.3:Sent signal 15 2023-11-29T09:04:25.891 INFO:tasks.ceph.mon.a:Sent signal 15 2023-11-29T09:04:25.891 INFO:tasks.ceph.mgr.x:Sent signal 15 2023-11-29T09:04:25.892 INFO:tasks.ceph.mon.a.smithi027.stderr:2023-11-29T09:04:25.891+0000 7f12497fc640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 82287) UID: 0 2023-11-29T09:04:25.892 INFO:tasks.ceph.mon.a.smithi027.stderr:2023-11-29T09:04:25.891+0000 7f12497fc640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-11-29T09:04:25.932 INFO:tasks.ceph.mgr.x.smithi139.stderr:2023-11-29T09:04:25.931+0000 7ff9d4bf7640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mgr -f --cluster ceph -i x (PID: 81633) UID: 0 2023-11-29T09:44:18.947 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio_pp: Running main() from gmock_main.cc 2023-11-29T09:44:18.965 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio_pp: [==========] Running 57 tests from 4 test suites. 2023-11-29T09:44:18.965 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio_pp: [----------] Global test environment set-up. 2023-11-29T09:44:18.966 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio_pp: [----------] 32 tests from LibRadosAio 2023-11-29T09:44:18.966 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio_pp: [ RUN ] LibRadosAio.TooBigPP 2023-11-29T09:44:18.966 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio_pp: [ OK ] LibRadosAio.TooBigPP (2494 ms) 2023-11-29T09:44:18.966 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio_pp: [ RUN ] LibRadosAio.PoolQuotaPP 2023-11-29T09:44:18.966 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio_pp: [ OK ] LibRadosAio.PoolQuotaPP (26994 ms) 2023-11-29T09:44:18.966 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleWritePP 2023-11-29T09:44:18.966 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleWritePP (57968 ms) 2023-11-29T09:44:18.966 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio_pp: [ RUN ] LibRadosAio.WaitForSafePP 2023-11-29T09:44:18.966 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio_pp: [ OK ] LibRadosAio.WaitForSafePP (11036 ms) 2023-11-29T09:44:18.967 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP 2023-11-29T09:44:18.967 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP (38975 ms) 2023-11-29T09:44:18.967 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP2 2023-11-29T09:44:18.967 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP2 (3074 ms) 2023-11-29T09:44:18.967 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP3 2023-11-29T09:44:18.967 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP3 (32943 ms) 2023-11-29T09:44:18.967 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripSparseReadPP 2023-11-29T09:44:18.967 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripSparseReadPP (8997 ms) 2023-11-29T09:44:18.968 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsCompletePP 2023-11-29T09:44:18.968 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio_pp: [ OK ] LibRadosAio.IsCompletePP (9045 ms) 2023-11-29T09:44:18.968 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsSafePP 2023-11-29T09:44:18.968 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio_pp: [ OK ] LibRadosAio.IsSafePP (3003 ms) 2023-11-29T09:44:18.968 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio_pp: [ RUN ] LibRadosAio.ReturnValuePP 2023-11-29T09:44:18.968 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio_pp: [ OK ] LibRadosAio.ReturnValuePP (8034 ms) 2023-11-29T09:44:18.968 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushPP 2023-11-29T09:44:18.968 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushPP (13069 ms) 2023-11-29T09:44:18.968 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushAsyncPP 2023-11-29T09:44:18.969 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushAsyncPP (3013 ms) 2023-11-29T09:44:18.969 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP 2023-11-29T09:44:18.969 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP (3015 ms) 2023-11-29T09:44:18.969 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP2 2023-11-29T09:44:18.969 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP2 (33846 ms) 2023-11-29T09:44:18.969 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP 2023-11-29T09:44:18.969 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP (16006 ms) 2023-11-29T09:44:18.969 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP2 2023-11-29T09:44:18.969 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP2 (15999 ms) 2023-11-29T09:44:18.969 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPPNS 2023-11-29T09:44:18.970 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPPNS (47076 ms) 2023-11-29T09:44:18.970 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPP 2023-11-29T09:44:18.970 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPP (8962 ms) 2023-11-29T09:44:18.970 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio_pp: [ RUN ] LibRadosAio.OperateMtime 2023-11-29T09:44:18.970 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio_pp: [ OK ] LibRadosAio.OperateMtime (27281 ms) 2023-11-29T09:44:18.970 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio_pp: [ RUN ] LibRadosAio.OperateMtime2 2023-11-29T09:44:18.970 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio_pp: [ OK ] LibRadosAio.OperateMtime2 (9033 ms) 2023-11-29T09:44:18.970 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio_pp: [ RUN ] LibRadosAio.StatRemovePP 2023-11-29T09:44:18.970 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio_pp: [ OK ] LibRadosAio.StatRemovePP (3687 ms) 2023-11-29T09:44:18.971 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio_pp: [ RUN ] LibRadosAio.ExecuteClassPP 2023-11-29T09:44:18.971 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio_pp: [ OK ] LibRadosAio.ExecuteClassPP (23005 ms) 2023-11-29T09:44:18.971 INFO:tasks.workunit.client.0.smithi027.stdout: api_aio_pp: [ RUN ] LibRadosAio.OmapPP 2023-11-29T09:44:18.971 INFO:tasks.workunit.client.0.smithi027.stderr:bash: line 1: 84374 Alarm clock ceph_test_rados_api_aio_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_aio_pp.xml 2>&1 2023-11-29T09:44:18.972 INFO:tasks.workunit.client.0.smithi027.stderr: 84376 Done | tee ceph_test_rados_api_aio_pp.log 2023-11-29T09:44:18.972 INFO:tasks.workunit.client.0.smithi027.stderr: 84377 Done | sed "s/^/ api_aio_pp: /" 2023-11-29T11:57:30.342 INFO:tasks.workunit.client.0.smithi027.stderr:++ cleanup 2023-11-29T11:57:30.363 INFO:tasks.workunit.client.0.smithi027.stderr:++ pkill -P 84281 2023-11-29T11:57:30.365 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-11-29T11:57:30.365 INFO:tasks.workunit.client.0.smithi027.stderr:++ true 2023-11-29T11:57:30.365 INFO:tasks.workunit:Stopping ['rados/test.sh', 'rados/test_pool_quota.sh'] on client.0... 2023-11-29T11:57:30.366 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-11-29T11:57:30.676 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph_3d760f113bd9f3a2e513474d34227633cd06f1ea/qa/tasks/workunit.py", line 129, in task p.spawn(_run_tests, ctx, refspec, role, tests, File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_ceph_ceph_3d760f113bd9f3a2e513474d34227633cd06f1ea/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test rados/test.sh) on smithi027 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3d760f113bd9f3a2e513474d34227633cd06f1ea TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' 2023-11-29T11:57:30.762 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=5c0b6742985f466d82e215c3dbb4c600 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph_3d760f113bd9f3a2e513474d34227633cd06f1ea/qa/tasks/workunit.py", line 129, in task p.spawn(_run_tests, ctx, refspec, role, tests, File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_ceph_ceph_3d760f113bd9f3a2e513474d34227633cd06f1ea/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test rados/test.sh) on smithi027 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3d760f113bd9f3a2e513474d34227633cd06f1ea TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' 2023-11-29T11:57:30.764 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-11-29T11:57:30.774 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-29T11:57:30.774 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-29T11:57:30.890 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:30.886+0000 7f80d7f9e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-11-29T11:57:30.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:30.890+0000 7f80d7f9e640 1 Processor -- start 2023-11-29T11:57:30.891 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:30.890+0000 7f80d7f9e640 1 -- start start 2023-11-29T11:57:30.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:30.891+0000 7f80d7f9e640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80d0097960 0x7f80d012f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:57:30.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:30.891+0000 7f80d7f9e640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d0098960 con 0x7f80d0097d70 2023-11-29T11:57:30.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:30.891+0000 7f80d7f9e640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d009a2a0 con 0x7f80d0097960 2023-11-29T11:57:30.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:30.891+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80d0097d70 legacy=0x7f80d012f780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:57:30.892 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:30.891+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80d0097960 msgr2=0x7f80d012f240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:57:30.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:30.891+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80d0097960 0x7f80d012f240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-29T11:57:31.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:31.092+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80d0097960 msgr2=0x7f80d012f240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:57:31.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:31.092+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80d0097d70 legacy=0x7f80d012f780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:57:31.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:31.092+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80d0097960 0x7f80d012f240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-29T11:57:31.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:31.493+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80d0097d70 legacy=0x7f80d012f780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:57:31.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:31.493+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80d0097960 msgr2=0x7f80d012f240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:57:31.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:31.493+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80d0097960 0x7f80d012f240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-29T11:57:32.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:32.294+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80d0097960 msgr2=0x7f80d012f240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:57:32.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:32.294+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80d0097d70 legacy=0x7f80d012f780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:57:32.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:32.294+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80d0097960 0x7f80d012f240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-29T11:57:33.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:33.891+0000 7f80c77fe640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80d0097960 msgr2=0x7f80d012f240 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:57:33.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:33.891+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80d0097960 0x7f80d012f240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:57:33.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:33.891+0000 7f80c77fe640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80d0097d70 legacy=0x7f80d012f780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:57:33.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:33.891+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80d0097960 0x7f80b400aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:57:33.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:33.891+0000 7f80c77fe640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d0072800 con 0x7f80d0097d70 2023-11-29T11:57:33.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:33.891+0000 7f80c77fe640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d009a2a0 con 0x7f80d0097960 2023-11-29T11:57:33.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:33.891+0000 7f80d5d3a640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80d0097d70 legacy=0x7f80b4007820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:57:33.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:33.891+0000 7f80d5539640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80d0097960 msgr2=0x7f80b400aff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:57:33.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:33.891+0000 7f80d5539640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80d0097960 0x7f80b400aff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-29T11:57:34.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:34.092+0000 7f80d5539640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80d0097960 msgr2=0x7f80b400aff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:57:34.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:34.092+0000 7f80d5d3a640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80d0097d70 legacy=0x7f80b4007820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:57:34.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:34.092+0000 7f80d5539640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80d0097960 0x7f80b400aff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-29T11:57:34.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:34.493+0000 7f80d5539640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80d0097960 msgr2=0x7f80b400aff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:57:34.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:34.493+0000 7f80d5d3a640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80d0097d70 legacy=0x7f80b4007820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:57:34.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:34.493+0000 7f80d5539640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80d0097960 0x7f80b400aff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-29T11:57:35.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:35.294+0000 7f80d5539640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80d0097960 msgr2=0x7f80b400aff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:57:35.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:35.294+0000 7f80d5d3a640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80d0097d70 legacy=0x7f80b4007820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:57:35.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:35.294+0000 7f80d5539640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80d0097960 0x7f80b400aff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-29T11:57:36.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:36.890+0000 7f80c77fe640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80d0097960 msgr2=0x7f80b400aff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:57:36.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:36.890+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80d0097960 0x7f80b400aff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:57:36.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:36.890+0000 7f80c77fe640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80d0097d70 legacy=0x7f80b4007820 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:57:36.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:36.890+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80d0097960 0x7f80b400aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:57:36.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:36.890+0000 7f80c77fe640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d0098960 con 0x7f80b400b600 2023-11-29T11:57:36.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:36.890+0000 7f80c77fe640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d009a2a0 con 0x7f80d0097960 2023-11-29T11:57:36.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:36.890+0000 7f80d5d3a640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400b600 legacy=0x7f80b400ba50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:57:36.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:36.890+0000 7f80d5539640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80d0097960 msgr2=0x7f80b400aff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:57:36.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:36.890+0000 7f80d5539640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80d0097960 0x7f80b400aff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-29T11:57:37.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:37.091+0000 7f80d5539640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80d0097960 msgr2=0x7f80b400aff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:57:37.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:37.091+0000 7f80d5d3a640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400b600 legacy=0x7f80b400ba50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:57:37.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:37.091+0000 7f80d5539640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80d0097960 0x7f80b400aff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-29T11:57:37.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:37.492+0000 7f80d5539640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80d0097960 msgr2=0x7f80b400aff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:57:37.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:37.492+0000 7f80d5d3a640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400b600 legacy=0x7f80b400ba50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:57:37.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:37.492+0000 7f80d5539640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80d0097960 0x7f80b400aff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-29T11:57:38.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:38.293+0000 7f80d5539640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80d0097960 msgr2=0x7f80b400aff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:57:38.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:38.293+0000 7f80d5d3a640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400b600 legacy=0x7f80b400ba50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:57:38.295 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:38.293+0000 7f80d5539640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80d0097960 0x7f80b400aff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-29T11:57:39.893 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:39.891+0000 7f80c77fe640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80d0097960 msgr2=0x7f80b400aff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:57:39.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:39.891+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80d0097960 0x7f80b400aff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:57:39.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:39.891+0000 7f80c77fe640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400b600 legacy=0x7f80b400ba50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:57:39.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:39.891+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80d0097960 0x7f80b400aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:57:39.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:39.891+0000 7f80c77fe640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d0072800 con 0x7f80b4007f50 2023-11-29T11:57:39.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:39.891+0000 7f80c77fe640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d009a2a0 con 0x7f80d0097960 2023-11-29T11:57:39.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:39.891+0000 7f80d5d3a640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b4007f50 legacy=0x7f80b40077e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:57:39.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:39.891+0000 7f80d5539640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80d0097960 msgr2=0x7f80b400aff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:57:39.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:39.891+0000 7f80d5539640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80d0097960 0x7f80b400aff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-29T11:57:40.093 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:40.092+0000 7f80d5539640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80d0097960 msgr2=0x7f80b400aff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:57:40.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:40.092+0000 7f80d5d3a640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b4007f50 legacy=0x7f80b40077e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:57:40.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:40.092+0000 7f80d5539640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80d0097960 0x7f80b400aff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-29T11:57:40.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:40.493+0000 7f80d5d3a640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b4007f50 legacy=0x7f80b40077e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:57:40.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:40.493+0000 7f80d5539640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80d0097960 msgr2=0x7f80b400aff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:57:40.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:40.493+0000 7f80d5539640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80d0097960 0x7f80b400aff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-29T11:57:41.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:41.294+0000 7f80d5539640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80d0097960 msgr2=0x7f80b400aff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:57:41.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:41.294+0000 7f80d5d3a640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b4007f50 legacy=0x7f80b40077e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:57:41.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:41.294+0000 7f80d5539640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80d0097960 0x7f80b400aff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-29T11:57:42.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:42.891+0000 7f80c77fe640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80d0097960 msgr2=0x7f80b400aff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:57:42.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:42.891+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80d0097960 0x7f80b400aff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:57:42.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:42.891+0000 7f80c77fe640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b4007f50 legacy=0x7f80b40077e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:57:42.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:42.891+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400ba50 0x7f80b4008360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:57:42.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:42.891+0000 7f80c77fe640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d0098960 con 0x7f80b4007f50 2023-11-29T11:57:42.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:42.891+0000 7f80c77fe640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d009a2a0 con 0x7f80b400ba50 2023-11-29T11:57:42.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:42.891+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400ba50 msgr2=0x7f80b4008360 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:57:42.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:42.891+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b4007f50 legacy=0x7f80b40057d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:57:42.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:42.891+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400ba50 0x7f80b4008360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-29T11:57:43.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:43.092+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b4007f50 legacy=0x7f80b40057d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:57:43.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:43.092+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400ba50 msgr2=0x7f80b4008360 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:57:43.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:43.092+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400ba50 0x7f80b4008360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-29T11:57:43.494 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:43.493+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b4007f50 legacy=0x7f80b40057d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:57:43.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:43.493+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400ba50 msgr2=0x7f80b4008360 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:57:43.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:43.493+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400ba50 0x7f80b4008360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-29T11:57:44.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:44.294+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400ba50 msgr2=0x7f80b4008360 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:57:44.298 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:44.294+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b4007f50 legacy=0x7f80b40057d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:57:44.298 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:44.294+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400ba50 0x7f80b4008360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-29T11:57:45.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:45.892+0000 7f80c77fe640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400ba50 msgr2=0x7f80b4008360 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:57:45.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:45.892+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400ba50 0x7f80b4008360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:57:45.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:45.892+0000 7f80c77fe640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b4007f50 legacy=0x7f80b40057d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:57:45.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:45.892+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b40088a0 0x7f80b4007600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:57:45.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:45.892+0000 7f80c77fe640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d0072800 con 0x7f80b400af90 2023-11-29T11:57:45.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:45.892+0000 7f80c77fe640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d009a2a0 con 0x7f80b40088a0 2023-11-29T11:57:45.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:45.892+0000 7f80d5539640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b40088a0 msgr2=0x7f80b4007600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:57:45.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:45.892+0000 7f80d5d3a640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400af90 legacy=0x7f80b4006ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:57:45.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:45.892+0000 7f80d5539640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b40088a0 0x7f80b4007600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-29T11:57:46.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:46.093+0000 7f80d5d3a640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400af90 legacy=0x7f80b4006ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:57:46.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:46.093+0000 7f80d5539640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b40088a0 msgr2=0x7f80b4007600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:57:46.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:46.093+0000 7f80d5539640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b40088a0 0x7f80b4007600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-29T11:57:46.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:46.494+0000 7f80d5539640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b40088a0 msgr2=0x7f80b4007600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:57:46.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:46.494+0000 7f80d5d3a640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400af90 legacy=0x7f80b4006ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:57:46.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:46.494+0000 7f80d5539640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b40088a0 0x7f80b4007600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-29T11:57:47.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:47.295+0000 7f80d5539640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b40088a0 msgr2=0x7f80b4007600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:57:47.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:47.295+0000 7f80d5d3a640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400af90 legacy=0x7f80b4006ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:57:47.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:47.295+0000 7f80d5539640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b40088a0 0x7f80b4007600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-29T11:57:48.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:48.892+0000 7f80c77fe640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b40088a0 msgr2=0x7f80b4007600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:57:48.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:48.892+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b40088a0 0x7f80b4007600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:57:48.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:48.892+0000 7f80c77fe640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400af90 legacy=0x7f80b4006ef0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:57:48.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:48.892+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4008360 0x7f80b40057d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:57:48.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:48.892+0000 7f80c77fe640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d0098960 con 0x7f80b400af90 2023-11-29T11:57:48.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:48.892+0000 7f80c77fe640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d009a2a0 con 0x7f80b4008360 2023-11-29T11:57:48.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:48.892+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4008360 msgr2=0x7f80b40057d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:57:48.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:48.892+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400af90 legacy=0x7f80b400c7d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:57:48.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:48.892+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4008360 0x7f80b40057d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-29T11:57:49.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:49.093+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4008360 msgr2=0x7f80b40057d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:57:49.094 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:49.093+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400af90 legacy=0x7f80b400c7d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:57:49.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:49.093+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4008360 0x7f80b40057d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-29T11:57:49.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:49.494+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400af90 legacy=0x7f80b400c7d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:57:49.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:49.494+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4008360 msgr2=0x7f80b40057d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:57:49.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:49.494+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4008360 0x7f80b40057d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-29T11:57:50.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:50.295+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400af90 legacy=0x7f80b400c7d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:57:50.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:50.295+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4008360 msgr2=0x7f80b40057d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:57:50.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:50.295+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4008360 0x7f80b40057d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-29T11:57:51.894 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:51.892+0000 7f80c77fe640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4008360 msgr2=0x7f80b40057d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:57:51.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:51.892+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4008360 0x7f80b40057d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:57:51.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:51.892+0000 7f80c77fe640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400af90 legacy=0x7f80b400c7d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:57:51.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:51.892+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4011a30 0x7f80b4013e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:57:51.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:51.892+0000 7f80c77fe640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d0072800 con 0x7f80b400def0 2023-11-29T11:57:51.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:51.892+0000 7f80c77fe640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d009a2a0 con 0x7f80b4011a30 2023-11-29T11:57:51.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:51.892+0000 7f80d5d3a640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400def0 legacy=0x7f80b4010310 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:57:51.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:51.892+0000 7f80d5539640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4011a30 msgr2=0x7f80b4013e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:57:51.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:51.892+0000 7f80d5539640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4011a30 0x7f80b4013e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-29T11:57:52.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:52.093+0000 7f80d5d3a640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400def0 legacy=0x7f80b4010310 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:57:52.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:52.093+0000 7f80d5539640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4011a30 msgr2=0x7f80b4013e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:57:52.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:52.093+0000 7f80d5539640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4011a30 0x7f80b4013e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-29T11:57:52.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:52.494+0000 7f80d5539640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4011a30 msgr2=0x7f80b4013e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:57:52.495 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:52.494+0000 7f80d5d3a640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400def0 legacy=0x7f80b4010310 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:57:52.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:52.494+0000 7f80d5539640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4011a30 0x7f80b4013e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-29T11:57:53.296 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:53.295+0000 7f80d5d3a640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400def0 legacy=0x7f80b4010310 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:57:53.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:53.295+0000 7f80d5539640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4011a30 msgr2=0x7f80b4013e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:57:53.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:53.295+0000 7f80d5539640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4011a30 0x7f80b4013e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-29T11:57:54.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:54.893+0000 7f80c77fe640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4011a30 msgr2=0x7f80b4013e50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:57:54.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:54.893+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4011a30 0x7f80b4013e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:57:54.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:54.893+0000 7f80c77fe640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400def0 legacy=0x7f80b4010310 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:57:54.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:54.893+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400c7d0 0x7f80b400cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:57:54.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:54.893+0000 7f80c77fe640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d0098960 con 0x7f80b400d120 2023-11-29T11:57:54.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:54.893+0000 7f80c77fe640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d009a2a0 con 0x7f80b400c7d0 2023-11-29T11:57:54.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:54.893+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d120 legacy=0x7f80b400d530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:57:54.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:54.893+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400c7d0 msgr2=0x7f80b400cbe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:57:54.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:54.893+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400c7d0 0x7f80b400cbe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-29T11:57:55.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:55.094+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d120 legacy=0x7f80b400d530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:57:55.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:55.094+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400c7d0 msgr2=0x7f80b400cbe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:57:55.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:55.094+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400c7d0 0x7f80b400cbe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-29T11:57:55.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:55.495+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d120 legacy=0x7f80b400d530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:57:55.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:55.495+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400c7d0 msgr2=0x7f80b400cbe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:57:55.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:55.495+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400c7d0 0x7f80b400cbe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-29T11:57:56.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:56.296+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d120 legacy=0x7f80b400d530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:57:56.298 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:56.296+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400c7d0 msgr2=0x7f80b400cbe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:57:56.298 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:56.296+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400c7d0 0x7f80b400cbe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-29T11:57:57.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:57.893+0000 7f80c77fe640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400c7d0 msgr2=0x7f80b400cbe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:57:57.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:57.893+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400c7d0 0x7f80b400cbe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:57:57.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:57.893+0000 7f80c77fe640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d120 legacy=0x7f80b400d530 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:57:57.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:57.893+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 0x7f80b4013e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:57:57.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:57.893+0000 7f80c77fe640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d0072800 con 0x7f80b400e300 2023-11-29T11:57:57.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:57.893+0000 7f80c77fe640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d009a2a0 con 0x7f80b4007780 2023-11-29T11:57:57.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:57.893+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 msgr2=0x7f80b4013e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:57:57.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:57.893+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400e300 legacy=0x7f80b4010720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:57:57.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:57.893+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 0x7f80b4013e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-29T11:57:58.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:58.094+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400e300 legacy=0x7f80b4010720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:57:58.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:58.094+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 msgr2=0x7f80b4013e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:57:58.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:58.094+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 0x7f80b4013e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-29T11:57:58.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:58.495+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 msgr2=0x7f80b4013e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:57:58.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:58.495+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400e300 legacy=0x7f80b4010720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:57:58.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:58.495+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 0x7f80b4013e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-29T11:57:59.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:59.296+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400e300 legacy=0x7f80b4010720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:57:59.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:59.296+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 msgr2=0x7f80b4013e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:57:59.298 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:57:59.296+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 0x7f80b4013e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-29T11:58:00.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:00.893+0000 7f80c77fe640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 msgr2=0x7f80b4013e50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:58:00.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:00.893+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 0x7f80b4013e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:58:00.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:00.893+0000 7f80c77fe640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400e300 legacy=0x7f80b4010720 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:58:00.895 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:00.893+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 0x7f80b4011e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:58:00.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:00.893+0000 7f80c77fe640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d0098960 con 0x7f80b400cbe0 2023-11-29T11:58:00.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:00.893+0000 7f80c77fe640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d009a2a0 con 0x7f80b4007780 2023-11-29T11:58:00.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:00.893+0000 7f80d5d3a640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400cbe0 legacy=0x7f80b400d530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:00.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:00.893+0000 7f80d5539640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 msgr2=0x7f80b4011e40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:00.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:00.893+0000 7f80d5539640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 0x7f80b4011e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-29T11:58:01.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:01.094+0000 7f80d5539640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 msgr2=0x7f80b4011e40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:01.095 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:01.094+0000 7f80d5d3a640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400cbe0 legacy=0x7f80b400d530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:01.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:01.094+0000 7f80d5539640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 0x7f80b4011e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-29T11:58:01.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:01.495+0000 7f80d5539640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 msgr2=0x7f80b4011e40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:01.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:01.495+0000 7f80d5d3a640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400cbe0 legacy=0x7f80b400d530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:01.496 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:01.495+0000 7f80d5539640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 0x7f80b4011e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-29T11:58:02.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:02.296+0000 7f80d5539640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 msgr2=0x7f80b4011e40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:02.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:02.296+0000 7f80d5d3a640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400cbe0 legacy=0x7f80b400d530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:02.297 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:02.296+0000 7f80d5539640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 0x7f80b4011e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-29T11:58:03.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:03.894+0000 7f80c77fe640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 msgr2=0x7f80b4011e40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:58:03.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:03.894+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 0x7f80b4011e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:58:03.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:03.894+0000 7f80c77fe640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400cbe0 legacy=0x7f80b400d530 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:58:03.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:03.894+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 0x7f80b4011e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:58:03.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:03.894+0000 7f80c77fe640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d0072800 con 0x7f80b4012380 2023-11-29T11:58:03.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:03.894+0000 7f80c77fe640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d009a2a0 con 0x7f80b4007780 2023-11-29T11:58:03.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:03.894+0000 7f80d5539640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 msgr2=0x7f80b4011e40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:03.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:03.894+0000 7f80d5d3a640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b4012380 legacy=0x7f80b4010720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:03.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:03.894+0000 7f80d5539640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 0x7f80b4011e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-29T11:58:04.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:04.095+0000 7f80d5539640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 msgr2=0x7f80b4011e40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:04.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:04.095+0000 7f80d5d3a640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b4012380 legacy=0x7f80b4010720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:04.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:04.095+0000 7f80d5539640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 0x7f80b4011e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-29T11:58:04.497 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:04.496+0000 7f80d5539640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 msgr2=0x7f80b4011e40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:04.497 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:04.496+0000 7f80d5d3a640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b4012380 legacy=0x7f80b4010720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:04.497 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:04.496+0000 7f80d5539640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 0x7f80b4011e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-29T11:58:05.298 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:05.297+0000 7f80d5d3a640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b4012380 legacy=0x7f80b4010720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:05.298 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:05.297+0000 7f80d5539640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 msgr2=0x7f80b4011e40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:05.299 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:05.297+0000 7f80d5539640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 0x7f80b4011e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-29T11:58:06.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:06.894+0000 7f80c77fe640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 msgr2=0x7f80b4011e40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:58:06.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:06.894+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 0x7f80b4011e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:58:06.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:06.894+0000 7f80c77fe640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b4012380 legacy=0x7f80b4010720 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:58:06.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:06.894+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 0x7f80b400d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:58:06.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:06.894+0000 7f80c77fe640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d0098960 con 0x7f80b4012380 2023-11-29T11:58:06.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:06.894+0000 7f80c77fe640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d009a2a0 con 0x7f80b400d530 2023-11-29T11:58:06.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:06.894+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 msgr2=0x7f80b400d940 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:06.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:06.894+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b4012380 legacy=0x7f80b400e710 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:06.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:06.894+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 0x7f80b400d940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-29T11:58:07.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:07.095+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b4012380 legacy=0x7f80b400e710 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:07.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:07.095+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 msgr2=0x7f80b400d940 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:07.096 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:07.095+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 0x7f80b400d940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-29T11:58:07.497 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:07.496+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 msgr2=0x7f80b400d940 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:07.497 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:07.496+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b4012380 legacy=0x7f80b400e710 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:07.497 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:07.496+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 0x7f80b400d940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-29T11:58:08.298 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:08.297+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 msgr2=0x7f80b400d940 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:08.299 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:08.297+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b4012380 legacy=0x7f80b400e710 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:08.299 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:08.297+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 0x7f80b400d940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-29T11:58:09.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:09.895+0000 7f80c77fe640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 msgr2=0x7f80b400d940 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:58:09.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:09.895+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 0x7f80b400d940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:58:09.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:09.895+0000 7f80c77fe640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b4012380 legacy=0x7f80b400e710 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:58:09.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:09.895+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4011550 0x7f80b4011e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:58:09.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:09.895+0000 7f80c77fe640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d0072800 con 0x7f80b4007780 2023-11-29T11:58:09.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:09.895+0000 7f80c77fe640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d009a2a0 con 0x7f80b4011550 2023-11-29T11:58:09.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:09.895+0000 7f80d5d3a640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b4007780 legacy=0x7f80b400fe30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:09.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:09.895+0000 7f80d5539640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4011550 msgr2=0x7f80b4011e40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:09.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:09.895+0000 7f80d5539640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4011550 0x7f80b4011e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-29T11:58:10.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:10.096+0000 7f80d5d3a640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b4007780 legacy=0x7f80b400fe30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:10.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:10.096+0000 7f80d5539640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4011550 msgr2=0x7f80b4011e40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:10.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:10.096+0000 7f80d5539640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4011550 0x7f80b4011e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-29T11:58:10.497 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:10.497+0000 7f80d5539640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4011550 msgr2=0x7f80b4011e40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:10.498 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:10.497+0000 7f80d5d3a640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b4007780 legacy=0x7f80b400fe30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:10.498 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:10.497+0000 7f80d5539640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4011550 0x7f80b4011e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-29T11:58:11.298 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:11.298+0000 7f80d5539640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4011550 msgr2=0x7f80b4011e40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:11.299 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:11.298+0000 7f80d5d3a640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b4007780 legacy=0x7f80b400fe30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:11.299 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:11.298+0000 7f80d5539640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4011550 0x7f80b4011e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-29T11:58:12.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:12.895+0000 7f80c77fe640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4011550 msgr2=0x7f80b4011e40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:58:12.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:12.895+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4011550 0x7f80b4011e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:58:12.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:12.895+0000 7f80c77fe640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b4007780 legacy=0x7f80b400fe30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:58:12.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:12.895+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4011550 0x7f80b4010720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:58:12.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:12.895+0000 7f80c77fe640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d0098960 con 0x7f80b4007780 2023-11-29T11:58:12.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:12.895+0000 7f80c77fe640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d009a2a0 con 0x7f80b4011550 2023-11-29T11:58:12.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:12.895+0000 7f80d5d3a640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b4007780 legacy=0x7f80b400d530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:12.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:12.895+0000 7f80d5539640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4011550 msgr2=0x7f80b4010720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:12.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:12.895+0000 7f80d5539640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4011550 0x7f80b4010720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-29T11:58:13.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:13.096+0000 7f80d5d3a640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b4007780 legacy=0x7f80b400d530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:13.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:13.096+0000 7f80d5539640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4011550 msgr2=0x7f80b4010720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:13.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:13.096+0000 7f80d5539640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4011550 0x7f80b4010720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-29T11:58:13.498 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:13.496+0000 7f80d5539640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4011550 msgr2=0x7f80b4010720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:13.498 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:13.496+0000 7f80d5d3a640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b4007780 legacy=0x7f80b400d530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:13.498 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:13.496+0000 7f80d5539640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4011550 0x7f80b4010720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-29T11:58:14.299 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:14.297+0000 7f80d5539640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4011550 msgr2=0x7f80b4010720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:14.299 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:14.297+0000 7f80d5d3a640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b4007780 legacy=0x7f80b400d530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:14.299 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:14.297+0000 7f80d5539640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4011550 0x7f80b4010720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-29T11:58:15.896 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:15.894+0000 7f80c77fe640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4011550 msgr2=0x7f80b4010720 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:58:15.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:15.894+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4011550 0x7f80b4010720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:58:15.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:15.894+0000 7f80c77fe640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b4007780 legacy=0x7f80b400d530 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:58:15.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:15.894+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4010c60 0x7f80b4009d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:58:15.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:15.894+0000 7f80c77fe640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d0072800 con 0x7f80b4011070 2023-11-29T11:58:15.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:15.894+0000 7f80c77fe640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d009a2a0 con 0x7f80b4010c60 2023-11-29T11:58:15.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:15.894+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4010c60 msgr2=0x7f80b4009d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:15.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:15.894+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b4011070 legacy=0x7f80b400a2a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:15.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:15.894+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4010c60 0x7f80b4009d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-29T11:58:16.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:16.095+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b4011070 legacy=0x7f80b400a2a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:16.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:16.095+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4010c60 msgr2=0x7f80b4009d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:16.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:16.095+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4010c60 0x7f80b4009d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-29T11:58:16.498 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:16.496+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b4011070 legacy=0x7f80b400a2a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:16.498 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:16.496+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4010c60 msgr2=0x7f80b4009d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:16.498 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:16.496+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4010c60 0x7f80b4009d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-29T11:58:17.299 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:17.297+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b4011070 legacy=0x7f80b400a2a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:17.299 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:17.297+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4010c60 msgr2=0x7f80b4009d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:17.299 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:17.297+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4010c60 0x7f80b4009d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-29T11:58:18.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:18.895+0000 7f80c77fe640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4010c60 msgr2=0x7f80b4009d60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:58:18.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:18.895+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4010c60 0x7f80b4009d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:58:18.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:18.895+0000 7f80c77fe640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b4011070 legacy=0x7f80b400a2a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:58:18.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:18.895+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4011550 0x7f80b400d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:58:18.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:18.895+0000 7f80c77fe640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d0098960 con 0x7f80b4007780 2023-11-29T11:58:18.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:18.895+0000 7f80c77fe640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d009a2a0 con 0x7f80b4011550 2023-11-29T11:58:18.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:18.895+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4011550 msgr2=0x7f80b400d530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:18.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:18.895+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b4007780 legacy=0x7f80b4008d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:18.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:18.895+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4011550 0x7f80b400d530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-29T11:58:19.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:19.096+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b4007780 legacy=0x7f80b4008d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:19.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:19.096+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4011550 msgr2=0x7f80b400d530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:19.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:19.096+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4011550 0x7f80b400d530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-29T11:58:19.498 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:19.497+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b4007780 legacy=0x7f80b4008d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:19.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:19.497+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4011550 msgr2=0x7f80b400d530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:19.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:19.497+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4011550 0x7f80b400d530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-29T11:58:20.299 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:20.298+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b4007780 legacy=0x7f80b4008d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:20.300 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:20.298+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4011550 msgr2=0x7f80b400d530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:20.300 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:20.298+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4011550 0x7f80b400d530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-29T11:58:21.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:21.895+0000 7f80c77fe640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4011550 msgr2=0x7f80b400d530 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:58:21.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:21.895+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4011550 0x7f80b400d530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:58:21.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:21.895+0000 7f80c77fe640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b4007780 legacy=0x7f80b4008d50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:58:21.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:21.895+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4010e30 0x7f80b400a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:58:21.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:21.895+0000 7f80c77fe640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d0072800 con 0x7f80b400da70 2023-11-29T11:58:21.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:21.895+0000 7f80c77fe640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d009a2a0 con 0x7f80b4010e30 2023-11-29T11:58:21.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:21.895+0000 7f80d5d3a640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400da70 legacy=0x7f80b4010720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:21.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:21.895+0000 7f80d5539640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4010e30 msgr2=0x7f80b400a470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:21.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:21.895+0000 7f80d5539640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4010e30 0x7f80b400a470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-29T11:58:22.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:22.096+0000 7f80d5d3a640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400da70 legacy=0x7f80b4010720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:22.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:22.096+0000 7f80d5539640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4010e30 msgr2=0x7f80b400a470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:22.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:22.096+0000 7f80d5539640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4010e30 0x7f80b400a470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-29T11:58:22.498 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:22.497+0000 7f80d5539640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4010e30 msgr2=0x7f80b400a470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:22.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:22.497+0000 7f80d5d3a640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400da70 legacy=0x7f80b4010720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:22.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:22.497+0000 7f80d5539640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4010e30 0x7f80b400a470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-29T11:58:23.300 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:23.298+0000 7f80d5539640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4010e30 msgr2=0x7f80b400a470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:23.300 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:23.298+0000 7f80d5d3a640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400da70 legacy=0x7f80b4010720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:23.300 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:23.298+0000 7f80d5539640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4010e30 0x7f80b400a470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-29T11:58:24.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:24.895+0000 7f80c77fe640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4010e30 msgr2=0x7f80b400a470 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:58:24.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:24.895+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4010e30 0x7f80b400a470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:58:24.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:24.895+0000 7f80c77fe640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400da70 legacy=0x7f80b4010720 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:58:24.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:24.895+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400a9b0 0x7f80b400d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:58:24.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:24.895+0000 7f80c77fe640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d0098960 con 0x7f80b400da70 2023-11-29T11:58:24.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:24.895+0000 7f80c77fe640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d009a2a0 con 0x7f80b400a9b0 2023-11-29T11:58:24.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:24.895+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400a9b0 msgr2=0x7f80b400d530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:24.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:24.895+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400da70 legacy=0x7f80b4010720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:24.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:24.895+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400a9b0 0x7f80b400d530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-29T11:58:25.097 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:25.096+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400a9b0 msgr2=0x7f80b400d530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:25.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:25.096+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400da70 legacy=0x7f80b4010720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:25.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:25.096+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400a9b0 0x7f80b400d530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-29T11:58:25.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:25.497+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400a9b0 msgr2=0x7f80b400d530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:25.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:25.497+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400da70 legacy=0x7f80b4010720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:25.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:25.497+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400a9b0 0x7f80b400d530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-29T11:58:26.300 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:26.298+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400a9b0 msgr2=0x7f80b400d530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:26.300 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:26.298+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400da70 legacy=0x7f80b4010720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:26.300 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:26.298+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400a9b0 0x7f80b400d530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-29T11:58:27.897 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:27.896+0000 7f80c77fe640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400a9b0 msgr2=0x7f80b400d530 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:58:27.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:27.896+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400a9b0 0x7f80b400d530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:58:27.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:27.896+0000 7f80c77fe640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400da70 legacy=0x7f80b4010720 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:58:27.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:27.896+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 0x7f80b4010e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:58:27.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:27.896+0000 7f80c77fe640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d0072800 con 0x7f80b400da70 2023-11-29T11:58:27.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:27.896+0000 7f80c77fe640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d009a2a0 con 0x7f80b4007780 2023-11-29T11:58:27.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:27.896+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400da70 legacy=0x7f80b4008cb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:27.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:27.896+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 msgr2=0x7f80b4010e30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:27.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:27.896+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 0x7f80b4010e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-29T11:58:28.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:28.097+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 msgr2=0x7f80b4010e30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:28.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:28.097+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400da70 legacy=0x7f80b4008cb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:28.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:28.097+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 0x7f80b4010e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-29T11:58:28.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:28.498+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 msgr2=0x7f80b4010e30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:28.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:28.498+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400da70 legacy=0x7f80b4008cb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:28.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:28.498+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 0x7f80b4010e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-29T11:58:29.301 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:29.299+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400da70 legacy=0x7f80b4008cb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:29.301 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:29.299+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 msgr2=0x7f80b4010e30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:29.301 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:29.299+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 0x7f80b4010e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-29T11:58:30.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:30.896+0000 7f80c77fe640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 msgr2=0x7f80b4010e30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:58:30.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:30.896+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 0x7f80b4010e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:58:30.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:30.896+0000 7f80c77fe640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400da70 legacy=0x7f80b4008cb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:58:30.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:30.896+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 0x7f80b4011370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:58:30.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:30.896+0000 7f80c77fe640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d0098960 con 0x7f80b4010720 2023-11-29T11:58:30.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:30.896+0000 7f80c77fe640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d009a2a0 con 0x7f80b400d530 2023-11-29T11:58:30.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:30.896+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b4010720 legacy=0x7f80b400a3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:30.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:30.896+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 msgr2=0x7f80b4011370 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:30.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:30.896+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 0x7f80b4011370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-29T11:58:31.098 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:31.097+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b4010720 legacy=0x7f80b400a3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:31.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:31.097+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 msgr2=0x7f80b4011370 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:31.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:31.097+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 0x7f80b4011370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-29T11:58:31.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:31.498+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b4010720 legacy=0x7f80b400a3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:31.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:31.498+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 msgr2=0x7f80b4011370 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:31.499 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:31.498+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 0x7f80b4011370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-29T11:58:32.300 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:32.299+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b4010720 legacy=0x7f80b400a3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:32.300 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:32.299+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 msgr2=0x7f80b4011370 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:32.300 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:32.299+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 0x7f80b4011370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-29T11:58:33.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:33.896+0000 7f80c77fe640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 msgr2=0x7f80b4011370 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:58:33.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:33.896+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 0x7f80b4011370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:58:33.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:33.896+0000 7f80c77fe640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b4010720 legacy=0x7f80b400a3d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:58:33.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:33.896+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 0x7f80b4011240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:58:33.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:33.896+0000 7f80c77fe640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d0072800 con 0x7f80b400d9e0 2023-11-29T11:58:33.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:33.896+0000 7f80c77fe640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d009a2a0 con 0x7f80b400d530 2023-11-29T11:58:33.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:33.896+0000 7f80d5539640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 msgr2=0x7f80b4011240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:33.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:33.896+0000 7f80d5d3a640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d9e0 legacy=0x7f80b4010b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:33.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:33.897+0000 7f80d5539640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 0x7f80b4011240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-29T11:58:34.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:34.098+0000 7f80d5d3a640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d9e0 legacy=0x7f80b4010b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:34.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:34.098+0000 7f80d5539640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 msgr2=0x7f80b4011240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:34.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:34.098+0000 7f80d5539640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 0x7f80b4011240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-29T11:58:34.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:34.499+0000 7f80d5539640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 msgr2=0x7f80b4011240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:34.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:34.499+0000 7f80d5d3a640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d9e0 legacy=0x7f80b4010b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:34.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:34.499+0000 7f80d5539640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 0x7f80b4011240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-29T11:58:35.301 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:35.300+0000 7f80d5539640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 msgr2=0x7f80b4011240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:35.302 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:35.300+0000 7f80d5d3a640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d9e0 legacy=0x7f80b4010b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:35.302 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:35.300+0000 7f80d5539640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 0x7f80b4011240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-29T11:58:36.898 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:36.897+0000 7f80c77fe640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 msgr2=0x7f80b4011240 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:58:36.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:36.897+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 0x7f80b4011240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:58:36.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:36.897+0000 7f80c77fe640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d9e0 legacy=0x7f80b4010b30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:58:36.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:36.897+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4010720 0x7f80b4009cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:58:36.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:36.897+0000 7f80c77fe640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d0098960 con 0x7f80b400d9e0 2023-11-29T11:58:36.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:36.897+0000 7f80c77fe640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d009a2a0 con 0x7f80b4010720 2023-11-29T11:58:36.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:36.897+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4010720 msgr2=0x7f80b4009cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:36.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:36.897+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d9e0 legacy=0x7f80b400a200 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:36.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:36.897+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4010720 0x7f80b4009cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-29T11:58:37.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:37.098+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d9e0 legacy=0x7f80b400a200 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:37.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:37.098+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4010720 msgr2=0x7f80b4009cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:37.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:37.098+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4010720 0x7f80b4009cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-29T11:58:37.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:37.499+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d9e0 legacy=0x7f80b400a200 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:37.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:37.499+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4010720 msgr2=0x7f80b4009cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:37.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:37.499+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4010720 0x7f80b4009cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-29T11:58:38.301 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:38.300+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4010720 msgr2=0x7f80b4009cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:38.301 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:38.300+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d9e0 legacy=0x7f80b400a200 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:38.302 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:38.300+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4010720 0x7f80b4009cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-29T11:58:39.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:39.897+0000 7f80c77fe640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4010720 msgr2=0x7f80b4009cc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:58:39.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:39.897+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4010720 0x7f80b4009cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:58:39.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:39.897+0000 7f80c77fe640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d9e0 legacy=0x7f80b400a200 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:58:39.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:39.897+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4010720 0x7f80b4011240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:58:39.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:39.897+0000 7f80c77fe640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d0072800 con 0x7f80b400d530 2023-11-29T11:58:39.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:39.897+0000 7f80c77fe640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d009a2a0 con 0x7f80b4010720 2023-11-29T11:58:39.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:39.897+0000 7f80d5d3a640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d530 legacy=0x7f80b4010b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:39.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:39.897+0000 7f80d5539640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4010720 msgr2=0x7f80b4011240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:39.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:39.897+0000 7f80d5539640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4010720 0x7f80b4011240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-29T11:58:40.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:40.098+0000 7f80d5d3a640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d530 legacy=0x7f80b4010b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:40.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:40.098+0000 7f80d5539640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4010720 msgr2=0x7f80b4011240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:40.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:40.098+0000 7f80d5539640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4010720 0x7f80b4011240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-29T11:58:40.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:40.499+0000 7f80d5539640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4010720 msgr2=0x7f80b4011240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:40.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:40.499+0000 7f80d5d3a640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d530 legacy=0x7f80b4010b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:40.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:40.499+0000 7f80d5539640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4010720 0x7f80b4011240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-29T11:58:41.301 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:41.300+0000 7f80d5d3a640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d530 legacy=0x7f80b4010b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:41.301 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:41.300+0000 7f80d5539640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4010720 msgr2=0x7f80b4011240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:41.302 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:41.300+0000 7f80d5539640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4010720 0x7f80b4011240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-29T11:58:42.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:42.897+0000 7f80c77fe640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4010720 msgr2=0x7f80b4011240 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:58:42.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:42.897+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4010720 0x7f80b4011240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:58:42.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:42.897+0000 7f80c77fe640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d530 legacy=0x7f80b4010b30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:58:42.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:42.897+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d9e0 0x7f80b4005770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:58:42.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:42.897+0000 7f80c77fe640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d0098960 con 0x7f80b4005cb0 2023-11-29T11:58:42.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:42.897+0000 7f80c77fe640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d009a2a0 con 0x7f80b400d9e0 2023-11-29T11:58:42.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:42.897+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d9e0 msgr2=0x7f80b4005770 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:42.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:42.897+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b4005cb0 legacy=0x7f80b40060c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:42.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:42.897+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d9e0 0x7f80b4005770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-29T11:58:43.099 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:43.098+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b4005cb0 legacy=0x7f80b40060c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:43.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:43.098+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d9e0 msgr2=0x7f80b4005770 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:43.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:43.098+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d9e0 0x7f80b4005770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-29T11:58:43.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:43.499+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b4005cb0 legacy=0x7f80b40060c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:43.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:43.499+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d9e0 msgr2=0x7f80b4005770 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:43.500 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:43.499+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d9e0 0x7f80b4005770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-29T11:58:44.301 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:44.300+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b4005cb0 legacy=0x7f80b40060c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:44.301 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:44.300+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d9e0 msgr2=0x7f80b4005770 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:44.301 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:44.300+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d9e0 0x7f80b4005770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-29T11:58:45.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:45.898+0000 7f80c77fe640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d9e0 msgr2=0x7f80b4005770 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:58:45.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:45.898+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d9e0 0x7f80b4005770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:58:45.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:45.898+0000 7f80c77fe640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b4005cb0 legacy=0x7f80b40060c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:58:45.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:45.898+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4014560 0x7f80b4016e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:58:45.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:45.898+0000 7f80c77fe640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d0072800 con 0x7f80b400d530 2023-11-29T11:58:45.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:45.898+0000 7f80c77fe640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d009a2a0 con 0x7f80b4014560 2023-11-29T11:58:45.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:45.898+0000 7f80d5d3a640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d530 legacy=0x7f80b4013e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:45.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:45.898+0000 7f80d5539640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4014560 msgr2=0x7f80b4016e70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:45.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:45.898+0000 7f80d5539640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4014560 0x7f80b4016e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-29T11:58:46.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:46.099+0000 7f80d5539640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4014560 msgr2=0x7f80b4016e70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:46.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:46.099+0000 7f80d5d3a640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d530 legacy=0x7f80b4013e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:46.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:46.099+0000 7f80d5539640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4014560 0x7f80b4016e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-29T11:58:46.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:46.500+0000 7f80d5d3a640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d530 legacy=0x7f80b4013e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:46.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:46.500+0000 7f80d5539640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4014560 msgr2=0x7f80b4016e70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:46.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:46.500+0000 7f80d5539640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4014560 0x7f80b4016e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-29T11:58:47.302 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:47.301+0000 7f80d5539640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4014560 msgr2=0x7f80b4016e70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:47.302 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:47.301+0000 7f80d5d3a640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d530 legacy=0x7f80b4013e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:47.302 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:47.301+0000 7f80d5539640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4014560 0x7f80b4016e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-29T11:58:48.899 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:48.898+0000 7f80c77fe640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4014560 msgr2=0x7f80b4016e70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:58:48.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:48.898+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4014560 0x7f80b4016e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:58:48.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:48.898+0000 7f80c77fe640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d530 legacy=0x7f80b4013e50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:58:48.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:48.898+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d9e0 0x7f80b4008cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:58:48.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:48.898+0000 7f80c77fe640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d0098960 con 0x7f80b400d530 2023-11-29T11:58:48.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:48.898+0000 7f80c77fe640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d009a2a0 con 0x7f80b400d9e0 2023-11-29T11:58:48.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:48.898+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d9e0 msgr2=0x7f80b4008cb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:48.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:48.898+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d530 legacy=0x7f80b400e710 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:48.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:48.898+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d9e0 0x7f80b4008cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-29T11:58:49.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:49.099+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d9e0 msgr2=0x7f80b4008cb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:49.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:49.099+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d530 legacy=0x7f80b400e710 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:49.100 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:49.099+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d9e0 0x7f80b4008cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-29T11:58:49.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:49.500+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d530 legacy=0x7f80b400e710 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:49.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:49.500+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d9e0 msgr2=0x7f80b4008cb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:49.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:49.500+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d9e0 0x7f80b4008cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-29T11:58:50.302 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:50.301+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d9e0 msgr2=0x7f80b4008cb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:50.302 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:50.301+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d530 legacy=0x7f80b400e710 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:50.302 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:50.301+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d9e0 0x7f80b4008cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-29T11:58:51.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:51.897+0000 7f80c77fe640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d9e0 msgr2=0x7f80b4008cb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:58:51.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:51.897+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d9e0 0x7f80b4008cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:58:51.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:51.897+0000 7f80c77fe640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d530 legacy=0x7f80b400e710 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:58:51.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:51.897+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 0x7f80b400ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:58:51.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:51.897+0000 7f80c77fe640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d0072800 con 0x7f80b400d530 2023-11-29T11:58:51.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:51.897+0000 7f80c77fe640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d009a2a0 con 0x7f80b4007780 2023-11-29T11:58:51.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:51.897+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 msgr2=0x7f80b400ee20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:51.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:51.897+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d530 legacy=0x7f80b400e710 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:51.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:51.897+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 0x7f80b400ee20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-29T11:58:52.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:52.098+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d530 legacy=0x7f80b400e710 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:52.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:52.098+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 msgr2=0x7f80b400ee20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:52.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:52.098+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 0x7f80b400ee20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-29T11:58:52.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:52.499+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 msgr2=0x7f80b400ee20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:52.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:52.499+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d530 legacy=0x7f80b400e710 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:52.501 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:52.499+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 0x7f80b400ee20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-29T11:58:53.302 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:53.300+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 msgr2=0x7f80b400ee20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:53.303 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:53.300+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d530 legacy=0x7f80b400e710 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:53.303 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:53.300+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 0x7f80b400ee20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-29T11:58:54.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:54.898+0000 7f80c77fe640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 msgr2=0x7f80b400ee20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:58:54.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:54.898+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 0x7f80b400ee20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:58:54.900 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:54.898+0000 7f80c77fe640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d530 legacy=0x7f80b400e710 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:58:54.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:54.898+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 0x7f80b400a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:58:54.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:54.898+0000 7f80c77fe640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d0098960 con 0x7f80b400d940 2023-11-29T11:58:54.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:54.898+0000 7f80c77fe640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d009a2a0 con 0x7f80b4007780 2023-11-29T11:58:54.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:54.898+0000 7f80d5d3a640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d940 legacy=0x7f80b4009cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:54.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:54.898+0000 7f80d5539640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 msgr2=0x7f80b400a3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:54.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:54.898+0000 7f80d5539640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 0x7f80b400a3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-29T11:58:55.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:55.099+0000 7f80d5d3a640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d940 legacy=0x7f80b4009cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:55.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:55.099+0000 7f80d5539640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 msgr2=0x7f80b400a3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:55.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:55.099+0000 7f80d5539640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 0x7f80b400a3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-29T11:58:55.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:55.500+0000 7f80d5539640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 msgr2=0x7f80b400a3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:55.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:55.500+0000 7f80d5d3a640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d940 legacy=0x7f80b4009cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:55.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:55.500+0000 7f80d5539640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 0x7f80b400a3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-29T11:58:56.303 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:56.301+0000 7f80d5539640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 msgr2=0x7f80b400a3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:56.303 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:56.301+0000 7f80d5d3a640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d940 legacy=0x7f80b4009cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:56.303 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:56.301+0000 7f80d5539640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 0x7f80b400a3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-29T11:58:57.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:57.898+0000 7f80c77fe640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 msgr2=0x7f80b400a3d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:58:57.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:57.898+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 0x7f80b400a3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:58:57.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:57.898+0000 7f80c77fe640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d940 legacy=0x7f80b4009cc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:58:57.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:57.898+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 0x7f80b400a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:58:57.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:57.898+0000 7f80c77fe640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d0072800 con 0x7f80b400d940 2023-11-29T11:58:57.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:57.898+0000 7f80c77fe640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d009a2a0 con 0x7f80b400d530 2023-11-29T11:58:57.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:57.898+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 msgr2=0x7f80b400a910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:57.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:57.898+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d940 legacy=0x7f80b4008cb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:57.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:57.898+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 0x7f80b400a910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-29T11:58:58.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:58.099+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d940 legacy=0x7f80b4008cb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:58.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:58.099+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 msgr2=0x7f80b400a910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:58.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:58.099+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 0x7f80b400a910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-29T11:58:58.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:58.500+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 msgr2=0x7f80b400a910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:58.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:58.500+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d940 legacy=0x7f80b4008cb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:58.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:58.500+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 0x7f80b400a910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-29T11:58:59.303 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:59.301+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 msgr2=0x7f80b400a910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:58:59.304 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:59.301+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d940 legacy=0x7f80b4008cb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:58:59.304 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:58:59.301+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 0x7f80b400a910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-29T11:59:00.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:00.899+0000 7f80c77fe640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 msgr2=0x7f80b400a910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:59:00.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:00.899+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 0x7f80b400a910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:59:00.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:00.899+0000 7f80c77fe640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d940 legacy=0x7f80b4008cb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:59:00.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:00.899+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 0x7f80b400a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:59:00.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:00.899+0000 7f80c77fe640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d0098960 con 0x7f80b400d940 2023-11-29T11:59:00.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:00.899+0000 7f80c77fe640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d009a2a0 con 0x7f80b4007780 2023-11-29T11:59:00.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:00.899+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d940 legacy=0x7f80b4010720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:59:00.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:00.899+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 msgr2=0x7f80b400a3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:59:00.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:00.899+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 0x7f80b400a3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-29T11:59:01.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:01.100+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d940 legacy=0x7f80b4010720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:59:01.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:01.100+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 msgr2=0x7f80b400a3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:59:01.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:01.100+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 0x7f80b400a3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-29T11:59:01.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:01.501+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d940 legacy=0x7f80b4010720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:59:01.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:01.501+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 msgr2=0x7f80b400a3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:59:01.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:01.501+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 0x7f80b400a3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-29T11:59:02.304 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:02.302+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 msgr2=0x7f80b400a3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:59:02.304 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:02.302+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d940 legacy=0x7f80b4010720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:59:02.304 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:02.302+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 0x7f80b400a3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-29T11:59:03.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:03.898+0000 7f80c77fe640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 msgr2=0x7f80b400a3d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:59:03.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:03.898+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 0x7f80b400a3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:59:03.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:03.898+0000 7f80c77fe640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d940 legacy=0x7f80b4010720 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:59:03.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:03.898+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 0x7f80b400a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:59:03.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:03.898+0000 7f80c77fe640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d0072800 con 0x7f80b400d940 2023-11-29T11:59:03.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:03.898+0000 7f80c77fe640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d009a2a0 con 0x7f80b400d530 2023-11-29T11:59:03.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:03.898+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 msgr2=0x7f80b400a910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:59:03.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:03.898+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d940 legacy=0x7f80b4008cb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:59:03.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:03.898+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 0x7f80b400a910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-29T11:59:04.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:04.100+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d940 legacy=0x7f80b4008cb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:59:04.101 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:04.100+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 msgr2=0x7f80b400a910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:59:04.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:04.100+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 0x7f80b400a910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-29T11:59:04.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:04.501+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d940 legacy=0x7f80b4008cb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:59:04.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:04.501+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 msgr2=0x7f80b400a910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:59:04.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:04.501+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 0x7f80b400a910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-29T11:59:05.304 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:05.302+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 msgr2=0x7f80b400a910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:59:05.304 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:05.302+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d940 legacy=0x7f80b4008cb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:59:05.304 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:05.302+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 0x7f80b400a910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-29T11:59:06.901 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:06.899+0000 7f80c77fe640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 msgr2=0x7f80b400a910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:59:06.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:06.899+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 0x7f80b400a910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:59:06.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:06.899+0000 7f80c77fe640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d940 legacy=0x7f80b4008cb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:59:06.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:06.899+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 0x7f80b400a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:59:06.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:06.899+0000 7f80c77fe640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d0098960 con 0x7f80b400d940 2023-11-29T11:59:06.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:06.899+0000 7f80c77fe640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d009a2a0 con 0x7f80b4007780 2023-11-29T11:59:06.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:06.899+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 msgr2=0x7f80b400a3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:59:06.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:06.899+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d940 legacy=0x7f80b4010720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:59:06.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:06.899+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 0x7f80b400a3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-29T11:59:07.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:07.100+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 msgr2=0x7f80b400a3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:59:07.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:07.100+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d940 legacy=0x7f80b4010720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:59:07.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:07.100+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 0x7f80b400a3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-29T11:59:07.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:07.501+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d940 legacy=0x7f80b4010720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:59:07.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:07.501+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 msgr2=0x7f80b400a3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:59:07.502 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:07.501+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 0x7f80b400a3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-29T11:59:08.303 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:08.302+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 msgr2=0x7f80b400a3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:59:08.303 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:08.302+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d940 legacy=0x7f80b4010720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:59:08.304 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:08.302+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 0x7f80b400a3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-29T11:59:09.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:09.900+0000 7f80c77fe640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 msgr2=0x7f80b400a3d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:59:09.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:09.900+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4007780 0x7f80b400a3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:59:09.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:09.900+0000 7f80c77fe640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d940 legacy=0x7f80b4010720 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:59:09.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:09.900+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 0x7f80b400a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:59:09.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:09.900+0000 7f80c77fe640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d0072800 con 0x7f80b400d940 2023-11-29T11:59:09.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:09.900+0000 7f80c77fe640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d009a2a0 con 0x7f80b400d530 2023-11-29T11:59:09.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:09.900+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 msgr2=0x7f80b400a910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:59:09.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:09.900+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d940 legacy=0x7f80b4010720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:59:09.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:09.900+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 0x7f80b400a910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-29T11:59:10.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:10.101+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d940 legacy=0x7f80b4010720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:59:10.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:10.101+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 msgr2=0x7f80b400a910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:59:10.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:10.101+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 0x7f80b400a910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-29T11:59:10.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:10.502+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d940 legacy=0x7f80b4010720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:59:10.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:10.502+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 msgr2=0x7f80b400a910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:59:10.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:10.502+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 0x7f80b400a910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-29T11:59:11.304 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:11.303+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d940 legacy=0x7f80b4010720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:59:11.304 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:11.303+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 msgr2=0x7f80b400a910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:59:11.304 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:11.303+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 0x7f80b400a910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-29T11:59:12.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:12.900+0000 7f80c77fe640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 msgr2=0x7f80b400a910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:59:12.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:12.900+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 0x7f80b400a910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:59:12.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:12.900+0000 7f80c77fe640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d940 legacy=0x7f80b4010720 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:59:12.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:12.900+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 0x7f80b4010e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:59:12.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:12.900+0000 7f80c77fe640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d0098960 con 0x7f80b400d940 2023-11-29T11:59:12.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:12.900+0000 7f80c77fe640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d009a2a0 con 0x7f80b400d530 2023-11-29T11:59:12.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:12.900+0000 7f80d5d3a640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d940 legacy=0x7f80b4010720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:59:12.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:12.900+0000 7f80d5539640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 msgr2=0x7f80b4010e30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:59:12.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:12.900+0000 7f80d5539640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 0x7f80b4010e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-29T11:59:13.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:13.101+0000 7f80d5d3a640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d940 legacy=0x7f80b4010720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:59:13.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:13.101+0000 7f80d5539640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 msgr2=0x7f80b4010e30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:59:13.102 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:13.101+0000 7f80d5539640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 0x7f80b4010e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-29T11:59:13.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:13.502+0000 7f80d5539640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 msgr2=0x7f80b4010e30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:59:13.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:13.502+0000 7f80d5d3a640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d940 legacy=0x7f80b4010720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:59:13.503 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:13.502+0000 7f80d5539640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 0x7f80b4010e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-29T11:59:14.304 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:14.303+0000 7f80d5539640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 msgr2=0x7f80b4010e30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:59:14.304 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:14.303+0000 7f80d5d3a640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d940 legacy=0x7f80b4010720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:59:14.304 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:14.303+0000 7f80d5539640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 0x7f80b4010e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-29T11:59:15.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:15.900+0000 7f80c77fe640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 msgr2=0x7f80b4010e30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:59:15.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:15.900+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 0x7f80b4010e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:59:15.902 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:15.900+0000 7f80c77fe640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d940 legacy=0x7f80b4010720 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:59:15.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:15.900+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 0x7f80b4010e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:59:15.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:15.900+0000 7f80c77fe640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d0072800 con 0x7f80b400d940 2023-11-29T11:59:15.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:15.900+0000 7f80c77fe640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d009a2a0 con 0x7f80b400d530 2023-11-29T11:59:15.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:15.900+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 msgr2=0x7f80b4010e30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:59:15.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:15.901+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 0x7f80b4010e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-29T11:59:15.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:15.901+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d940 legacy=0x7f80b4010720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:59:16.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:16.102+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d940 legacy=0x7f80b4010720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:59:16.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:16.102+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 msgr2=0x7f80b4010e30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:59:16.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:16.102+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 0x7f80b4010e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-29T11:59:16.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:16.503+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 msgr2=0x7f80b4010e30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:59:16.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:16.503+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d940 legacy=0x7f80b4010720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:59:16.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:16.503+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 0x7f80b4010e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-29T11:59:17.305 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:17.304+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d940 legacy=0x7f80b4010720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:59:17.305 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:17.304+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 msgr2=0x7f80b4010e30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:59:17.305 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:17.304+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 0x7f80b4010e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-29T11:59:18.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:18.901+0000 7f80c77fe640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 msgr2=0x7f80b4010e30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:59:18.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:18.901+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 0x7f80b4010e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:59:18.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:18.901+0000 7f80c77fe640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d940 legacy=0x7f80b4010720 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:59:18.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:18.901+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4006780 0x7f80b4006b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:59:18.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:18.901+0000 7f80c77fe640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d0098960 con 0x7f80b400d940 2023-11-29T11:59:18.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:18.901+0000 7f80c77fe640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d009a2a0 con 0x7f80b4006780 2023-11-29T11:59:18.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:18.901+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4006780 msgr2=0x7f80b4006b90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:59:18.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:18.901+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d940 legacy=0x7f80b40070d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:59:18.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:18.901+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4006780 0x7f80b4006b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-29T11:59:19.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:19.102+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4006780 msgr2=0x7f80b4006b90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:59:19.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:19.102+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d940 legacy=0x7f80b40070d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:59:19.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:19.102+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4006780 0x7f80b4006b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-29T11:59:19.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:19.503+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4006780 msgr2=0x7f80b4006b90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:59:19.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:19.503+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d940 legacy=0x7f80b40070d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:59:19.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:19.503+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4006780 0x7f80b4006b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-29T11:59:20.305 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:20.304+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4006780 msgr2=0x7f80b4006b90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:59:20.305 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:20.304+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d940 legacy=0x7f80b40070d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:59:20.305 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:20.304+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4006780 0x7f80b4006b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-29T11:59:21.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:21.901+0000 7f80c77fe640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b4006780 msgr2=0x7f80b4006b90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:59:21.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:21.901+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b4006780 0x7f80b4006b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:59:21.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:21.901+0000 7f80c77fe640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d940 legacy=0x7f80b40070d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:59:21.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:21.901+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 0x7f80b4005770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:59:21.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:21.901+0000 7f80c77fe640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d0072800 con 0x7f80b400d940 2023-11-29T11:59:21.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:21.901+0000 7f80c77fe640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d009a2a0 con 0x7f80b400d530 2023-11-29T11:59:21.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:21.901+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d940 legacy=0x7f80b4005cb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:59:21.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:21.901+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 msgr2=0x7f80b4005770 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:59:21.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:21.901+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 0x7f80b4005770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-29T11:59:22.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:22.102+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 msgr2=0x7f80b4005770 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:59:22.103 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:22.102+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d940 legacy=0x7f80b4005cb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:59:22.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:22.102+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 0x7f80b4005770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-29T11:59:22.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:22.503+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 msgr2=0x7f80b4005770 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:59:22.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:22.503+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d940 legacy=0x7f80b4005cb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:59:22.504 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:22.503+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 0x7f80b4005770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-29T11:59:23.305 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:23.304+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d940 legacy=0x7f80b4005cb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:59:23.305 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:23.304+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 msgr2=0x7f80b4005770 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:59:23.306 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:23.304+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 0x7f80b4005770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-29T11:59:24.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:24.902+0000 7f80c77fe640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 msgr2=0x7f80b4005770 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:59:24.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:24.902+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 0x7f80b4005770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:59:24.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:24.902+0000 7f80c77fe640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b400d940 legacy=0x7f80b4005cb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:59:24.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:24.902+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 0x7f80b4010e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:59:24.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:24.902+0000 7f80c77fe640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d0098960 con 0x7f80b40073d0 2023-11-29T11:59:24.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:24.902+0000 7f80c77fe640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d009a2a0 con 0x7f80b400d530 2023-11-29T11:59:24.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:24.902+0000 7f80d5539640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 msgr2=0x7f80b4010e30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:59:24.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:24.902+0000 7f80d5d3a640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b40073d0 legacy=0x7f80b4010720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:59:24.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:24.902+0000 7f80d5539640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 0x7f80b4010e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-29T11:59:25.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:25.103+0000 7f80d5d3a640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b40073d0 legacy=0x7f80b4010720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:59:25.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:25.103+0000 7f80d5539640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 msgr2=0x7f80b4010e30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:59:25.105 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:25.103+0000 7f80d5539640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 0x7f80b4010e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-29T11:59:25.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:25.504+0000 7f80d5d3a640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b40073d0 legacy=0x7f80b4010720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:59:25.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:25.504+0000 7f80d5539640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 msgr2=0x7f80b4010e30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:59:25.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:25.504+0000 7f80d5539640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 0x7f80b4010e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-29T11:59:26.306 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:26.305+0000 7f80d5d3a640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b40073d0 legacy=0x7f80b4010720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:59:26.306 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:26.305+0000 7f80d5539640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 msgr2=0x7f80b4010e30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:59:26.306 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:26.305+0000 7f80d5539640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 0x7f80b4010e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-29T11:59:27.903 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:27.902+0000 7f80c77fe640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 msgr2=0x7f80b4010e30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:59:27.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:27.902+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b400d530 0x7f80b4010e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:59:27.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:27.902+0000 7f80c77fe640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b40073d0 legacy=0x7f80b4010720 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:59:27.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:27.902+0000 7f80c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b40077e0 0x7f80b4005770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:59:27.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:27.902+0000 7f80c77fe640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d0072800 con 0x7f80b40073d0 2023-11-29T11:59:27.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:27.902+0000 7f80c77fe640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d009a2a0 con 0x7f80b40077e0 2023-11-29T11:59:27.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:27.902+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b40077e0 msgr2=0x7f80b4005770 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:59:27.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:27.902+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b40073d0 legacy=0x7f80b400d530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:59:27.904 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:27.902+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b40077e0 0x7f80b4005770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-29T11:59:28.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:28.103+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b40073d0 legacy=0x7f80b400d530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:59:28.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:28.103+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b40077e0 msgr2=0x7f80b4005770 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:59:28.104 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:28.103+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b40077e0 0x7f80b4005770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-29T11:59:28.505 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:28.504+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b40077e0 msgr2=0x7f80b4005770 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:59:28.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:28.504+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b40073d0 legacy=0x7f80b400d530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:59:28.506 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:28.504+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b40077e0 0x7f80b4005770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-29T11:59:29.306 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:29.304+0000 7f80d5539640 1 -- >> v1:172.21.15.27:6789/0 conn(0x7f80b40073d0 legacy=0x7f80b400d530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.27:6789/0 2023-11-29T11:59:29.306 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:29.304+0000 7f80d5d3a640 1 -- >> v2:172.21.15.27:3300/0 conn(0x7f80b40077e0 msgr2=0x7f80b4005770 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.27:3300/0 2023-11-29T11:59:29.307 INFO:teuthology.orchestra.run.smithi027.stderr:2023-11-29T11:59:29.304+0000 7f80d5d3a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f80b40077e0 0x7f80b4005770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-29T11:59:30.815 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-11-29T11:59:30.815 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph_3d760f113bd9f3a2e513474d34227633cd06f1ea/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_ceph_ceph_3d760f113bd9f3a2e513474d34227633cd06f1ea/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_ceph_ceph_3d760f113bd9f3a2e513474d34227633cd06f1ea/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_ceph_ceph_3d760f113bd9f3a2e513474d34227633cd06f1ea/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph_3d760f113bd9f3a2e513474d34227633cd06f1ea/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph_3d760f113bd9f3a2e513474d34227633cd06f1ea/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi027 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-11-29T11:59:30.826 INFO:teuthology.misc:Shutting down mds daemons... 2023-11-29T11:59:30.826 INFO:teuthology.misc:Shutting down osd daemons... 2023-11-29T11:59:30.827 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-11-29T11:59:30.827 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T11:59:30.917 INFO:tasks.ceph.osd.0:Stopped 2023-11-29T11:59:30.918 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-11-29T11:59:30.918 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T11:59:30.918 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-29T11:59:30.918 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph_3d760f113bd9f3a2e513474d34227633cd06f1ea/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph_3d760f113bd9f3a2e513474d34227633cd06f1ea/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_ceph_ceph_3d760f113bd9f3a2e513474d34227633cd06f1ea/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_ceph_ceph_3d760f113bd9f3a2e513474d34227633cd06f1ea/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_ceph_ceph_3d760f113bd9f3a2e513474d34227633cd06f1ea/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph_3d760f113bd9f3a2e513474d34227633cd06f1ea/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph_3d760f113bd9f3a2e513474d34227633cd06f1ea/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi027 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi027 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log' 2023-11-29T11:59:30.928 INFO:tasks.ceph.osd.1:Stopped 2023-11-29T11:59:30.928 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-11-29T11:59:30.928 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T11:59:31.010 INFO:tasks.ceph.osd.2:Stopped 2023-11-29T11:59:31.010 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-11-29T11:59:31.011 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T11:59:31.091 INFO:tasks.ceph.osd.3:Stopped 2023-11-29T11:59:31.091 INFO:teuthology.misc:Shutting down mgr daemons... 2023-11-29T11:59:31.091 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-11-29T11:59:31.092 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T11:59:31.092 INFO:tasks.ceph.mgr.x:Stopped 2023-11-29T11:59:31.092 INFO:teuthology.misc:Shutting down mon daemons... 2023-11-29T11:59:31.092 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-11-29T11:59:31.092 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T11:59:31.092 INFO:tasks.ceph.mon.a:Stopped 2023-11-29T11:59:31.093 INFO:tasks.ceph:Checking cluster log for badness... 2023-11-29T11:59:31.093 DEBUG:teuthology.orchestra.run.smithi027:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'reached quota' | egrep -v 'but it is still running' | egrep -v 'overall HEALTH_' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | head -n 1 2023-11-29T11:59:31.130 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi027.front.sepia.ceph.com 2023-11-29T11:59:31.131 DEBUG:teuthology.orchestra.run.smithi027:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-11-29T11:59:31.283 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi027.front.sepia.ceph.com 2023-11-29T11:59:31.284 DEBUG:teuthology.orchestra.run.smithi027:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-11-29T11:59:31.378 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi139.front.sepia.ceph.com 2023-11-29T11:59:31.378 DEBUG:teuthology.orchestra.run.smithi139:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-11-29T11:59:31.543 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi139.front.sepia.ceph.com 2023-11-29T11:59:31.543 DEBUG:teuthology.orchestra.run.smithi139:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-11-29T11:59:31.605 INFO:tasks.ceph:Archiving mon data... 2023-11-29T11:59:31.607 DEBUG:teuthology.misc:Transferring archived files from smithi027:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/matan-2023-11-29_08:30:41-crimson-rados-wip-matanb-crimson-snaptrimevent-lifetime-v2-distro-crimson-smithi/7470475/data/mon.a.tgz 2023-11-29T11:59:31.607 DEBUG:teuthology.orchestra.run.smithi027:> mktemp 2023-11-29T11:59:31.622 INFO:teuthology.orchestra.run.smithi027.stdout:/tmp/tmp.52eRH2l8q7 2023-11-29T11:59:31.622 DEBUG:teuthology.orchestra.run.smithi027:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.52eRH2l8q7 2023-11-29T11:59:31.845 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 0666 /tmp/tmp.52eRH2l8q7 2023-11-29T11:59:31.934 DEBUG:teuthology.orchestra.remote:smithi027:/tmp/tmp.52eRH2l8q7 is 668KB 2023-11-29T11:59:32.034 DEBUG:teuthology.orchestra.run.smithi027:> rm -fr /tmp/tmp.52eRH2l8q7 2023-11-29T11:59:32.049 INFO:tasks.ceph:Cleaning ceph cluster... 2023-11-29T11:59:32.050 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-29T11:59:32.094 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-29T11:59:32.175 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2023-11-29T11:59:32.192 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2023-11-29T11:59:32.192 INFO:tasks.ceph:Archiving crash dumps... 2023-11-29T11:59:32.194 DEBUG:teuthology.misc:Transferring archived files from smithi027:/var/lib/ceph/crash to /home/teuthworker/archive/matan-2023-11-29_08:30:41-crimson-rados-wip-matanb-crimson-snaptrimevent-lifetime-v2-distro-crimson-smithi/7470475/remote/smithi027/crash 2023-11-29T11:59:32.195 DEBUG:teuthology.orchestra.run.smithi027:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-29T11:59:32.246 DEBUG:teuthology.misc:Transferring archived files from smithi139:/var/lib/ceph/crash to /home/teuthworker/archive/matan-2023-11-29_08:30:41-crimson-rados-wip-matanb-crimson-snaptrimevent-lifetime-v2-distro-crimson-smithi/7470475/remote/smithi139/crash 2023-11-29T11:59:32.247 DEBUG:teuthology.orchestra.run.smithi139:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-29T11:59:32.323 INFO:tasks.ceph:Compressing logs... 2023-11-29T11:59:32.324 DEBUG:teuthology.orchestra.run.smithi027:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-29T11:59:32.326 DEBUG:teuthology.orchestra.run.smithi139:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-29T11:59:32.363 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81833.log 2023-11-29T11:59:32.363 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81713.log 2023-11-29T11:59:32.363 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81793.log 2023-11-29T11:59:32.363 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.81833.log: /var/log/ceph/ceph-client.admin.81713.log: gzip -5 --verbose -- 84.7% /var/log/ceph/ceph-osd.3.log 2023-11-29T11:59:32.364 INFO:teuthology.orchestra.run.smithi139.stderr: -- replaced with /var/log/ceph/ceph-client.admin.81833.log.gz 2023-11-29T11:59:32.364 INFO:teuthology.orchestra.run.smithi139.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.81713.log.gz 2023-11-29T11:59:32.364 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.81793.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-11-29T11:59:32.364 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-osd.3.log: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.81793.log.gzgzip 2023-11-29T11:59:32.364 INFO:teuthology.orchestra.run.smithi139.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.81753.log 2023-11-29T11:59:32.364 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-11-29T11:59:32.365 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.81753.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.81753.log.gz 2023-11-29T11:59:32.380 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84022.log 2023-11-29T11:59:32.380 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83702.log 2023-11-29T11:59:32.381 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.79981.log 2023-11-29T11:59:32.381 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.84022.log: /var/log/ceph/ceph-client.admin.83702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84473.log 2023-11-29T11:59:32.381 INFO:teuthology.orchestra.run.smithi027.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.84022.log.gz 2023-11-29T11:59:32.381 INFO:teuthology.orchestra.run.smithi027.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.83702.log.gz 2023-11-29T11:59:32.381 INFO:teuthology.orchestra.run.smithi027.stderr:gzip/var/log/ceph/ceph.tmp-client.admin.79981.log: -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-11-29T11:59:32.381 INFO:teuthology.orchestra.run.smithi027.stderr: 67.7% -- replaced with /var/log/ceph/ceph.tmp-client.admin.79981.log.gz 2023-11-29T11:59:32.381 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.84473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84643.log 2023-11-29T11:59:32.381 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83868.log 2023-11-29T11:59:32.381 INFO:teuthology.orchestra.run.smithi027.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.84473.log.gz 2023-11-29T11:59:32.382 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.84643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85196.log 2023-11-29T11:59:32.382 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.83868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84681.log 2023-11-29T11:59:32.382 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.85196.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.83868.log.gz 2023-11-29T11:59:32.382 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84921.log 2023-11-29T11:59:32.382 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85176.log 2023-11-29T11:59:32.382 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.84681.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.85196.log.gz 2023-11-29T11:59:32.382 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.84921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82368.log 2023-11-29T11:59:32.382 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.85176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82552.log 2023-11-29T11:59:32.382 INFO:teuthology.orchestra.run.smithi027.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.85176.log.gz 2023-11-29T11:59:32.383 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.82368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149213.log 2023-11-29T11:59:32.383 INFO:teuthology.orchestra.run.smithi027.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.84643.log.gz 2023-11-29T11:59:32.383 INFO:teuthology.orchestra.run.smithi027.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.82368.log.gz 2023-11-29T11:59:32.383 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.82552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84665.log 2023-11-29T11:59:32.383 INFO:teuthology.orchestra.run.smithi027.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.84681.log.gz 2023-11-29T11:59:32.383 INFO:teuthology.orchestra.run.smithi027.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.82552.log.gz 2023-11-29T11:59:32.383 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.149213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83699.log 2023-11-29T11:59:32.383 INFO:teuthology.orchestra.run.smithi027.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.84921.log.gz 2023-11-29T11:59:32.383 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.84665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148260.log 2023-11-29T11:59:32.384 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83867.log 2023-11-29T11:59:32.384 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.83699.log: /var/log/ceph/ceph-client.admin.148260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84485.log 2023-11-29T11:59:32.384 INFO:teuthology.orchestra.run.smithi027.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.83699.log.gz 2023-11-29T11:59:32.384 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.83867.log: 90.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.148260.log.gz 2023-11-29T11:59:32.384 INFO:teuthology.orchestra.run.smithi027.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.85175.log 2023-11-29T11:59:32.384 INFO:teuthology.orchestra.run.smithi027.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.84665.log.gz 2023-11-29T11:59:32.384 INFO:teuthology.orchestra.run.smithi027.stderr: 95.6% -- replaced with /var/log/ceph/ceph-client.admin.149213.log.gz 2023-11-29T11:59:32.385 INFO:teuthology.orchestra.run.smithi027.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.83867.log.gz 2023-11-29T11:59:32.385 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.84485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85210.log 2023-11-29T11:59:32.385 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.85175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148936.log 2023-11-29T11:59:32.385 INFO:teuthology.orchestra.run.smithi027.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.84485.log.gz 2023-11-29T11:59:32.385 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.85210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148934.log 2023-11-29T11:59:32.385 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.148936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84442.log 2023-11-29T11:59:32.385 INFO:teuthology.orchestra.run.smithi027.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.85175.log.gz 2023-11-29T11:59:32.385 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.148934.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-29T11:59:32.385 INFO:teuthology.orchestra.run.smithi027.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.85210.log.gz 2023-11-29T11:59:32.386 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.84442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148134.log 2023-11-29T11:59:32.386 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84396.log 2023-11-29T11:59:32.386 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.148134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84625.log 2023-11-29T11:59:32.386 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.84396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148935.log 2023-11-29T11:59:32.386 INFO:teuthology.orchestra.run.smithi027.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.148134.log.gz 2023-11-29T11:59:32.386 INFO:teuthology.orchestra.run.smithi027.stderr: 89.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-29T11:59:32.386 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.84625.log: gzip -5 --verbose 90.0% -- replaced with /var/log/ceph/ceph-client.admin.84396.log.gz 2023-11-29T11:59:32.387 INFO:teuthology.orchestra.run.smithi027.stderr: -- /var/log/ceph/ceph-client.admin.82524.log 2023-11-29T11:59:32.387 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.148935.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.84625.log.gz 2023-11-29T11:59:32.387 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83600.log 2023-11-29T11:59:32.387 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.82524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84845.log 2023-11-29T11:59:32.387 INFO:teuthology.orchestra.run.smithi027.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.82524.log.gz 2023-11-29T11:59:32.387 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.83600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85195.log 86.2% -- replaced with /var/log/ceph/ceph-client.admin.83600.log.gz 2023-11-29T11:59:32.387 INFO:teuthology.orchestra.run.smithi027.stderr: 2023-11-29T11:59:32.387 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.84845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148204.log 2023-11-29T11:59:32.388 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.85195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82289.log 2023-11-29T11:59:32.388 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.148204.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.84845.log.gz 2023-11-29T11:59:32.388 INFO:teuthology.orchestra.run.smithi027.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.85195.log.gz 2023-11-29T11:59:32.388 INFO:teuthology.orchestra.run.smithi027.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.148204.log.gz 2023-11-29T11:59:32.388 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83979.log 2023-11-29T11:59:32.388 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.82289.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-11-29T11:59:32.388 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.83979.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.82289.log.gz 2023-11-29T11:59:32.388 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148205.log 2023-11-29T11:59:32.389 INFO:teuthology.orchestra.run.smithi027.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.83979.log.gz 2023-11-29T11:59:32.389 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84354.log 2023-11-29T11:59:32.389 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84448.log 2023-11-29T11:59:32.389 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.148205.log: /var/log/ceph/ceph-client.admin.84354.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.148205.log.gz 2023-11-29T11:59:32.389 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85211.log 2023-11-29T11:59:32.389 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.84448.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.84448.log.gz 2023-11-29T11:59:32.389 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84517.log 2023-11-29T11:59:32.389 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.85211.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.85211.log.gz 2023-11-29T11:59:32.389 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83368.log 2023-11-29T11:59:32.390 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.84517.log: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.84354.log.gz 2023-11-29T11:59:32.390 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148665.log 2023-11-29T11:59:32.390 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.83368.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.83368.log.gz 2023-11-29T11:59:32.390 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85108.log 2023-11-29T11:59:32.390 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.148665.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.148665.log.gz 2023-11-29T11:59:32.390 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83516.log 2023-11-29T11:59:32.390 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.85108.log: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.85108.log.gz 2023-11-29T11:59:32.390 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84977.log 2023-11-29T11:59:32.391 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.83516.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.83516.log.gz 2023-11-29T11:59:32.394 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85093.log 2023-11-29T11:59:32.394 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.84977.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.84977.log.gz 2023-11-29T11:59:32.395 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84806.log 2023-11-29T11:59:32.395 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.85093.log: 67.7% -- replaced with /var/log/ceph/ceph-client.admin.85093.log.gz 2023-11-29T11:59:32.395 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148259.log 2023-11-29T11:59:32.395 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.84806.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.84806.log.gz 2023-11-29T11:59:32.395 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85054.log 2023-11-29T11:59:32.395 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.148259.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.148259.log.gz 2023-11-29T11:59:32.396 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148261.log 2023-11-29T11:59:32.396 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.85054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83870.log 2023-11-29T11:59:32.412 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.148261.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.148261.log.gz 2023-11-29T11:59:32.412 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84834.log 2023-11-29T11:59:32.412 INFO:teuthology.orchestra.run.smithi027.stderr: 96.2% -- replaced with /var/log/ceph/ceph-client.admin.148936.log.gz 2023-11-29T11:59:32.412 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.83870.log: 96.3% -- replaced with /var/log/ceph/ceph-client.admin.148934.log.gz 2023-11-29T11:59:32.412 INFO:teuthology.orchestra.run.smithi027.stderr: 86.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84575.log 2023-11-29T11:59:32.413 INFO:teuthology.orchestra.run.smithi027.stderr: -- replaced with /var/log/ceph/ceph-client.admin.83870.log.gz 2023-11-29T11:59:32.413 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84911.log 2023-11-29T11:59:32.415 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.84834.log: /var/log/ceph/ceph-client.admin.84575.log: 96.2% -- replaced with /var/log/ceph/ceph-client.admin.148935.log.gz 2023-11-29T11:59:32.415 INFO:teuthology.orchestra.run.smithi027.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.84834.log.gz 2023-11-29T11:59:32.415 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84926.log 2023-11-29T11:59:32.415 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.84911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148937.log 2023-11-29T11:59:32.416 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.84926.log: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.84926.log.gz 2023-11-29T11:59:32.416 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83700.log 2023-11-29T11:59:32.418 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.148937.log: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.84911.log.gz 2023-11-29T11:59:32.418 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84064.log 2023-11-29T11:59:32.419 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.83700.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.83700.log.gz 2023-11-29T11:59:32.419 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83869.log 2023-11-29T11:59:32.423 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.84064.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.84064.log.gz 2023-11-29T11:59:32.423 INFO:teuthology.orchestra.run.smithi027.stderr: 96.1% -- replaced with /var/log/ceph/ceph-client.admin.84442.log.gz 2023-11-29T11:59:32.423 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-11-29T11:59:32.423 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.83869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83474.log 2023-11-29T11:59:32.423 INFO:teuthology.orchestra.run.smithi027.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.83869.log.gz 2023-11-29T11:59:32.423 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148136.log 2023-11-29T11:59:32.423 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.83474.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.83474.log.gz 2023-11-29T11:59:32.424 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148135.log 2023-11-29T11:59:32.428 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.148136.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.148136.log.gz 2023-11-29T11:59:32.428 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83432.log 2023-11-29T11:59:32.429 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.148135.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.148135.log.gz 2023-11-29T11:59:32.429 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-29T11:59:32.429 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.83432.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.83432.log.gz 2023-11-29T11:59:32.429 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148933.log 2023-11-29T11:59:32.429 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph.log: 95.2% -- replaced with /var/log/ceph/ceph-client.admin.84575.log.gz 2023-11-29T11:59:32.429 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84415.log 2023-11-29T11:59:32.429 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.148933.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.148933.log.gz 2023-11-29T11:59:32.429 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83701.log 2023-11-29T11:59:32.429 INFO:teuthology.orchestra.run.smithi027.stderr: 87.4% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-29T11:59:32.432 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.84415.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.84415.log.gz 2023-11-29T11:59:32.433 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84374.log 2023-11-29T11:59:32.433 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.83701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83558.log 2023-11-29T11:59:32.433 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.84374.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.83701.log.gz 2023-11-29T11:59:32.433 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148666.log 2023-11-29T11:59:32.433 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.83558.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.83558.log.gz 2023-11-29T11:59:32.433 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148667.log 2023-11-29T11:59:32.433 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.148666.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.148666.log.gz 2023-11-29T11:59:32.434 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84707.log 2023-11-29T11:59:32.434 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.148667.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.148667.log.gz 2023-11-29T11:59:32.435 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.admin.84707.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.84707.log.gz 2023-11-29T11:59:32.443 INFO:teuthology.orchestra.run.smithi027.stderr: 96.0% -- replaced with /var/log/ceph/ceph-client.admin.85054.log.gz 2023-11-29T11:59:32.444 INFO:teuthology.orchestra.run.smithi027.stderr: 94.6% -- replaced with /var/log/ceph/ceph-client.admin.84374.log.gz 2023-11-29T11:59:32.458 INFO:teuthology.orchestra.run.smithi027.stderr: 96.3% -- replaced with /var/log/ceph/ceph-client.admin.148937.log.gz 2023-11-29T11:59:32.511 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-osd.2.log: 93.3% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-11-29T11:59:32.819 INFO:teuthology.orchestra.run.smithi027.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.84517.log.gz 2023-11-29T11:59:33.642 INFO:teuthology.orchestra.run.smithi027.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-11-29T11:59:34.748 INFO:teuthology.orchestra.run.smithi027.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-11-29T11:59:42.412 INFO:teuthology.orchestra.run.smithi139.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-11-29T11:59:42.573 INFO:teuthology.orchestra.run.smithi139.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-11-29T11:59:42.575 INFO:teuthology.orchestra.run.smithi139.stderr: 2023-11-29T11:59:42.575 INFO:teuthology.orchestra.run.smithi139.stderr:real 0m10.233s 2023-11-29T11:59:42.575 INFO:teuthology.orchestra.run.smithi139.stderr:user 0m19.562s 2023-11-29T11:59:42.575 INFO:teuthology.orchestra.run.smithi139.stderr:sys 0m0.855s 2023-11-29T11:59:43.825 INFO:teuthology.orchestra.run.smithi027.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-11-29T11:59:43.827 INFO:teuthology.orchestra.run.smithi027.stderr: 2023-11-29T11:59:43.827 INFO:teuthology.orchestra.run.smithi027.stderr:real 0m11.489s 2023-11-29T11:59:43.827 INFO:teuthology.orchestra.run.smithi027.stderr:user 0m15.332s 2023-11-29T11:59:43.827 INFO:teuthology.orchestra.run.smithi027.stderr:sys 0m0.614s 2023-11-29T11:59:43.828 INFO:tasks.ceph:Archiving logs... 2023-11-29T11:59:43.828 DEBUG:teuthology.misc:Transferring archived files from smithi027:/var/log/ceph to /home/teuthworker/archive/matan-2023-11-29_08:30:41-crimson-rados-wip-matanb-crimson-snaptrimevent-lifetime-v2-distro-crimson-smithi/7470475/remote/smithi027/log 2023-11-29T11:59:43.829 DEBUG:teuthology.orchestra.run.smithi027:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-29T11:59:46.215 DEBUG:teuthology.misc:Transferring archived files from smithi139:/var/log/ceph to /home/teuthworker/archive/matan-2023-11-29_08:30:41-crimson-rados-wip-matanb-crimson-snaptrimevent-lifetime-v2-distro-crimson-smithi/7470475/remote/smithi139/log 2023-11-29T11:59:46.216 DEBUG:teuthology.orchestra.run.smithi139:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-29T11:59:49.413 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_3d760f113bd9f3a2e513474d34227633cd06f1ea/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_ceph_ceph_3d760f113bd9f3a2e513474d34227633cd06f1ea/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_ceph_ceph_3d760f113bd9f3a2e513474d34227633cd06f1ea/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_ceph_ceph_3d760f113bd9f3a2e513474d34227633cd06f1ea/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph_3d760f113bd9f3a2e513474d34227633cd06f1ea/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph_3d760f113bd9f3a2e513474d34227633cd06f1ea/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi027 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-11-29T11:59:49.423 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-11-29T11:59:49.433 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_3d760f113bd9f3a2e513474d34227633cd06f1ea/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_ceph_ceph_3d760f113bd9f3a2e513474d34227633cd06f1ea/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_ceph_ceph_3d760f113bd9f3a2e513474d34227633cd06f1ea/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_ceph_ceph_3d760f113bd9f3a2e513474d34227633cd06f1ea/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph_3d760f113bd9f3a2e513474d34227633cd06f1ea/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph_3d760f113bd9f3a2e513474d34227633cd06f1ea/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi027 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-11-29T11:59:49.437 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-11-29T11:59:49.437 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-29T11:59:49.443 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-29T11:59:49.527 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-11-29T11:59:49.536 INFO:teuthology.task.clock:Checking final clock skew... 2023-11-29T11:59:49.537 DEBUG:teuthology.orchestra.run.smithi027:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-29T11:59:49.540 DEBUG:teuthology.orchestra.run.smithi139:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-29T11:59:49.553 INFO:teuthology.orchestra.run.smithi027.stderr:bash: line 1: ntpq: command not found 2023-11-29T11:59:49.556 INFO:teuthology.orchestra.run.smithi139.stderr:bash: line 1: ntpq: command not found 2023-11-29T11:59:49.557 INFO:teuthology.orchestra.run.smithi027.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-29T11:59:49.558 INFO:teuthology.orchestra.run.smithi027.stdout:=============================================================================== 2023-11-29T11:59:49.558 INFO:teuthology.orchestra.run.smithi027.stdout:^+ hv01.front.sepia.ceph.com 2 8 377 48 +2349us[+2349us] +/- 83ms 2023-11-29T11:59:49.558 INFO:teuthology.orchestra.run.smithi027.stdout:^* hv02.front.sepia.ceph.com 3 8 377 234 -1041us[-1024us] +/- 64ms 2023-11-29T11:59:49.558 INFO:teuthology.orchestra.run.smithi027.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 38 -801us[ -801us] +/- 82ms 2023-11-29T11:59:49.558 INFO:teuthology.orchestra.run.smithi027.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-11-29T11:59:49.560 INFO:teuthology.orchestra.run.smithi139.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-29T11:59:49.560 INFO:teuthology.orchestra.run.smithi139.stdout:=============================================================================== 2023-11-29T11:59:49.560 INFO:teuthology.orchestra.run.smithi139.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 41 +2355us[+2380us] +/- 83ms 2023-11-29T11:59:49.560 INFO:teuthology.orchestra.run.smithi139.stdout:^* hv02.front.sepia.ceph.com 3 7 377 30 -989us[ -963us] +/- 51ms 2023-11-29T11:59:49.560 INFO:teuthology.orchestra.run.smithi139.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 31 -731us[ -706us] +/- 82ms 2023-11-29T11:59:49.561 INFO:teuthology.orchestra.run.smithi139.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-11-29T11:59:49.561 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-11-29T11:59:49.570 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-11-29T11:59:49.570 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-11-29T11:59:49.580 DEBUG:teuthology.orchestra.run.smithi027:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-11-29T11:59:49.707 DEBUG:teuthology.orchestra.run.smithi139:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-11-29T11:59:49.804 DEBUG:teuthology.orchestra.run.smithi027:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-29T11:59:49.840 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-29T11:59:49.841 DEBUG:teuthology.orchestra.run.smithi139:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-29T11:59:49.873 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-29T11:59:49.874 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-11-29T11:59:49.884 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-11-29T11:59:49.894 INFO:teuthology.task.internal:Duration was 11856.505253 seconds 2023-11-29T11:59:49.895 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-11-29T11:59:49.905 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-11-29T11:59:49.905 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-29T11:59:49.908 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-29T11:59:49.956 INFO:teuthology.orchestra.run.smithi027.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-29T11:59:49.958 INFO:teuthology.orchestra.run.smithi139.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-29T11:59:50.335 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-11-29T11:59:50.335 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi027.front.sepia.ceph.com 2023-11-29T11:59:50.336 DEBUG:teuthology.orchestra.run.smithi027:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-29T11:59:50.357 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi139.front.sepia.ceph.com 2023-11-29T11:59:50.357 DEBUG:teuthology.orchestra.run.smithi139:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-29T11:59:50.382 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-11-29T11:59:50.383 DEBUG:teuthology.orchestra.run.smithi027:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-29T11:59:50.400 DEBUG:teuthology.orchestra.run.smithi139:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-29T11:59:50.451 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-11-29T11:59:50.452 DEBUG:teuthology.orchestra.run.smithi027:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-29T11:59:50.472 DEBUG:teuthology.orchestra.run.smithi139:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-29T11:59:50.588 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-11-29T11:59:50.598 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-11-29T11:59:50.599 DEBUG:teuthology.orchestra.run.smithi027:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-29T11:59:50.630 DEBUG:teuthology.orchestra.run.smithi139:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-29T11:59:50.657 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-11-29T11:59:50.667 DEBUG:teuthology.orchestra.run.smithi027:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-29T11:59:50.672 DEBUG:teuthology.orchestra.run.smithi139:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-29T11:59:50.699 INFO:teuthology.orchestra.run.smithi027.stdout:kernel.core_pattern = core 2023-11-29T11:59:50.723 INFO:teuthology.orchestra.run.smithi139.stdout:kernel.core_pattern = core 2023-11-29T11:59:50.757 DEBUG:teuthology.orchestra.run.smithi027:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-29T11:59:50.778 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-29T11:59:50.779 DEBUG:teuthology.orchestra.run.smithi139:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-29T11:59:50.811 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-29T11:59:50.811 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-11-29T11:59:50.820 INFO:teuthology.task.internal:Transferring archived files... 2023-11-29T11:59:50.821 DEBUG:teuthology.misc:Transferring archived files from smithi027:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/matan-2023-11-29_08:30:41-crimson-rados-wip-matanb-crimson-snaptrimevent-lifetime-v2-distro-crimson-smithi/7470475/remote/smithi027 2023-11-29T11:59:50.821 DEBUG:teuthology.orchestra.run.smithi027:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-29T11:59:50.883 DEBUG:teuthology.misc:Transferring archived files from smithi139:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/matan-2023-11-29_08:30:41-crimson-rados-wip-matanb-crimson-snaptrimevent-lifetime-v2-distro-crimson-smithi/7470475/remote/smithi139 2023-11-29T11:59:50.883 DEBUG:teuthology.orchestra.run.smithi139:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-29T11:59:50.918 INFO:teuthology.task.internal:Removing archive directory... 2023-11-29T11:59:50.919 DEBUG:teuthology.orchestra.run.smithi027:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-29T11:59:50.921 DEBUG:teuthology.orchestra.run.smithi139:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-29T11:59:50.968 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-11-29T11:59:50.985 INFO:teuthology.task.internal:Not uploading archives. 2023-11-29T11:59:50.986 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-11-29T11:59:51.000 INFO:teuthology.task.internal:Tidying up after the test... 2023-11-29T11:59:51.000 DEBUG:teuthology.orchestra.run.smithi027:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-29T11:59:51.002 DEBUG:teuthology.orchestra.run.smithi139:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-29T11:59:51.015 INFO:teuthology.orchestra.run.smithi027.stdout: 265987 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Nov 29 11:59 /home/ubuntu/cephtest 2023-11-29T11:59:51.016 INFO:teuthology.orchestra.run.smithi027.stdout: 402587 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Nov 29 08:56 /home/ubuntu/cephtest/mnt.0 2023-11-29T11:59:51.016 INFO:teuthology.orchestra.run.smithi027.stdout: 402588 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Nov 29 08:57 /home/ubuntu/cephtest/mnt.0/client.0 2023-11-29T11:59:51.016 INFO:teuthology.orchestra.run.smithi027.stdout: 538180 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 29 08:57 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-11-29T11:59:51.016 INFO:teuthology.orchestra.run.smithi027.stdout: 538191 60 -rw-r--r-- 1 ubuntu ubuntu 59016 Nov 29 08:57 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_tier_pp.log 2023-11-29T11:59:51.016 INFO:teuthology.orchestra.run.smithi027.stdout: 538196 8 -rw-r--r-- 1 ubuntu ubuntu 4484 Nov 29 08:57 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_stat_pp.log 2023-11-29T11:59:51.016 INFO:teuthology.orchestra.run.smithi027.stdout: 538188 8 -rw-r--r-- 1 ubuntu ubuntu 7588 Nov 29 08:58 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_lock.log 2023-11-29T11:59:51.016 INFO:teuthology.orchestra.run.smithi027.stdout: 538205 4 -rw-r--r-- 1 ubuntu ubuntu 1716 Nov 29 08:59 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_c_read_operations.log 2023-11-29T11:59:51.016 INFO:teuthology.orchestra.run.smithi027.stdout: 538207 4 -rw-r--r-- 1 ubuntu ubuntu 2715 Nov 29 09:04 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_list_parallel.log 2023-11-29T11:59:51.017 INFO:teuthology.orchestra.run.smithi027.stdout: 538190 8 -rw-r--r-- 1 ubuntu ubuntu 7743 Nov 29 09:00 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_misc_pp.log 2023-11-29T11:59:51.017 INFO:teuthology.orchestra.run.smithi027.stdout: 538181 12 -rw-r--r-- 1 ubuntu ubuntu 9376 Nov 29 09:03 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_aio.log 2023-11-29T11:59:51.017 INFO:teuthology.orchestra.run.smithi027.stdout: 538189 4 -rw-r--r-- 1 ubuntu ubuntu 3099 Nov 29 08:58 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_misc.log 2023-11-29T11:59:51.017 INFO:teuthology.orchestra.run.smithi027.stdout: 538204 4 -rw-r--r-- 1 ubuntu ubuntu 1171 Nov 29 08:57 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_cls_remote_reads.log 2023-11-29T11:59:51.017 INFO:teuthology.orchestra.run.smithi027.stdout: 538201 4 -rw-r--r-- 1 ubuntu ubuntu 592 Nov 29 08:57 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_cmd_pp.log 2023-11-29T11:59:51.017 INFO:teuthology.orchestra.run.smithi027.stdout: 538200 4 -rw-r--r-- 1 ubuntu ubuntu 2451 Nov 29 08:58 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_cmd.log 2023-11-29T11:59:51.017 INFO:teuthology.orchestra.run.smithi027.stdout: 538198 4 -rw-r--r-- 1 ubuntu ubuntu 3975 Nov 29 08:59 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_watch_notify.log 2023-11-29T11:59:51.017 INFO:teuthology.orchestra.run.smithi027.stdout: 538193 8 -rw-r--r-- 1 ubuntu ubuntu 7137 Nov 29 08:59 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_snapshots.log 2023-11-29T11:59:51.017 INFO:teuthology.orchestra.run.smithi027.stdout: 538186 24 -rw-r--r-- 1 ubuntu ubuntu 24380 Nov 29 08:57 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_asio.log 2023-11-29T11:59:51.018 INFO:teuthology.orchestra.run.smithi027.stdout: 538195 8 -rw-r--r-- 1 ubuntu ubuntu 4325 Nov 29 08:57 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_stat.log 2023-11-29T11:59:51.018 INFO:teuthology.orchestra.run.smithi027.stdout: 538208 4 -rw-r--r-- 1 ubuntu ubuntu 1311 Nov 29 09:01 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_delete_pools_parallel.log 2023-11-29T11:59:51.018 INFO:teuthology.orchestra.run.smithi027.stdout: 538202 4 -rw-r--r-- 1 ubuntu ubuntu 2630 Nov 29 08:58 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_service_pp.log 2023-11-29T11:59:51.018 INFO:teuthology.orchestra.run.smithi027.stdout: 538203 4 -rw-r--r-- 1 ubuntu ubuntu 959 Nov 29 08:59 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_c_write_operations.log 2023-11-29T11:59:51.018 INFO:teuthology.orchestra.run.smithi027.stdout: 538199 4 -rw-r--r-- 1 ubuntu ubuntu 2530 Nov 29 08:57 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_service.log 2023-11-29T11:59:51.018 INFO:teuthology.orchestra.run.smithi027.stdout: 538182 4 -rw-r--r-- 1 ubuntu ubuntu 2262 Nov 29 09:04 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_aio_pp.log 2023-11-29T11:59:51.018 INFO:teuthology.orchestra.run.smithi027.stdout: 538184 16 -rw-r--r-- 1 ubuntu ubuntu 15537 Nov 29 08:58 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_io_pp.log 2023-11-29T11:59:51.018 INFO:teuthology.orchestra.run.smithi027.stdout: 538206 4 -rw-r--r-- 1 ubuntu ubuntu 1040 Nov 29 09:01 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_open_pools_parallel.log 2023-11-29T11:59:51.019 INFO:teuthology.orchestra.run.smithi027.stdout: 538197 8 -rw-r--r-- 1 ubuntu ubuntu 6086 Nov 29 09:00 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_watch_notify_pp.log 2023-11-29T11:59:51.019 INFO:teuthology.orchestra.run.smithi027.stdout: 538187 8 -rw-r--r-- 1 ubuntu ubuntu 7836 Nov 29 08:58 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_lock_pp.log 2023-11-29T11:59:51.019 INFO:teuthology.orchestra.run.smithi027.stdout: 538192 4 -rw-r--r-- 1 ubuntu ubuntu 1611 Nov 29 08:58 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_pool.log 2023-11-29T11:59:51.019 INFO:teuthology.orchestra.run.smithi027.stdout: 538185 8 -rw-r--r-- 1 ubuntu ubuntu 5656 Nov 29 09:03 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_list.log 2023-11-29T11:59:51.019 INFO:teuthology.orchestra.run.smithi027.stdout: 538194 12 -rw-r--r-- 1 ubuntu ubuntu 9864 Nov 29 08:59 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_snapshots_pp.log 2023-11-29T11:59:51.019 INFO:teuthology.orchestra.run.smithi027.stdout: 538183 12 -rw-r--r-- 1 ubuntu ubuntu 9561 Nov 29 08:58 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_io.log 2023-11-29T11:59:51.020 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-29T11:59:51.020 INFO:teuthology.orchestra.run.smithi027.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-11-29T11:59:51.020 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_3d760f113bd9f3a2e513474d34227633cd06f1ea/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_ceph_ceph_3d760f113bd9f3a2e513474d34227633cd06f1ea/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_ceph_ceph_3d760f113bd9f3a2e513474d34227633cd06f1ea/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_ceph_ceph_3d760f113bd9f3a2e513474d34227633cd06f1ea/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph_3d760f113bd9f3a2e513474d34227633cd06f1ea/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph_3d760f113bd9f3a2e513474d34227633cd06f1ea/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi027 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi027 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-11-29T11:59:51.032 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-11-29T11:59:51.047 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-11-29T11:59:51.057 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi027 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-11-29T11:59:51.057 INFO:teuthology.nuke:Checking targets against current locks 2023-11-29T11:59:51.065 INFO:teuthology.orchestra.run.smithi139.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 29 11:59 /home/ubuntu/cephtest 2023-11-29T11:59:51.083 DEBUG:teuthology.nuke:shortname: smithi027 2023-11-29T11:59:51.084 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-29T11:59:51.105 DEBUG:teuthology.nuke:shortname: smithi139 2023-11-29T11:59:51.106 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-29T11:59:51.110 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi027.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2023-11-29_08:30:41-crimson-rados-wip-matanb-crimson-snaptrimevent-lifetime-v2-distro-crimson-smithi/7470475', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-29 08:31:43.306484', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLQR7FSsM2WG3bXLSyzCfiqjoRZynboasDBaX+6yp30CSoYVR34oL7LJIIvOpNSVnLht3UOfgZV/B9cLBjK3TCQ='} 2023-11-29T11:59:51.123 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi139.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2023-11-29_08:30:41-crimson-rados-wip-matanb-crimson-snaptrimevent-lifetime-v2-distro-crimson-smithi/7470475', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-29 08:31:43.304627', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFcL3nDrki+eYUfUljt+Tv4/NglX6E0ioeMMbcbLmTVq5cwRywPFKOvY7pMHRugFQhr24ZNA8MTH7lpIphM1hh0='} 2023-11-29T11:59:51.150 INFO:teuthology.orchestra.console.smithi027:Power off 2023-11-29T11:59:51.151 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-29T11:59:51.180 DEBUG:teuthology.orchestra.console.smithi027:power off output: Chassis Power Control: Down/Off 2023-11-29T11:59:51.180 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T11:59:51.198 INFO:teuthology.orchestra.console.smithi139:Power off 2023-11-29T11:59:51.198 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-29T11:59:51.207 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on 2023-11-29T11:59:51.221 DEBUG:teuthology.orchestra.console.smithi139:power off output: Chassis Power Control: Down/Off 2023-11-29T11:59:51.222 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T11:59:51.244 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is on 2023-11-29T11:59:55.208 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T11:59:55.245 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T11:59:55.320 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on 2023-11-29T11:59:55.356 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is on 2023-11-29T11:59:59.322 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T11:59:59.356 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T11:59:59.431 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on 2023-11-29T11:59:59.466 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is on 2023-11-29T12:00:03.434 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T12:00:03.467 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T12:00:03.544 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off 2023-11-29T12:00:03.579 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is off 2023-11-29T12:00:03.645 INFO:teuthology.orchestra.console.smithi027:Power off completed 2023-11-29T12:00:03.682 INFO:teuthology.orchestra.console.smithi139:Power off completed 2023-11-29T12:00:03.788 INFO:teuthology.run:Summary data: description: crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rados_api_tests} duration: 11856.505253314972 failure_reason: 'Command failed (workunit test rados/test.sh) on smithi027 with status 124: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3d760f113bd9f3a2e513474d34227633cd06f1ea TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh''' flavor: crimson owner: scheduled_matan@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=5c0b6742985f466d82e215c3dbb4c600 status: fail success: false 2023-11-29T12:00:03.788 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T12:00:03.866 INFO:teuthology.run:FAIL