2023-11-02T09:14:20.100 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-02T09:14:20.101 DEBUG:teuthology.run:Teuthology command: teuthology --description rgw:notifications/{beast bluestore-bitmap centos_latest fixed-2 ignore-pg-availability overrides tasks/{0-install test_amqp test_kafka test_others}} --name alimasa-2023-11-02_07:21:35-rgw:notifications-wip-alimasa-2pc-remove-issue-distro-default-smithi --archive /home/teuthworker/archive/alimasa-2023-11-02_07:21:35-rgw:notifications-wip-alimasa-2pc-remove-issue-distro-default-smithi/7444142 --verbose --owner scheduled_alimasa@teuthology -- /home/teuthworker/archive/alimasa-2023-11-02_07:21:35-rgw:notifications-wip-alimasa-2pc-remove-issue-distro-default-smithi/7444142/orig.config.yaml 2023-11-02T09:14:20.143 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T09:14:20.244 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/alimasa-2023-11-02_07:21:35-rgw:notifications-wip-alimasa-2pc-remove-issue-distro-default-smithi/7444142 branch: wip-alimasa-2pc-remove-issue description: rgw:notifications/{beast bluestore-bitmap centos_latest fixed-2 ignore-pg-availability overrides tasks/{0-install test_amqp test_kafka test_others}} email: null first_in_suite: false job_id: '7444142' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: alimasa-2023-11-02_07:21:35-rgw:notifications-wip-alimasa-2pc-remove-issue-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-alimasa-2pc-remove-issue ceph: conf: client: debug rgw: 20 rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= setgroup: ceph setuser: ceph global: osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled sha1: 84d22000a111c0f6e32c6bf0246b078c52c8bdde ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: extra_system_packages: deb: - default-jre rpm: - java flavor: default sha1: 84d22000a111c0f6e32c6bf0246b078c52c8bdde rgw: frontend: beast storage classes: LUKEWARM, FROZEN s3tests: storage classes: LUKEWARM, FROZEN thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-alimasa-2pc-remove-issue sha1: 84d22000a111c0f6e32c6bf0246b078c52c8bdde owner: scheduled_alimasa@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b sha1: 84d22000a111c0f6e32c6bf0246b078c52c8bdde sleep_before_teardown: 0 suite: rgw:notifications suite_branch: wip-alimasa-2pc-remove-issue suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 84d22000a111c0f6e32c6bf0246b078c52c8bdde targets: smithi156.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLny8vT41KenT/XBLKWfPw5JqXTJ6Dgk/RyoCDIyrrrN3uH7A/XLi7LA5lj3S/JRoWvG5D7+etWFk2POCDrQXys= smithi186.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEUgB4WEEEueDe7qvQI1h000GrLx2Uh8nxJMxsHr7LwwnVmTIxtBSW/5uo51qz3GYsdvIQJwPOsCA+YdWOisM+o= tasks: - install: null - ceph: null - openssl_keys: null - rgw: client.0: null - rabbitmq: client.0: null - notification-tests: client.0: extra_attr: - amqp_test rgw_server: client.0 - kafka: client.0: kafka_version: 2.6.0 - notification-tests: client.0: extra_attr: - kafka_test rgw_server: client.0 - notification-tests: client.0: rgw_server: client.0 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 6899cd26fceddb2fec83dc1a1349394b28c8998e timestamp: 2023-11-02_07:21:35 tube: smithi user: alimasa verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.770726 2023-11-02T09:14:20.245 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa; will attempt to use it 2023-11-02T09:14:20.369 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks 2023-11-02T09:14:20.370 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-11-02T09:14:20.372 INFO:teuthology.task.internal:Checking packages... 2023-11-02T09:14:20.405 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '84d22000a111c0f6e32c6bf0246b078c52c8bdde' 2023-11-02T09:14:20.406 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-11-02T09:14:20.406 INFO:teuthology.packaging:ref: None 2023-11-02T09:14:20.407 INFO:teuthology.packaging:tag: None 2023-11-02T09:14:20.407 INFO:teuthology.packaging:branch: wip-alimasa-2pc-remove-issue 2023-11-02T09:14:20.407 INFO:teuthology.packaging:sha1: 84d22000a111c0f6e32c6bf0246b078c52c8bdde 2023-11-02T09:14:20.408 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-alimasa-2pc-remove-issue 2023-11-02T09:14:20.548 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-6872.g84d22000 2023-11-02T09:14:20.549 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-11-02T09:14:20.556 INFO:teuthology.task.internal:no buildpackages task found 2023-11-02T09:14:20.556 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-11-02T09:14:20.615 INFO:teuthology.task.internal:Saving configuration 2023-11-02T09:14:20.632 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-11-02T09:14:20.639 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-02T09:14:20.664 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi156.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/alimasa-2023-11-02_07:21:35-rgw:notifications-wip-alimasa-2pc-remove-issue-distro-default-smithi/7444142', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-02 09:09:06.235620', 'locked_by': 'scheduled_alimasa@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLny8vT41KenT/XBLKWfPw5JqXTJ6Dgk/RyoCDIyrrrN3uH7A/XLi7LA5lj3S/JRoWvG5D7+etWFk2POCDrQXys='} 2023-11-02T09:14:20.689 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi186.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/alimasa-2023-11-02_07:21:35-rgw:notifications-wip-alimasa-2pc-remove-issue-distro-default-smithi/7444142', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-02 09:09:06.237064', 'locked_by': 'scheduled_alimasa@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEUgB4WEEEueDe7qvQI1h000GrLx2Uh8nxJMxsHr7LwwnVmTIxtBSW/5uo51qz3GYsdvIQJwPOsCA+YdWOisM+o='} 2023-11-02T09:14:20.690 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-11-02T09:14:20.697 INFO:teuthology.task.internal:roles: ubuntu@smithi156.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2023-11-02T09:14:20.697 INFO:teuthology.task.internal:roles: ubuntu@smithi186.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2023-11-02T09:14:20.697 INFO:teuthology.run_tasks:Running task console_log... 2023-11-02T09:14:20.783 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f49d51f1940>, signals=[15]) 2023-11-02T09:14:20.784 INFO:teuthology.run_tasks:Running task internal.connect... 2023-11-02T09:14:20.790 INFO:teuthology.task.internal:Opening connections... 2023-11-02T09:14:20.791 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi156.front.sepia.ceph.com 2023-11-02T09:14:20.792 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-02T09:14:20.881 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi186.front.sepia.ceph.com 2023-11-02T09:14:20.883 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-02T09:14:20.964 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-11-02T09:14:20.972 DEBUG:teuthology.orchestra.run.smithi156:> uname -m 2023-11-02T09:14:20.990 INFO:teuthology.orchestra.run.smithi156.stdout:x86_64 2023-11-02T09:14:20.991 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release 2023-11-02T09:14:21.051 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="CentOS Stream" 2023-11-02T09:14:21.051 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="9" 2023-11-02T09:14:21.052 INFO:teuthology.orchestra.run.smithi156.stdout:ID="centos" 2023-11-02T09:14:21.052 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="rhel fedora" 2023-11-02T09:14:21.052 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="9" 2023-11-02T09:14:21.052 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el9" 2023-11-02T09:14:21.053 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-02T09:14:21.053 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31" 2023-11-02T09:14:21.053 INFO:teuthology.orchestra.run.smithi156.stdout:LOGO="fedora-logo-icon" 2023-11-02T09:14:21.053 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-02T09:14:21.053 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://centos.org/" 2023-11-02T09:14:21.054 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-02T09:14:21.054 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-02T09:14:21.054 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-02T09:14:21.055 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2023-11-02T09:14:21.082 DEBUG:teuthology.orchestra.run.smithi186:> uname -m 2023-11-02T09:14:21.101 INFO:teuthology.orchestra.run.smithi186.stdout:x86_64 2023-11-02T09:14:21.102 DEBUG:teuthology.orchestra.run.smithi186:> cat /etc/os-release 2023-11-02T09:14:21.158 INFO:teuthology.orchestra.run.smithi186.stdout:NAME="CentOS Stream" 2023-11-02T09:14:21.159 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION="9" 2023-11-02T09:14:21.159 INFO:teuthology.orchestra.run.smithi186.stdout:ID="centos" 2023-11-02T09:14:21.159 INFO:teuthology.orchestra.run.smithi186.stdout:ID_LIKE="rhel fedora" 2023-11-02T09:14:21.159 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_ID="9" 2023-11-02T09:14:21.160 INFO:teuthology.orchestra.run.smithi186.stdout:PLATFORM_ID="platform:el9" 2023-11-02T09:14:21.160 INFO:teuthology.orchestra.run.smithi186.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-02T09:14:21.160 INFO:teuthology.orchestra.run.smithi186.stdout:ANSI_COLOR="0;31" 2023-11-02T09:14:21.160 INFO:teuthology.orchestra.run.smithi186.stdout:LOGO="fedora-logo-icon" 2023-11-02T09:14:21.160 INFO:teuthology.orchestra.run.smithi186.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-02T09:14:21.161 INFO:teuthology.orchestra.run.smithi186.stdout:HOME_URL="https://centos.org/" 2023-11-02T09:14:21.161 INFO:teuthology.orchestra.run.smithi186.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-02T09:14:21.161 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-02T09:14:21.161 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-02T09:14:21.162 INFO:teuthology.lock.ops:Updating smithi186.front.sepia.ceph.com on lock server 2023-11-02T09:14:21.182 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-11-02T09:14:21.192 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-11-02T09:14:21.198 INFO:teuthology.task.internal:Checking for old test directory... 2023-11-02T09:14:21.198 DEBUG:teuthology.orchestra.run.smithi156:> test '!' -e /home/ubuntu/cephtest 2023-11-02T09:14:21.202 DEBUG:teuthology.orchestra.run.smithi186:> test '!' -e /home/ubuntu/cephtest 2023-11-02T09:14:21.223 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-11-02T09:14:21.229 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-11-02T09:14:21.230 DEBUG:teuthology.orchestra.run.smithi156:> test -z $(ls -A /var/lib/ceph) 2023-11-02T09:14:21.263 DEBUG:teuthology.orchestra.run.smithi186:> test -z $(ls -A /var/lib/ceph) 2023-11-02T09:14:21.367 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-11-02T09:14:21.426 INFO:teuthology.run_tasks:Running task kernel... 2023-11-02T09:14:21.441 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-11-02T09:14:21.442 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-11-02T09:14:21.443 DEBUG:teuthology.orchestra.run.smithi156:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-02T09:14:21.444 DEBUG:teuthology.orchestra.run.smithi186:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-02T09:14:21.460 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-02T09:14:21.461 DEBUG:teuthology.orchestra.run.smithi156:> uname -r 2023-11-02T09:14:21.462 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-02T09:14:21.463 DEBUG:teuthology.orchestra.run.smithi186:> uname -r 2023-11-02T09:14:21.518 INFO:teuthology.orchestra.run.smithi186.stdout:5.14.0-361.el9.x86_64 2023-11-02T09:14:21.519 INFO:teuthology.task.kernel:Running kernel on smithi186: 5.14.0-361.el9.x86_64 2023-11-02T09:14:21.519 DEBUG:teuthology.orchestra.run.smithi186:> sudo yum install -y kernel 2023-11-02T09:14:21.527 INFO:teuthology.orchestra.run.smithi156.stdout:5.14.0-361.el9.x86_64 2023-11-02T09:14:21.528 INFO:teuthology.task.kernel:Running kernel on smithi156: 5.14.0-361.el9.x86_64 2023-11-02T09:14:21.528 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum install -y kernel 2023-11-02T09:14:23.739 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS-9 - AppStream 13 MB/s | 6.3 MB 00:00 2023-11-02T09:14:23.939 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS-9 - AppStream 7.8 MB/s | 6.3 MB 00:00 2023-11-02T09:14:25.181 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS-9 - BaseOS 5.2 MB/s | 2.0 MB 00:00 2023-11-02T09:14:25.514 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS-9 - BaseOS 3.8 MB/s | 2.0 MB 00:00 2023-11-02T09:14:26.080 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 7.9 MB 00:00 2023-11-02T09:14:28.881 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS Stream 9 - AppStream 10 MB/s | 18 MB 00:01 2023-11-02T09:14:30.946 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS Stream 9 - BaseOS 1.5 MB/s | 7.9 MB 00:05 2023-11-02T09:14:32.690 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS Stream 9 - CRB 12 MB/s | 5.8 MB 00:00 2023-11-02T09:14:33.855 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS Stream 9 - AppStream 9.6 MB/s | 18 MB 00:01 2023-11-02T09:14:34.141 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS Stream 9 - Extras packages 40 kB/s | 15 kB 00:00 2023-11-02T09:14:36.000 INFO:teuthology.orchestra.run.smithi156.stdout:Extra Packages for Enterprise Linux 11 MB/s | 19 MB 00:01 2023-11-02T09:14:37.922 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS Stream 9 - CRB 7.6 MB/s | 5.8 MB 00:00 2023-11-02T09:14:39.539 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS Stream 9 - Extras packages 27 kB/s | 15 kB 00:00 2023-11-02T09:14:40.600 INFO:teuthology.orchestra.run.smithi156.stdout:lab-extras 9.2 kB/s | 1.7 kB 00:00 2023-11-02T09:14:40.752 INFO:teuthology.orchestra.run.smithi186.stdout:Extra Packages for Enterprise Linux 18 MB/s | 19 MB 00:01 2023-11-02T09:14:42.698 INFO:teuthology.orchestra.run.smithi156.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-11-02T09:14:42.699 INFO:teuthology.orchestra.run.smithi156.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-11-02T09:14:42.792 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-11-02T09:14:42.798 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-02T09:14:42.798 INFO:teuthology.orchestra.run.smithi156.stdout: Package Architecture Version Repository Size 2023-11-02T09:14:42.798 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-02T09:14:42.799 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2023-11-02T09:14:42.799 INFO:teuthology.orchestra.run.smithi156.stdout: kernel x86_64 5.14.0-378.el9 baseos 5.3 M 2023-11-02T09:14:42.799 INFO:teuthology.orchestra.run.smithi156.stdout:Installing dependencies: 2023-11-02T09:14:42.799 INFO:teuthology.orchestra.run.smithi156.stdout: kernel-core x86_64 5.14.0-378.el9 baseos 20 M 2023-11-02T09:14:42.800 INFO:teuthology.orchestra.run.smithi156.stdout: kernel-modules x86_64 5.14.0-378.el9 baseos 38 M 2023-11-02T09:14:42.800 INFO:teuthology.orchestra.run.smithi156.stdout: kernel-modules-core x86_64 5.14.0-378.el9 baseos 32 M 2023-11-02T09:14:42.800 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:14:42.800 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-11-02T09:14:42.800 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-02T09:14:42.801 INFO:teuthology.orchestra.run.smithi156.stdout:Install 4 Packages 2023-11-02T09:14:42.801 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:14:42.801 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 95 M 2023-11-02T09:14:42.802 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 120 M 2023-11-02T09:14:42.802 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-11-02T09:14:43.694 INFO:teuthology.orchestra.run.smithi156.stdout:(1/4): kernel-5.14.0-378.el9.x86_64.rpm 7.9 MB/s | 5.3 MB 00:00 2023-11-02T09:14:45.207 INFO:teuthology.orchestra.run.smithi186.stdout:lab-extras 38 kB/s | 1.7 kB 00:00 2023-11-02T09:14:46.310 INFO:teuthology.orchestra.run.smithi156.stdout:(2/4): kernel-core-5.14.0-378.el9.x86_64.rpm 6.1 MB/s | 20 MB 00:03 2023-11-02T09:14:47.214 INFO:teuthology.orchestra.run.smithi186.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-11-02T09:14:47.215 INFO:teuthology.orchestra.run.smithi186.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-11-02T09:14:47.303 INFO:teuthology.orchestra.run.smithi186.stdout:Dependencies resolved. 2023-11-02T09:14:47.311 INFO:teuthology.orchestra.run.smithi186.stdout:================================================================================ 2023-11-02T09:14:47.311 INFO:teuthology.orchestra.run.smithi186.stdout: Package Architecture Version Repository Size 2023-11-02T09:14:47.312 INFO:teuthology.orchestra.run.smithi186.stdout:================================================================================ 2023-11-02T09:14:47.312 INFO:teuthology.orchestra.run.smithi186.stdout:Installing: 2023-11-02T09:14:47.312 INFO:teuthology.orchestra.run.smithi186.stdout: kernel x86_64 5.14.0-378.el9 baseos 5.3 M 2023-11-02T09:14:47.312 INFO:teuthology.orchestra.run.smithi186.stdout:Installing dependencies: 2023-11-02T09:14:47.312 INFO:teuthology.orchestra.run.smithi186.stdout: kernel-core x86_64 5.14.0-378.el9 baseos 20 M 2023-11-02T09:14:47.313 INFO:teuthology.orchestra.run.smithi186.stdout: kernel-modules x86_64 5.14.0-378.el9 baseos 38 M 2023-11-02T09:14:47.313 INFO:teuthology.orchestra.run.smithi186.stdout: kernel-modules-core x86_64 5.14.0-378.el9 baseos 32 M 2023-11-02T09:14:47.313 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-11-02T09:14:47.313 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction Summary 2023-11-02T09:14:47.314 INFO:teuthology.orchestra.run.smithi186.stdout:================================================================================ 2023-11-02T09:14:47.314 INFO:teuthology.orchestra.run.smithi186.stdout:Install 4 Packages 2023-11-02T09:14:47.314 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-11-02T09:14:47.314 INFO:teuthology.orchestra.run.smithi186.stdout:Total download size: 95 M 2023-11-02T09:14:47.315 INFO:teuthology.orchestra.run.smithi186.stdout:Installed size: 120 M 2023-11-02T09:14:47.315 INFO:teuthology.orchestra.run.smithi186.stdout:Downloading Packages: 2023-11-02T09:14:49.227 INFO:teuthology.orchestra.run.smithi156.stdout:(3/4): kernel-modules-core-5.14.0-378.el9.x86_6 5.8 MB/s | 32 MB 00:05 2023-11-02T09:14:49.717 INFO:teuthology.orchestra.run.smithi186.stdout:(1/4): kernel-5.14.0-378.el9.x86_64.rpm 2.5 MB/s | 5.3 MB 00:02 2023-11-02T09:14:52.542 INFO:teuthology.orchestra.run.smithi186.stdout:(2/4): kernel-core-5.14.0-378.el9.x86_64.rpm 4.0 MB/s | 20 MB 00:04 2023-11-02T09:14:58.633 INFO:teuthology.orchestra.run.smithi186.stdout:(3/4): kernel-modules-core-5.14.0-378.el9.x86_6 3.6 MB/s | 32 MB 00:08 2023-11-02T09:15:05.933 INFO:teuthology.orchestra.run.smithi156.stdout:(4/4): kernel-modules-5.14.0-378.el9.x86_64.rpm 1.6 MB/s | 38 MB 00:22 2023-11-02T09:15:05.934 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-11-02T09:15:05.934 INFO:teuthology.orchestra.run.smithi156.stdout:Total 4.1 MB/s | 95 MB 00:23 2023-11-02T09:15:06.778 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-11-02T09:15:07.160 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-11-02T09:15:07.160 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-11-02T09:15:08.468 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-11-02T09:15:08.468 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-11-02T09:15:09.340 INFO:teuthology.orchestra.run.smithi186.stdout:(4/4): kernel-modules-5.14.0-378.el9.x86_64.rpm 1.7 MB/s | 38 MB 00:21 2023-11-02T09:15:09.341 INFO:teuthology.orchestra.run.smithi186.stdout:-------------------------------------------------------------------------------- 2023-11-02T09:15:09.342 INFO:teuthology.orchestra.run.smithi186.stdout:Total 4.3 MB/s | 95 MB 00:22 2023-11-02T09:15:10.181 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction check 2023-11-02T09:15:10.566 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction check succeeded. 2023-11-02T09:15:10.566 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction test 2023-11-02T09:15:11.375 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-11-02T09:15:11.846 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction test succeeded. 2023-11-02T09:15:11.847 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction 2023-11-02T09:15:12.009 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : kernel-modules-core-5.14.0-378.el9.x86_64 1/4 2023-11-02T09:15:12.134 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : kernel-core-5.14.0-378.el9.x86_64 2/4 2023-11-02T09:15:14.437 INFO:teuthology.orchestra.run.smithi186.stdout: Preparing : 1/1 2023-11-02T09:15:14.918 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: kernel-core-5.14.0-378.el9.x86_64 2/4 2023-11-02T09:15:15.061 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : kernel-modules-core-5.14.0-378.el9.x86_64 1/4 2023-11-02T09:15:15.105 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : kernel-modules-5.14.0-378.el9.x86_64 3/4 2023-11-02T09:15:15.182 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : kernel-core-5.14.0-378.el9.x86_64 2/4 2023-11-02T09:15:17.953 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: kernel-core-5.14.0-378.el9.x86_64 2/4 2023-11-02T09:15:18.336 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : kernel-modules-5.14.0-378.el9.x86_64 3/4 2023-11-02T09:15:19.700 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: kernel-modules-5.14.0-378.el9.x86_64 3/4 2023-11-02T09:15:20.037 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : kernel-5.14.0-378.el9.x86_64 4/4 2023-11-02T09:15:22.966 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: kernel-modules-5.14.0-378.el9.x86_64 3/4 2023-11-02T09:15:23.132 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : kernel-5.14.0-378.el9.x86_64 4/4 2023-11-02T09:15:24.646 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: kernel-modules-core-5.14.0-378.el9.x86_64 4/4 2023-11-02T09:15:27.780 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: kernel-modules-core-5.14.0-378.el9.x86_64 4/4 2023-11-02T09:15:53.644 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: kernel-core-5.14.0-378.el9.x86_64 4/4 2023-11-02T09:15:53.687 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: kernel-modules-5.14.0-378.el9.x86_64 4/4 2023-11-02T09:15:54.083 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: kernel-5.14.0-378.el9.x86_64 4/4 2023-11-02T09:15:54.083 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : kernel-5.14.0-378.el9.x86_64 1/4 2023-11-02T09:15:54.083 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : kernel-core-5.14.0-378.el9.x86_64 2/4 2023-11-02T09:15:54.083 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : kernel-modules-5.14.0-378.el9.x86_64 3/4 2023-11-02T09:15:54.464 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : kernel-modules-core-5.14.0-378.el9.x86_64 4/4 2023-11-02T09:15:54.464 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:15:54.464 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-11-02T09:15:54.465 INFO:teuthology.orchestra.run.smithi156.stdout: kernel-5.14.0-378.el9.x86_64 2023-11-02T09:15:54.465 INFO:teuthology.orchestra.run.smithi156.stdout: kernel-core-5.14.0-378.el9.x86_64 2023-11-02T09:15:54.465 INFO:teuthology.orchestra.run.smithi156.stdout: kernel-modules-5.14.0-378.el9.x86_64 2023-11-02T09:15:54.465 INFO:teuthology.orchestra.run.smithi156.stdout: kernel-modules-core-5.14.0-378.el9.x86_64 2023-11-02T09:15:54.465 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:15:54.466 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-11-02T09:15:54.958 DEBUG:teuthology.orchestra.run.smithi156:> rpm -q kernel | sort -rV | head -n 1 2023-11-02T09:15:55.094 INFO:teuthology.orchestra.run.smithi156.stdout:kernel-5.14.0-378.el9.x86_64 2023-11-02T09:15:55.097 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-378.el9.x86_64 2023-11-02T09:15:55.098 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-378.el9.x86_64 2023-11-02T09:15:55.098 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-11-02T09:15:55.098 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-11-02T09:15:55.098 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-11-02T09:15:55.099 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi156.front.sepia.ceph.com, path=None, version=distro) 2023-11-02T09:15:55.099 DEBUG:teuthology.orchestra.run.smithi156:> rpm -q kernel | sort -rV | head -n 1 2023-11-02T09:15:55.217 INFO:teuthology.orchestra.run.smithi156.stdout:kernel-5.14.0-378.el9.x86_64 2023-11-02T09:15:55.218 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-378.el9.x86_64 2023-11-02T09:15:55.219 DEBUG:teuthology.orchestra.run.smithi156:> sudo rpm -qi grub2-tools 2023-11-02T09:15:55.265 INFO:teuthology.orchestra.run.smithi156.stdout:Name : grub2-tools 2023-11-02T09:15:55.265 INFO:teuthology.orchestra.run.smithi156.stdout:Epoch : 1 2023-11-02T09:15:55.266 INFO:teuthology.orchestra.run.smithi156.stdout:Version : 2.06 2023-11-02T09:15:55.266 INFO:teuthology.orchestra.run.smithi156.stdout:Release : 68.el9 2023-11-02T09:15:55.266 INFO:teuthology.orchestra.run.smithi156.stdout:Architecture: x86_64 2023-11-02T09:15:55.266 INFO:teuthology.orchestra.run.smithi156.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-11-02T09:15:55.267 INFO:teuthology.orchestra.run.smithi156.stdout:Group : Unspecified 2023-11-02T09:15:55.267 INFO:teuthology.orchestra.run.smithi156.stdout:Size : 8264254 2023-11-02T09:15:55.267 INFO:teuthology.orchestra.run.smithi156.stdout:License : GPLv3+ 2023-11-02T09:15:55.267 INFO:teuthology.orchestra.run.smithi156.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-11-02T09:15:55.268 INFO:teuthology.orchestra.run.smithi156.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-11-02T09:15:55.268 INFO:teuthology.orchestra.run.smithi156.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-11-02T09:15:55.268 INFO:teuthology.orchestra.run.smithi156.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-11-02T09:15:55.268 INFO:teuthology.orchestra.run.smithi156.stdout:Packager : builder@centos.org 2023-11-02T09:15:55.269 INFO:teuthology.orchestra.run.smithi156.stdout:Vendor : CentOS 2023-11-02T09:15:55.269 INFO:teuthology.orchestra.run.smithi156.stdout:URL : http://www.gnu.org/software/grub/ 2023-11-02T09:15:55.269 INFO:teuthology.orchestra.run.smithi156.stdout:Summary : Support tools for GRUB. 2023-11-02T09:15:55.270 INFO:teuthology.orchestra.run.smithi156.stdout:Description : 2023-11-02T09:15:55.270 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:15:55.270 INFO:teuthology.orchestra.run.smithi156.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-11-02T09:15:55.271 INFO:teuthology.orchestra.run.smithi156.stdout:customizable bootloader with modular architecture. It supports a rich 2023-11-02T09:15:55.271 INFO:teuthology.orchestra.run.smithi156.stdout:variety of kernel formats, file systems, computer architectures and 2023-11-02T09:15:55.271 INFO:teuthology.orchestra.run.smithi156.stdout:hardware devices. 2023-11-02T09:15:55.271 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:15:55.271 INFO:teuthology.orchestra.run.smithi156.stdout:This subpackage provides tools for support of all platforms. 2023-11-02T09:15:55.272 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-11-02T09:15:55.273 INFO:teuthology.task.kernel:Updating grub on smithi156 to boot 5.14.0-378.el9.x86_64 2023-11-02T09:15:55.273 DEBUG:teuthology.orchestra.run.smithi156:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-11-02T09:15:55.928 INFO:teuthology.orchestra.run.smithi156.stderr:Generating grub configuration file ... 2023-11-02T09:15:56.663 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: kernel-core-5.14.0-378.el9.x86_64 4/4 2023-11-02T09:15:56.705 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: kernel-modules-5.14.0-378.el9.x86_64 4/4 2023-11-02T09:15:57.076 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: kernel-5.14.0-378.el9.x86_64 4/4 2023-11-02T09:15:57.077 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : kernel-5.14.0-378.el9.x86_64 1/4 2023-11-02T09:15:57.077 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : kernel-core-5.14.0-378.el9.x86_64 2/4 2023-11-02T09:15:57.077 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : kernel-modules-5.14.0-378.el9.x86_64 3/4 2023-11-02T09:15:57.327 INFO:teuthology.orchestra.run.smithi156.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-11-02T09:15:57.361 INFO:teuthology.orchestra.run.smithi156.stderr:done 2023-11-02T09:15:57.364 DEBUG:teuthology.orchestra.run.smithi156:> mktemp 2023-11-02T09:15:57.380 INFO:teuthology.orchestra.run.smithi156.stdout:/tmp/tmp.orVSNZgy8H 2023-11-02T09:15:57.381 DEBUG:teuthology.orchestra.run.smithi156:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.orVSNZgy8H 2023-11-02T09:15:57.449 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod 0666 /tmp/tmp.orVSNZgy8H 2023-11-02T09:15:57.482 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : kernel-modules-core-5.14.0-378.el9.x86_64 4/4 2023-11-02T09:15:57.482 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-11-02T09:15:57.482 INFO:teuthology.orchestra.run.smithi186.stdout:Installed: 2023-11-02T09:15:57.482 INFO:teuthology.orchestra.run.smithi186.stdout: kernel-5.14.0-378.el9.x86_64 2023-11-02T09:15:57.483 INFO:teuthology.orchestra.run.smithi186.stdout: kernel-core-5.14.0-378.el9.x86_64 2023-11-02T09:15:57.483 INFO:teuthology.orchestra.run.smithi186.stdout: kernel-modules-5.14.0-378.el9.x86_64 2023-11-02T09:15:57.483 INFO:teuthology.orchestra.run.smithi186.stdout: kernel-modules-core-5.14.0-378.el9.x86_64 2023-11-02T09:15:57.483 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-11-02T09:15:57.483 INFO:teuthology.orchestra.run.smithi186.stdout:Complete! 2023-11-02T09:15:57.593 DEBUG:teuthology.orchestra.remote:smithi156:/tmp/tmp.orVSNZgy8H is 6KB 2023-11-02T09:15:57.642 DEBUG:teuthology.orchestra.run.smithi156:> rm -fr /tmp/tmp.orVSNZgy8H 2023-11-02T09:15:57.657 DEBUG:teuthology.orchestra.run.smithi156:> sudo /bin/ls /boot/loader/entries || true 2023-11-02T09:15:57.725 INFO:teuthology.orchestra.run.smithi156.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-11-02T09:15:57.725 INFO:teuthology.orchestra.run.smithi156.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-11-02T09:15:57.725 INFO:teuthology.orchestra.run.smithi156.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-11-02T09:15:57.725 INFO:teuthology.orchestra.run.smithi156.stdout:15949e3c88704300882482eddfd7baae-5.14.0-378.el9.x86_64.conf 2023-11-02T09:15:57.726 DEBUG:teuthology.orchestra.run.smithi156:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-378.el9.x86_64 2023-11-02T09:15:57.895 DEBUG:teuthology.orchestra.run.smithi156:> sudo shutdown -r now 2023-11-02T09:15:57.994 DEBUG:teuthology.orchestra.run.smithi186:> rpm -q kernel | sort -rV | head -n 1 2023-11-02T09:15:58.144 INFO:teuthology.orchestra.run.smithi186.stdout:kernel-5.14.0-378.el9.x86_64 2023-11-02T09:15:58.145 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-378.el9.x86_64 2023-11-02T09:15:58.145 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-378.el9.x86_64 2023-11-02T09:15:58.145 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-11-02T09:15:58.146 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-11-02T09:15:58.146 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-11-02T09:15:58.146 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi186.front.sepia.ceph.com, path=None, version=distro) 2023-11-02T09:15:58.147 DEBUG:teuthology.orchestra.run.smithi186:> rpm -q kernel | sort -rV | head -n 1 2023-11-02T09:15:58.265 INFO:teuthology.orchestra.run.smithi186.stdout:kernel-5.14.0-378.el9.x86_64 2023-11-02T09:15:58.265 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-378.el9.x86_64 2023-11-02T09:15:58.265 DEBUG:teuthology.orchestra.run.smithi186:> sudo rpm -qi grub2-tools 2023-11-02T09:15:58.309 INFO:teuthology.orchestra.run.smithi186.stdout:Name : grub2-tools 2023-11-02T09:15:58.310 INFO:teuthology.orchestra.run.smithi186.stdout:Epoch : 1 2023-11-02T09:15:58.310 INFO:teuthology.orchestra.run.smithi186.stdout:Version : 2.06 2023-11-02T09:15:58.310 INFO:teuthology.orchestra.run.smithi186.stdout:Release : 68.el9 2023-11-02T09:15:58.310 INFO:teuthology.orchestra.run.smithi186.stdout:Architecture: x86_64 2023-11-02T09:15:58.311 INFO:teuthology.orchestra.run.smithi186.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-11-02T09:15:58.311 INFO:teuthology.orchestra.run.smithi186.stdout:Group : Unspecified 2023-11-02T09:15:58.311 INFO:teuthology.orchestra.run.smithi186.stdout:Size : 8264254 2023-11-02T09:15:58.311 INFO:teuthology.orchestra.run.smithi186.stdout:License : GPLv3+ 2023-11-02T09:15:58.311 INFO:teuthology.orchestra.run.smithi186.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-11-02T09:15:58.312 INFO:teuthology.orchestra.run.smithi186.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-11-02T09:15:58.312 INFO:teuthology.orchestra.run.smithi186.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-11-02T09:15:58.312 INFO:teuthology.orchestra.run.smithi186.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-11-02T09:15:58.312 INFO:teuthology.orchestra.run.smithi186.stdout:Packager : builder@centos.org 2023-11-02T09:15:58.312 INFO:teuthology.orchestra.run.smithi186.stdout:Vendor : CentOS 2023-11-02T09:15:58.313 INFO:teuthology.orchestra.run.smithi186.stdout:URL : http://www.gnu.org/software/grub/ 2023-11-02T09:15:58.313 INFO:teuthology.orchestra.run.smithi186.stdout:Summary : Support tools for GRUB. 2023-11-02T09:15:58.313 INFO:teuthology.orchestra.run.smithi186.stdout:Description : 2023-11-02T09:15:58.313 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-11-02T09:15:58.313 INFO:teuthology.orchestra.run.smithi186.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-11-02T09:15:58.314 INFO:teuthology.orchestra.run.smithi186.stdout:customizable bootloader with modular architecture. It supports a rich 2023-11-02T09:15:58.314 INFO:teuthology.orchestra.run.smithi186.stdout:variety of kernel formats, file systems, computer architectures and 2023-11-02T09:15:58.314 INFO:teuthology.orchestra.run.smithi186.stdout:hardware devices. 2023-11-02T09:15:58.314 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-11-02T09:15:58.314 INFO:teuthology.orchestra.run.smithi186.stdout:This subpackage provides tools for support of all platforms. 2023-11-02T09:15:58.315 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-11-02T09:15:58.316 INFO:teuthology.task.kernel:Updating grub on smithi186 to boot 5.14.0-378.el9.x86_64 2023-11-02T09:15:58.316 DEBUG:teuthology.orchestra.run.smithi186:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-11-02T09:15:58.904 INFO:teuthology.orchestra.run.smithi186.stderr:Generating grub configuration file ... 2023-11-02T09:16:00.287 INFO:teuthology.orchestra.run.smithi186.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-11-02T09:16:00.316 INFO:teuthology.orchestra.run.smithi186.stderr:done 2023-11-02T09:16:00.320 DEBUG:teuthology.orchestra.run.smithi186:> mktemp 2023-11-02T09:16:00.336 INFO:teuthology.orchestra.run.smithi186.stdout:/tmp/tmp.LixUlLDcGW 2023-11-02T09:16:00.337 DEBUG:teuthology.orchestra.run.smithi186:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.LixUlLDcGW 2023-11-02T09:16:00.406 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod 0666 /tmp/tmp.LixUlLDcGW 2023-11-02T09:16:00.544 DEBUG:teuthology.orchestra.remote:smithi186:/tmp/tmp.LixUlLDcGW is 6KB 2023-11-02T09:16:00.592 DEBUG:teuthology.orchestra.run.smithi186:> rm -fr /tmp/tmp.LixUlLDcGW 2023-11-02T09:16:00.693 DEBUG:teuthology.orchestra.run.smithi186:> sudo /bin/ls /boot/loader/entries || true 2023-11-02T09:16:00.720 INFO:teuthology.orchestra.run.smithi186.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-11-02T09:16:00.720 INFO:teuthology.orchestra.run.smithi186.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-11-02T09:16:00.720 INFO:teuthology.orchestra.run.smithi186.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-11-02T09:16:00.721 INFO:teuthology.orchestra.run.smithi186.stdout:15949e3c88704300882482eddfd7baae-5.14.0-378.el9.x86_64.conf 2023-11-02T09:16:00.722 DEBUG:teuthology.orchestra.run.smithi186:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-378.el9.x86_64 2023-11-02T09:16:00.881 DEBUG:teuthology.orchestra.run.smithi186:> sudo shutdown -r now 2023-11-02T09:16:27.926 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-11-02T09:16:27.927 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-11-02T09:16:27.928 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-02T09:16:30.887 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-11-02T09:16:30.887 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi186.front.sepia.ceph.com' 2023-11-02T09:16:30.888 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-02T09:17:02.458 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-11-02T09:17:05.530 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-11-02T09:17:11.465 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-11-02T09:17:11.466 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-02T09:17:14.535 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi186.front.sepia.ceph.com' 2023-11-02T09:17:14.536 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-02T09:18:11.571 DEBUG:teuthology.orchestra.remote:timed out 2023-11-02T09:18:14.566 DEBUG:teuthology.orchestra.remote:timed out 2023-11-02T09:18:23.583 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-11-02T09:18:23.584 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-02T09:18:24.031 DEBUG:teuthology.orchestra.run.smithi156:> true 2023-11-02T09:18:24.395 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-11-02T09:18:24.404 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-378.el9.x86_64"... 2023-11-02T09:18:24.405 DEBUG:teuthology.orchestra.run.smithi156:> uname -r 2023-11-02T09:18:24.422 INFO:teuthology.orchestra.run.smithi156.stdout:5.14.0-378.el9.x86_64 2023-11-02T09:18:24.422 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-378.el9.x86_64 vs 5.14.0-378.el9.x86_64 2023-11-02T09:18:24.423 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-02T09:18:24.423 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-11-02T09:18:25.424 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-11-02T09:18:25.425 DEBUG:teuthology.orchestra.run.smithi156:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-02T09:18:25.506 INFO:teuthology.orchestra.run.smithi156.stdout:ttyS1 2023-11-02T09:18:25.549 DEBUG:teuthology.parallel:result is None 2023-11-02T09:18:26.568 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi186.front.sepia.ceph.com' 2023-11-02T09:18:26.569 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-02T09:18:27.062 DEBUG:teuthology.orchestra.run.smithi186:> true 2023-11-02T09:18:27.416 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi186.front.sepia.ceph.com' 2023-11-02T09:18:27.416 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-378.el9.x86_64"... 2023-11-02T09:18:27.416 DEBUG:teuthology.orchestra.run.smithi186:> uname -r 2023-11-02T09:18:27.433 INFO:teuthology.orchestra.run.smithi186.stdout:5.14.0-378.el9.x86_64 2023-11-02T09:18:27.434 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-378.el9.x86_64 vs 5.14.0-378.el9.x86_64 2023-11-02T09:18:27.434 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-02T09:18:27.434 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-11-02T09:18:28.436 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-11-02T09:18:28.436 DEBUG:teuthology.orchestra.run.smithi186:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-02T09:18:28.513 INFO:teuthology.orchestra.run.smithi186.stdout:ttyS1 2023-11-02T09:18:28.548 DEBUG:teuthology.parallel:result is None 2023-11-02T09:18:28.549 INFO:teuthology.run_tasks:Running task internal.base... 2023-11-02T09:18:28.559 INFO:teuthology.task.internal:Creating test directory... 2023-11-02T09:18:28.560 DEBUG:teuthology.orchestra.run.smithi156:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-02T09:18:28.563 DEBUG:teuthology.orchestra.run.smithi186:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-02T09:18:28.581 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-11-02T09:18:28.588 INFO:teuthology.run_tasks:Running task internal.archive... 2023-11-02T09:18:28.612 INFO:teuthology.task.internal:Creating archive directory... 2023-11-02T09:18:28.613 DEBUG:teuthology.orchestra.run.smithi156:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-02T09:18:28.621 DEBUG:teuthology.orchestra.run.smithi186:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-02T09:18:28.655 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-11-02T09:18:28.662 INFO:teuthology.task.internal:Enabling coredump saving... 2023-11-02T09:18:28.662 DEBUG:teuthology.orchestra.run.smithi156:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-02T09:18:28.687 DEBUG:teuthology.orchestra.run.smithi186:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-02T09:18:28.720 INFO:teuthology.orchestra.run.smithi156.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-02T09:18:28.725 INFO:teuthology.orchestra.run.smithi186.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-02T09:18:28.734 INFO:teuthology.orchestra.run.smithi156.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-02T09:18:28.738 INFO:teuthology.orchestra.run.smithi186.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-02T09:18:28.740 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-11-02T09:18:28.748 INFO:teuthology.task.internal:Configuring sudo... 2023-11-02T09:18:28.749 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-02T09:18:28.778 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-02T09:18:28.809 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-11-02T09:18:28.818 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-11-02T09:18:28.819 DEBUG:teuthology.orchestra.run.smithi156:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-02T09:18:28.849 DEBUG:teuthology.orchestra.run.smithi186:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-02T09:18:28.864 DEBUG:teuthology.orchestra.run.smithi156:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-02T09:18:28.958 DEBUG:teuthology.orchestra.run.smithi156:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-02T09:18:28.993 DEBUG:teuthology.orchestra.run.smithi156:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-02T09:18:29.083 DEBUG:teuthology.orchestra.run.smithi156:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-02T09:18:29.117 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-11-02T09:18:29.117 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-02T09:18:29.183 DEBUG:teuthology.orchestra.run.smithi186:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-02T09:18:29.236 DEBUG:teuthology.orchestra.run.smithi186:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-02T09:18:29.284 DEBUG:teuthology.orchestra.run.smithi186:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-02T09:18:29.377 DEBUG:teuthology.orchestra.run.smithi186:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-02T09:18:29.410 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-11-02T09:18:29.411 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-02T09:18:29.479 DEBUG:teuthology.orchestra.run.smithi156:> sudo service rsyslog restart 2023-11-02T09:18:29.482 DEBUG:teuthology.orchestra.run.smithi186:> sudo service rsyslog restart 2023-11-02T09:18:29.520 INFO:teuthology.orchestra.run.smithi156.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-02T09:18:29.573 INFO:teuthology.orchestra.run.smithi186.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-02T09:18:29.941 INFO:teuthology.run_tasks:Running task internal.timer... 2023-11-02T09:18:29.953 INFO:teuthology.task.internal:Starting timer... 2023-11-02T09:18:29.954 INFO:teuthology.run_tasks:Running task pcp... 2023-11-02T09:18:29.965 INFO:teuthology.run_tasks:Running task selinux... 2023-11-02T09:18:29.975 DEBUG:teuthology.orchestra.run.smithi156:> sudo service auditd rotate 2023-11-02T09:18:30.031 INFO:teuthology.orchestra.run.smithi156.stdout:Rotating logs: 2023-11-02T09:18:30.033 DEBUG:teuthology.orchestra.run.smithi186:> sudo service auditd rotate 2023-11-02T09:18:30.092 INFO:teuthology.orchestra.run.smithi186.stdout:Rotating logs: 2023-11-02T09:18:30.095 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-11-02T09:18:30.095 DEBUG:teuthology.orchestra.run.smithi156:> /usr/sbin/getenforce 2023-11-02T09:18:30.117 INFO:teuthology.orchestra.run.smithi156.stdout:Permissive 2023-11-02T09:18:30.117 DEBUG:teuthology.orchestra.run.smithi186:> /usr/sbin/getenforce 2023-11-02T09:18:30.136 INFO:teuthology.orchestra.run.smithi186.stdout:Permissive 2023-11-02T09:18:30.136 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi156.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi186.front.sepia.ceph.com': 'permissive'} 2023-11-02T09:18:30.137 DEBUG:teuthology.orchestra.run.smithi156:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-02T09:18:30.184 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-02T09:18:30.185 DEBUG:teuthology.orchestra.run.smithi186:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-02T09:18:30.214 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-02T09:18:30.215 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-11-02T09:18:30.215 DEBUG:teuthology.orchestra.run.smithi156:> sudo /usr/sbin/setenforce permissive 2023-11-02T09:18:30.260 DEBUG:teuthology.orchestra.run.smithi186:> sudo /usr/sbin/setenforce permissive 2023-11-02T09:18:30.296 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-11-02T09:18:30.307 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-11-02T09:18:30.308 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-11-02T09:18:30.328 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-11-02T09:18:30.329 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi156.front.sepia.ceph.com,smithi186.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-11-02T09:24:21.245 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi156.front.sepia.ceph.com'), Remote(name='ubuntu@smithi186.front.sepia.ceph.com')] 2023-11-02T09:24:21.247 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-11-02T09:24:21.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-02T09:24:21.377 DEBUG:teuthology.orchestra.run.smithi156:> true 2023-11-02T09:24:21.445 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-11-02T09:24:21.446 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi186.front.sepia.ceph.com' 2023-11-02T09:24:21.446 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-02T09:24:21.539 DEBUG:teuthology.orchestra.run.smithi186:> true 2023-11-02T09:24:21.615 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi186.front.sepia.ceph.com' 2023-11-02T09:24:21.615 INFO:teuthology.run_tasks:Running task clock... 2023-11-02T09:24:21.631 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-11-02T09:24:21.632 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-02T09:24:21.633 DEBUG:teuthology.orchestra.run.smithi156:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-02T09:24:21.636 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-02T09:24:21.636 DEBUG:teuthology.orchestra.run.smithi186:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-02T09:24:21.665 INFO:teuthology.orchestra.run.smithi156.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-02T09:24:21.682 INFO:teuthology.orchestra.run.smithi156.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-02T09:24:21.689 INFO:teuthology.orchestra.run.smithi186.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-02T09:24:21.707 INFO:teuthology.orchestra.run.smithi186.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-02T09:24:21.712 INFO:teuthology.orchestra.run.smithi156.stderr:sudo: ntpd: command not found 2023-11-02T09:24:21.725 INFO:teuthology.orchestra.run.smithi156.stdout:506 Cannot talk to daemon 2023-11-02T09:24:21.737 INFO:teuthology.orchestra.run.smithi186.stderr:sudo: ntpd: command not found 2023-11-02T09:24:21.741 INFO:teuthology.orchestra.run.smithi156.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-02T09:24:21.751 INFO:teuthology.orchestra.run.smithi186.stdout:506 Cannot talk to daemon 2023-11-02T09:24:21.759 INFO:teuthology.orchestra.run.smithi156.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-02T09:24:21.768 INFO:teuthology.orchestra.run.smithi186.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-02T09:24:21.785 INFO:teuthology.orchestra.run.smithi186.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-02T09:24:21.800 INFO:teuthology.orchestra.run.smithi156.stderr:bash: line 1: ntpq: command not found 2023-11-02T09:24:21.804 INFO:teuthology.orchestra.run.smithi156.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-02T09:24:21.804 INFO:teuthology.orchestra.run.smithi156.stdout:=============================================================================== 2023-11-02T09:24:21.805 INFO:teuthology.orchestra.run.smithi156.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-02T09:24:21.805 INFO:teuthology.orchestra.run.smithi156.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-02T09:24:21.805 INFO:teuthology.orchestra.run.smithi156.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-02T09:24:21.805 INFO:teuthology.orchestra.run.smithi156.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-02T09:24:21.827 INFO:teuthology.orchestra.run.smithi186.stderr:bash: line 1: ntpq: command not found 2023-11-02T09:24:21.830 INFO:teuthology.orchestra.run.smithi186.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-02T09:24:21.830 INFO:teuthology.orchestra.run.smithi186.stdout:=============================================================================== 2023-11-02T09:24:21.830 INFO:teuthology.orchestra.run.smithi186.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-02T09:24:21.830 INFO:teuthology.orchestra.run.smithi186.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-02T09:24:21.830 INFO:teuthology.orchestra.run.smithi186.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-02T09:24:21.831 INFO:teuthology.orchestra.run.smithi186.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-02T09:24:21.832 INFO:teuthology.run_tasks:Running task install... 2023-11-02T09:24:21.841 DEBUG:teuthology.task.install:project ceph 2023-11-02T09:24:21.841 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'extra_system_packages': {'deb': ['default-jre'], 'rpm': ['java']}, 'flavor': 'default', 'sha1': '84d22000a111c0f6e32c6bf0246b078c52c8bdde'}} 2023-11-02T09:24:21.842 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['default-jre'], 'rpm': ['java']}, 'flavor': 'default', 'sha1': '84d22000a111c0f6e32c6bf0246b078c52c8bdde'} 2023-11-02T09:24:21.842 INFO:teuthology.task.install:Using flavor: default 2023-11-02T09:24:21.876 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-11-02T09:24:21.877 INFO:teuthology.task.install:extra packages: [] 2023-11-02T09:24:21.877 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['default-jre'], 'rpm': ['java']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '84d22000a111c0f6e32c6bf0246b078c52c8bdde', 'tag': None, 'wait_for_package': False} 2023-11-02T09:24:21.878 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=84d22000a111c0f6e32c6bf0246b078c52c8bdde 2023-11-02T09:24:21.880 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['default-jre'], 'rpm': ['java']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '84d22000a111c0f6e32c6bf0246b078c52c8bdde', 'tag': None, 'wait_for_package': False} 2023-11-02T09:24:21.880 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=84d22000a111c0f6e32c6bf0246b078c52c8bdde 2023-11-02T09:24:22.104 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-alimasa-2pc-remove-issue/84d22000a111c0f6e32c6bf0246b078c52c8bdde/centos/9/flavors/default/ 2023-11-02T09:24:22.104 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6872.g84d22000 2023-11-02T09:24:22.242 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-alimasa-2pc-remove-issue/84d22000a111c0f6e32c6bf0246b078c52c8bdde/centos/9/flavors/default/ 2023-11-02T09:24:22.243 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6872.g84d22000 2023-11-02T09:24:22.368 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-alimasa-2pc-remove-issue/84d22000a111c0f6e32c6bf0246b078c52c8bdde/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-alimasa-2pc-remove-issue/84d22000a111c0f6e32c6bf0246b078c52c8bdde/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-alimasa-2pc-remove-issue/84d22000a111c0f6e32c6bf0246b078c52c8bdde/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-02T09:24:22.369 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-11-02T09:24:22.369 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-02T09:24:22.393 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-alimasa-2pc-remove-issue/84d22000a111c0f6e32c6bf0246b078c52c8bdde/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-alimasa-2pc-remove-issue/84d22000a111c0f6e32c6bf0246b078c52c8bdde/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-alimasa-2pc-remove-issue/84d22000a111c0f6e32c6bf0246b078c52c8bdde/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-02T09:24:22.394 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-11-02T09:24:22.394 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-02T09:24:22.398 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, java, java, java on remote rpm x86_64 2023-11-02T09:24:22.399 DEBUG:teuthology.orchestra.run.smithi156:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/84d22000a111c0f6e32c6bf0246b078c52c8bdde/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-02T09:24:22.423 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, java, java, java, java on remote rpm x86_64 2023-11-02T09:24:22.424 DEBUG:teuthology.orchestra.run.smithi186:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/84d22000a111c0f6e32c6bf0246b078c52c8bdde/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-02T09:24:22.469 DEBUG:teuthology.orchestra.run.smithi156:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-02T09:24:22.492 DEBUG:teuthology.orchestra.run.smithi186:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-02T09:24:22.550 DEBUG:teuthology.orchestra.run.smithi156:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-02T09:24:22.572 DEBUG:teuthology.orchestra.run.smithi186:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-02T09:24:22.617 INFO:teuthology.orchestra.run.smithi156.stdout:check_obsoletes = 1 2023-11-02T09:24:22.619 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum clean all 2023-11-02T09:24:22.638 INFO:teuthology.orchestra.run.smithi186.stdout:check_obsoletes = 1 2023-11-02T09:24:22.640 DEBUG:teuthology.orchestra.run.smithi186:> sudo yum clean all 2023-11-02T09:24:22.857 INFO:teuthology.orchestra.run.smithi156.stdout:72 files removed 2023-11-02T09:24:22.876 INFO:teuthology.orchestra.run.smithi186.stdout:72 files removed 2023-11-02T09:24:22.884 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd java java java java 2023-11-02T09:24:22.905 DEBUG:teuthology.orchestra.run.smithi186:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd java java java java 2023-11-02T09:24:23.629 INFO:teuthology.orchestra.run.smithi156.stdout:ceph packages for x86_64 182 kB/s | 78 kB 00:00 2023-11-02T09:24:23.636 INFO:teuthology.orchestra.run.smithi186.stdout:ceph packages for x86_64 190 kB/s | 78 kB 00:00 2023-11-02T09:24:23.978 INFO:teuthology.orchestra.run.smithi186.stdout:ceph noarch packages 32 kB/s | 9.4 kB 00:00 2023-11-02T09:24:23.996 INFO:teuthology.orchestra.run.smithi156.stdout:ceph noarch packages 30 kB/s | 9.4 kB 00:00 2023-11-02T09:24:24.347 INFO:teuthology.orchestra.run.smithi186.stdout:ceph source packages 5.6 kB/s | 1.9 kB 00:00 2023-11-02T09:24:24.380 INFO:teuthology.orchestra.run.smithi156.stdout:ceph source packages 5.4 kB/s | 1.9 kB 00:00 2023-11-02T09:24:24.731 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS-9 - AppStream 18 MB/s | 6.3 MB 00:00 2023-11-02T09:24:24.774 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS-9 - AppStream 18 MB/s | 6.3 MB 00:00 2023-11-02T09:24:26.032 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS-9 - BaseOS 8.0 MB/s | 2.0 MB 00:00 2023-11-02T09:24:26.066 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS-9 - BaseOS 7.8 MB/s | 2.0 MB 00:00 2023-11-02T09:24:26.906 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 7.9 MB 00:00 2023-11-02T09:24:28.290 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS Stream 9 - BaseOS 4.1 MB/s | 7.9 MB 00:01 2023-11-02T09:24:29.948 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS Stream 9 - AppStream 8.9 MB/s | 18 MB 00:02 2023-11-02T09:24:32.716 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS Stream 9 - AppStream 5.3 MB/s | 18 MB 00:03 2023-11-02T09:24:34.457 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS Stream 9 - CRB 4.8 MB/s | 5.8 MB 00:01 2023-11-02T09:24:36.292 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS Stream 9 - Extras packages 20 kB/s | 15 kB 00:00 2023-11-02T09:24:37.066 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS Stream 9 - CRB 5.5 MB/s | 5.8 MB 00:01 2023-11-02T09:24:37.977 INFO:teuthology.orchestra.run.smithi186.stdout:Extra Packages for Enterprise Linux 12 MB/s | 19 MB 00:01 2023-11-02T09:24:38.409 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS Stream 9 - Extras packages 56 kB/s | 15 kB 00:00 2023-11-02T09:24:42.485 INFO:teuthology.orchestra.run.smithi186.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2023-11-02T09:24:44.096 INFO:teuthology.orchestra.run.smithi156.stdout:Extra Packages for Enterprise Linux 3.5 MB/s | 19 MB 00:05 2023-11-02T09:24:44.820 INFO:teuthology.orchestra.run.smithi186.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-02T09:24:44.821 INFO:teuthology.orchestra.run.smithi186.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-02T09:24:44.917 INFO:teuthology.orchestra.run.smithi186.stdout:Dependencies resolved. 2023-11-02T09:24:44.937 INFO:teuthology.orchestra.run.smithi186.stdout:====================================================================================================== 2023-11-02T09:24:44.938 INFO:teuthology.orchestra.run.smithi186.stdout: Package Arch Version Repository Size 2023-11-02T09:24:44.938 INFO:teuthology.orchestra.run.smithi186.stdout:====================================================================================================== 2023-11-02T09:24:44.938 INFO:teuthology.orchestra.run.smithi186.stdout:Installing: 2023-11-02T09:24:44.938 INFO:teuthology.orchestra.run.smithi186.stdout: ceph x86_64 2:18.0.0-6872.g84d22000.el9 ceph 6.5 k 2023-11-02T09:24:44.939 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-base x86_64 2:18.0.0-6872.g84d22000.el9 ceph 5.2 M 2023-11-02T09:24:44.939 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-fuse x86_64 2:18.0.0-6872.g84d22000.el9 ceph 856 k 2023-11-02T09:24:44.939 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6872.g84d22000.el9 ceph 142 k 2023-11-02T09:24:44.939 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr x86_64 2:18.0.0-6872.g84d22000.el9 ceph 1.5 M 2023-11-02T09:24:44.939 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6872.g84d22000.el9 ceph-noarch 132 k 2023-11-02T09:24:44.940 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6872.g84d22000.el9 ceph-noarch 1.8 M 2023-11-02T09:24:44.940 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6872.g84d22000.el9 ceph-noarch 7.4 M 2023-11-02T09:24:44.940 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-rook noarch 2:18.0.0-6872.g84d22000.el9 ceph-noarch 48 k 2023-11-02T09:24:44.940 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-radosgw x86_64 2:18.0.0-6872.g84d22000.el9 ceph 8.7 M 2023-11-02T09:24:44.940 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-test x86_64 2:18.0.0-6872.g84d22000.el9 ceph 41 M 2023-11-02T09:24:44.941 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-volume noarch 2:18.0.0-6872.g84d22000.el9 ceph-noarch 262 k 2023-11-02T09:24:44.941 INFO:teuthology.orchestra.run.smithi186.stdout: cephadm noarch 2:18.0.0-6872.g84d22000.el9 ceph-noarch 270 k 2023-11-02T09:24:44.941 INFO:teuthology.orchestra.run.smithi186.stdout: java-11-openjdk x86_64 1:11.0.18.0.10-3.el9 CentOS-AppStream 439 k 2023-11-02T09:24:44.941 INFO:teuthology.orchestra.run.smithi186.stdout: libcephfs-devel x86_64 2:18.0.0-6872.g84d22000.el9 ceph 31 k 2023-11-02T09:24:44.941 INFO:teuthology.orchestra.run.smithi186.stdout: libcephfs2 x86_64 2:18.0.0-6872.g84d22000.el9 ceph 716 k 2023-11-02T09:24:44.942 INFO:teuthology.orchestra.run.smithi186.stdout: librados-devel x86_64 2:18.0.0-6872.g84d22000.el9 ceph 127 k 2023-11-02T09:24:44.942 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cephfs x86_64 2:18.0.0-6872.g84d22000.el9 ceph 162 k 2023-11-02T09:24:44.942 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rados x86_64 2:18.0.0-6872.g84d22000.el9 ceph 320 k 2023-11-02T09:24:44.942 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rbd x86_64 2:18.0.0-6872.g84d22000.el9 ceph 298 k 2023-11-02T09:24:44.942 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rgw x86_64 2:18.0.0-6872.g84d22000.el9 ceph 99 k 2023-11-02T09:24:44.943 INFO:teuthology.orchestra.run.smithi186.stdout: rbd-fuse x86_64 2:18.0.0-6872.g84d22000.el9 ceph 85 k 2023-11-02T09:24:44.943 INFO:teuthology.orchestra.run.smithi186.stdout: rbd-mirror x86_64 2:18.0.0-6872.g84d22000.el9 ceph 3.0 M 2023-11-02T09:24:44.943 INFO:teuthology.orchestra.run.smithi186.stdout: rbd-nbd x86_64 2:18.0.0-6872.g84d22000.el9 ceph 170 k 2023-11-02T09:24:44.943 INFO:teuthology.orchestra.run.smithi186.stdout:Upgrading: 2023-11-02T09:24:44.943 INFO:teuthology.orchestra.run.smithi186.stdout: librados2 x86_64 2:18.0.0-6872.g84d22000.el9 ceph 3.3 M 2023-11-02T09:24:44.944 INFO:teuthology.orchestra.run.smithi186.stdout: librbd1 x86_64 2:18.0.0-6872.g84d22000.el9 ceph 3.0 M 2023-11-02T09:24:44.944 INFO:teuthology.orchestra.run.smithi186.stdout:Installing dependencies: 2023-11-02T09:24:44.944 INFO:teuthology.orchestra.run.smithi186.stdout: ModemManager-glib x86_64 1.20.2-1.el9 CentOS-BaseOS 334 k 2023-11-02T09:24:44.944 INFO:teuthology.orchestra.run.smithi186.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 CentOS-AppStream 625 k 2023-11-02T09:24:44.944 INFO:teuthology.orchestra.run.smithi186.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 CentOS-AppStream 11 M 2023-11-02T09:24:44.945 INFO:teuthology.orchestra.run.smithi186.stdout: alsa-lib x86_64 1.2.9-1.el9 appstream 518 k 2023-11-02T09:24:44.945 INFO:teuthology.orchestra.run.smithi186.stdout: at-spi2-atk x86_64 2.38.0-4.el9 CentOS-AppStream 86 k 2023-11-02T09:24:44.945 INFO:teuthology.orchestra.run.smithi186.stdout: at-spi2-core x86_64 2.40.3-1.el9 CentOS-AppStream 176 k 2023-11-02T09:24:44.945 INFO:teuthology.orchestra.run.smithi186.stdout: atk x86_64 2.36.0-5.el9 CentOS-AppStream 270 k 2023-11-02T09:24:44.945 INFO:teuthology.orchestra.run.smithi186.stdout: avahi-glib x86_64 0.8-12.el9 appstream 15 k 2023-11-02T09:24:44.946 INFO:teuthology.orchestra.run.smithi186.stdout: bluez-libs x86_64 5.64-1.el9 CentOS-BaseOS 83 k 2023-11-02T09:24:44.946 INFO:teuthology.orchestra.run.smithi186.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-11-02T09:24:44.946 INFO:teuthology.orchestra.run.smithi186.stdout: bubblewrap x86_64 0.4.1-6.el9 CentOS-BaseOS 49 k 2023-11-02T09:24:44.947 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-common x86_64 2:18.0.0-6872.g84d22000.el9 ceph 19 M 2023-11-02T09:24:44.947 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6872.g84d22000.el9 ceph-noarch 23 k 2023-11-02T09:24:44.947 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mds x86_64 2:18.0.0-6872.g84d22000.el9 ceph 2.1 M 2023-11-02T09:24:44.947 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6872.g84d22000.el9 ceph-noarch 243 k 2023-11-02T09:24:44.948 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mon x86_64 2:18.0.0-6872.g84d22000.el9 ceph 4.4 M 2023-11-02T09:24:44.948 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-osd x86_64 2:18.0.0-6872.g84d22000.el9 ceph 18 M 2023-11-02T09:24:44.948 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6872.g84d22000.el9 ceph-noarch 15 k 2023-11-02T09:24:44.948 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-selinux x86_64 2:18.0.0-6872.g84d22000.el9 ceph 24 k 2023-11-02T09:24:44.948 INFO:teuthology.orchestra.run.smithi186.stdout: colord-libs x86_64 1.4.5-4.el9 CentOS-AppStream 228 k 2023-11-02T09:24:44.949 INFO:teuthology.orchestra.run.smithi186.stdout: copy-jdk-configs noarch 4.0-3.el9 CentOS-AppStream 27 k 2023-11-02T09:24:44.949 INFO:teuthology.orchestra.run.smithi186.stdout: cups-libs x86_64 1:2.3.3op2-21.el9 CentOS-BaseOS 262 k 2023-11-02T09:24:44.949 INFO:teuthology.orchestra.run.smithi186.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 CentOS-AppStream 524 k 2023-11-02T09:24:44.949 INFO:teuthology.orchestra.run.smithi186.stdout: exiv2-libs x86_64 0.27.5-2.el9 CentOS-AppStream 780 k 2023-11-02T09:24:44.949 INFO:teuthology.orchestra.run.smithi186.stdout: fdk-aac-free x86_64 2.0.0-8.el9 CentOS-AppStream 324 k 2023-11-02T09:24:44.950 INFO:teuthology.orchestra.run.smithi186.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2023-11-02T09:24:44.950 INFO:teuthology.orchestra.run.smithi186.stdout: flatpak-selinux noarch 1.12.8-1.el9 appstream 21 k 2023-11-02T09:24:44.950 INFO:teuthology.orchestra.run.smithi186.stdout: flatpak-session-helper x86_64 1.12.8-1.el9 appstream 74 k 2023-11-02T09:24:44.950 INFO:teuthology.orchestra.run.smithi186.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-11-02T09:24:44.950 INFO:teuthology.orchestra.run.smithi186.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-11-02T09:24:44.951 INFO:teuthology.orchestra.run.smithi186.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-11-02T09:24:44.951 INFO:teuthology.orchestra.run.smithi186.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-11-02T09:24:44.951 INFO:teuthology.orchestra.run.smithi186.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-11-02T09:24:44.951 INFO:teuthology.orchestra.run.smithi186.stdout: gdk-pixbuf2-modules x86_64 2.42.6-3.el9 CentOS-AppStream 84 k 2023-11-02T09:24:44.951 INFO:teuthology.orchestra.run.smithi186.stdout: geoclue2 x86_64 2.6.0-7.el9 CentOS-AppStream 122 k 2023-11-02T09:24:44.952 INFO:teuthology.orchestra.run.smithi186.stdout: giflib x86_64 5.2.1-9.el9 CentOS-AppStream 47 k 2023-11-02T09:24:44.952 INFO:teuthology.orchestra.run.smithi186.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-11-02T09:24:44.952 INFO:teuthology.orchestra.run.smithi186.stdout: graphene x86_64 1.10.6-2.el9 CentOS-AppStream 63 k 2023-11-02T09:24:44.952 INFO:teuthology.orchestra.run.smithi186.stdout: gsm x86_64 1.0.19-6.el9 CentOS-AppStream 33 k 2023-11-02T09:24:44.952 INFO:teuthology.orchestra.run.smithi186.stdout: gstreamer1 x86_64 1.22.1-2.el9 appstream 1.4 M 2023-11-02T09:24:44.953 INFO:teuthology.orchestra.run.smithi186.stdout: gstreamer1-plugins-base x86_64 1.22.1-1.el9 appstream 2.2 M 2023-11-02T09:24:44.953 INFO:teuthology.orchestra.run.smithi186.stdout: gtk-update-icon-cache x86_64 3.24.31-2.el9 CentOS-AppStream 34 k 2023-11-02T09:24:44.953 INFO:teuthology.orchestra.run.smithi186.stdout: hicolor-icon-theme noarch 0.17-13.el9 CentOS-AppStream 65 k 2023-11-02T09:24:44.953 INFO:teuthology.orchestra.run.smithi186.stdout: iso-codes noarch 4.6.0-3.el9 CentOS-AppStream 3.3 M 2023-11-02T09:24:44.953 INFO:teuthology.orchestra.run.smithi186.stdout: java-11-openjdk-headless x86_64 1:11.0.18.0.10-3.el9 CentOS-AppStream 40 M 2023-11-02T09:24:44.954 INFO:teuthology.orchestra.run.smithi186.stdout: javapackages-filesystem noarch 6.0.0-4.el9 CentOS-AppStream 10 k 2023-11-02T09:24:44.954 INFO:teuthology.orchestra.run.smithi186.stdout: jbigkit-libs x86_64 2.1-23.el9 CentOS-AppStream 52 k 2023-11-02T09:24:44.954 INFO:teuthology.orchestra.run.smithi186.stdout: jq x86_64 1.6-15.el9 appstream 187 k 2023-11-02T09:24:44.954 INFO:teuthology.orchestra.run.smithi186.stdout: lcms2 x86_64 2.12-3.el9 CentOS-AppStream 166 k 2023-11-02T09:24:44.955 INFO:teuthology.orchestra.run.smithi186.stdout: libX11-xcb x86_64 1.7.0-8.el9 appstream 11 k 2023-11-02T09:24:44.955 INFO:teuthology.orchestra.run.smithi186.stdout: libXcomposite x86_64 0.4.5-7.el9 CentOS-AppStream 23 k 2023-11-02T09:24:44.955 INFO:teuthology.orchestra.run.smithi186.stdout: libXcursor x86_64 1.2.0-7.el9 CentOS-AppStream 30 k 2023-11-02T09:24:44.955 INFO:teuthology.orchestra.run.smithi186.stdout: libXdamage x86_64 1.1.5-7.el9 CentOS-AppStream 22 k 2023-11-02T09:24:44.955 INFO:teuthology.orchestra.run.smithi186.stdout: libXfixes x86_64 5.0.3-16.el9 CentOS-AppStream 19 k 2023-11-02T09:24:44.956 INFO:teuthology.orchestra.run.smithi186.stdout: libXi x86_64 1.7.10-8.el9 CentOS-AppStream 38 k 2023-11-02T09:24:44.956 INFO:teuthology.orchestra.run.smithi186.stdout: libXinerama x86_64 1.1.4-10.el9 CentOS-AppStream 14 k 2023-11-02T09:24:44.956 INFO:teuthology.orchestra.run.smithi186.stdout: libXrandr x86_64 1.5.2-8.el9 CentOS-AppStream 27 k 2023-11-02T09:24:44.956 INFO:teuthology.orchestra.run.smithi186.stdout: libXtst x86_64 1.2.3-16.el9 CentOS-AppStream 20 k 2023-11-02T09:24:44.957 INFO:teuthology.orchestra.run.smithi186.stdout: libXv x86_64 1.0.11-16.el9 CentOS-AppStream 18 k 2023-11-02T09:24:44.957 INFO:teuthology.orchestra.run.smithi186.stdout: libXxf86vm x86_64 1.1.4-18.el9 CentOS-AppStream 18 k 2023-11-02T09:24:44.957 INFO:teuthology.orchestra.run.smithi186.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-11-02T09:24:44.957 INFO:teuthology.orchestra.run.smithi186.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-11-02T09:24:44.958 INFO:teuthology.orchestra.run.smithi186.stdout: libasyncns x86_64 0.8-22.el9 CentOS-AppStream 29 k 2023-11-02T09:24:44.958 INFO:teuthology.orchestra.run.smithi186.stdout: libcanberra x86_64 0.30-27.el9 appstream 86 k 2023-11-02T09:24:44.958 INFO:teuthology.orchestra.run.smithi186.stdout: libcephsqlite x86_64 2:18.0.0-6872.g84d22000.el9 ceph 164 k 2023-11-02T09:24:44.958 INFO:teuthology.orchestra.run.smithi186.stdout: libdrm x86_64 2.4.115-1.el9 appstream 160 k 2023-11-02T09:24:44.959 INFO:teuthology.orchestra.run.smithi186.stdout: libepoxy x86_64 1.5.5-4.el9 CentOS-AppStream 240 k 2023-11-02T09:24:44.959 INFO:teuthology.orchestra.run.smithi186.stdout: libexif x86_64 0.6.22-6.el9 CentOS-AppStream 431 k 2023-11-02T09:24:44.959 INFO:teuthology.orchestra.run.smithi186.stdout: libfontenc x86_64 1.1.3-17.el9 CentOS-AppStream 30 k 2023-11-02T09:24:44.959 INFO:teuthology.orchestra.run.smithi186.stdout: libgexiv2 x86_64 0.12.3-1.el9 CentOS-AppStream 82 k 2023-11-02T09:24:44.959 INFO:teuthology.orchestra.run.smithi186.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-11-02T09:24:44.960 INFO:teuthology.orchestra.run.smithi186.stdout: libglvnd x86_64 1:1.3.4-1.el9 CentOS-AppStream 134 k 2023-11-02T09:24:44.960 INFO:teuthology.orchestra.run.smithi186.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 CentOS-AppStream 36 k 2023-11-02T09:24:44.960 INFO:teuthology.orchestra.run.smithi186.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 CentOS-AppStream 141 k 2023-11-02T09:24:44.960 INFO:teuthology.orchestra.run.smithi186.stdout: libgsf x86_64 1.14.47-5.el9 CentOS-AppStream 245 k 2023-11-02T09:24:44.960 INFO:teuthology.orchestra.run.smithi186.stdout: libgxps x86_64 0.3.2-3.el9 CentOS-AppStream 78 k 2023-11-02T09:24:44.961 INFO:teuthology.orchestra.run.smithi186.stdout: libiptcdata x86_64 1.0.5-9.el9 CentOS-AppStream 61 k 2023-11-02T09:24:44.961 INFO:teuthology.orchestra.run.smithi186.stdout: libldac x86_64 2.0.2.3-10.el9 CentOS-AppStream 40 k 2023-11-02T09:24:44.961 INFO:teuthology.orchestra.run.smithi186.stdout: libnotify x86_64 0.7.9-8.el9 CentOS-AppStream 43 k 2023-11-02T09:24:44.961 INFO:teuthology.orchestra.run.smithi186.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-11-02T09:24:44.961 INFO:teuthology.orchestra.run.smithi186.stdout: libogg x86_64 2:1.3.4-6.el9 CentOS-AppStream 32 k 2023-11-02T09:24:44.962 INFO:teuthology.orchestra.run.smithi186.stdout: libosinfo x86_64 1.10.0-1.el9 CentOS-AppStream 312 k 2023-11-02T09:24:44.962 INFO:teuthology.orchestra.run.smithi186.stdout: libpciaccess x86_64 0.16-6.el9 CentOS-BaseOS 27 k 2023-11-02T09:24:44.962 INFO:teuthology.orchestra.run.smithi186.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-11-02T09:24:44.962 INFO:teuthology.orchestra.run.smithi186.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-11-02T09:24:44.962 INFO:teuthology.orchestra.run.smithi186.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2023-11-02T09:24:44.963 INFO:teuthology.orchestra.run.smithi186.stdout: libradosstriper1 x86_64 2:18.0.0-6872.g84d22000.el9 ceph 473 k 2023-11-02T09:24:44.963 INFO:teuthology.orchestra.run.smithi186.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-11-02T09:24:44.963 INFO:teuthology.orchestra.run.smithi186.stdout: librgw2 x86_64 2:18.0.0-6872.g84d22000.el9 ceph 4.8 M 2023-11-02T09:24:44.963 INFO:teuthology.orchestra.run.smithi186.stdout: libsbc x86_64 1.4-9.el9 CentOS-AppStream 44 k 2023-11-02T09:24:44.963 INFO:teuthology.orchestra.run.smithi186.stdout: libsndfile x86_64 1.0.31-7.el9 CentOS-AppStream 206 k 2023-11-02T09:24:44.964 INFO:teuthology.orchestra.run.smithi186.stdout: libtheora x86_64 1:1.1.1-31.el9 CentOS-AppStream 163 k 2023-11-02T09:24:44.964 INFO:teuthology.orchestra.run.smithi186.stdout: libtiff x86_64 4.4.0-10.el9 appstream 197 k 2023-11-02T09:24:44.964 INFO:teuthology.orchestra.run.smithi186.stdout: libtool-ltdl x86_64 2.4.6-45.el9 CentOS-AppStream 36 k 2023-11-02T09:24:44.964 INFO:teuthology.orchestra.run.smithi186.stdout: libtracker-sparql x86_64 3.1.2-3.el9 CentOS-AppStream 316 k 2023-11-02T09:24:44.964 INFO:teuthology.orchestra.run.smithi186.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-11-02T09:24:44.965 INFO:teuthology.orchestra.run.smithi186.stdout: libvisual x86_64 1:0.4.0-34.el9 CentOS-AppStream 143 k 2023-11-02T09:24:44.965 INFO:teuthology.orchestra.run.smithi186.stdout: libvorbis x86_64 1:1.3.7-5.el9 CentOS-AppStream 192 k 2023-11-02T09:24:44.965 INFO:teuthology.orchestra.run.smithi186.stdout: libwayland-client x86_64 1.21.0-1.el9 CentOS-AppStream 32 k 2023-11-02T09:24:44.965 INFO:teuthology.orchestra.run.smithi186.stdout: libwayland-cursor x86_64 1.21.0-1.el9 CentOS-AppStream 18 k 2023-11-02T09:24:44.965 INFO:teuthology.orchestra.run.smithi186.stdout: libwayland-egl x86_64 1.21.0-1.el9 CentOS-AppStream 12 k 2023-11-02T09:24:44.965 INFO:teuthology.orchestra.run.smithi186.stdout: libwayland-server x86_64 1.21.0-1.el9 CentOS-AppStream 41 k 2023-11-02T09:24:44.966 INFO:teuthology.orchestra.run.smithi186.stdout: libwebp x86_64 1.2.0-8.el9 appstream 277 k 2023-11-02T09:24:44.966 INFO:teuthology.orchestra.run.smithi186.stdout: libxkbcommon x86_64 1.0.3-4.el9 CentOS-AppStream 132 k 2023-11-02T09:24:44.966 INFO:teuthology.orchestra.run.smithi186.stdout: libxshmfence x86_64 1.3-10.el9 CentOS-AppStream 12 k 2023-11-02T09:24:44.966 INFO:teuthology.orchestra.run.smithi186.stdout: lksctp-tools x86_64 1.0.19-2.el9 CentOS-BaseOS 90 k 2023-11-02T09:24:44.966 INFO:teuthology.orchestra.run.smithi186.stdout: low-memory-monitor x86_64 2.1-4.el9 CentOS-AppStream 35 k 2023-11-02T09:24:44.967 INFO:teuthology.orchestra.run.smithi186.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-11-02T09:24:44.967 INFO:teuthology.orchestra.run.smithi186.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2023-11-02T09:24:44.968 INFO:teuthology.orchestra.run.smithi186.stdout: lua-posix x86_64 35.0-8.el9 CentOS-AppStream 131 k 2023-11-02T09:24:44.968 INFO:teuthology.orchestra.run.smithi186.stdout: mesa-libEGL x86_64 23.1.4-1.el9 appstream 125 k 2023-11-02T09:24:44.968 INFO:teuthology.orchestra.run.smithi186.stdout: mesa-libGL x86_64 23.1.4-1.el9 appstream 166 k 2023-11-02T09:24:44.968 INFO:teuthology.orchestra.run.smithi186.stdout: mesa-libgbm x86_64 23.1.4-1.el9 appstream 38 k 2023-11-02T09:24:44.968 INFO:teuthology.orchestra.run.smithi186.stdout: mesa-libglapi x86_64 23.1.4-1.el9 appstream 47 k 2023-11-02T09:24:44.969 INFO:teuthology.orchestra.run.smithi186.stdout: mesa-vulkan-drivers x86_64 23.1.4-1.el9 appstream 9.2 M 2023-11-02T09:24:44.969 INFO:teuthology.orchestra.run.smithi186.stdout: mkfontscale x86_64 1.2.1-3.el9 CentOS-AppStream 31 k 2023-11-02T09:24:44.969 INFO:teuthology.orchestra.run.smithi186.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-11-02T09:24:44.969 INFO:teuthology.orchestra.run.smithi186.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-11-02T09:24:44.969 INFO:teuthology.orchestra.run.smithi186.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-11-02T09:24:44.970 INFO:teuthology.orchestra.run.smithi186.stdout: openjpeg2 x86_64 2.4.0-7.el9 CentOS-AppStream 162 k 2023-11-02T09:24:44.970 INFO:teuthology.orchestra.run.smithi186.stdout: opus x86_64 1.3.1-10.el9 CentOS-AppStream 199 k 2023-11-02T09:24:44.970 INFO:teuthology.orchestra.run.smithi186.stdout: orc x86_64 0.4.31-6.el9 CentOS-AppStream 183 k 2023-11-02T09:24:44.970 INFO:teuthology.orchestra.run.smithi186.stdout: osinfo-db noarch 20230518-1.el9 appstream 503 k 2023-11-02T09:24:44.970 INFO:teuthology.orchestra.run.smithi186.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 CentOS-AppStream 68 k 2023-11-02T09:24:44.971 INFO:teuthology.orchestra.run.smithi186.stdout: ostree-libs x86_64 2023.6-1.el9 CentOS-AppStream 470 k 2023-11-02T09:24:44.971 INFO:teuthology.orchestra.run.smithi186.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-11-02T09:24:44.971 INFO:teuthology.orchestra.run.smithi186.stdout: pipewire-libs x86_64 0.3.67-2.el9 CentOS-AppStream 1.7 M 2023-11-02T09:24:44.971 INFO:teuthology.orchestra.run.smithi186.stdout: poppler x86_64 21.01.0-19.el9 CentOS-AppStream 1.1 M 2023-11-02T09:24:44.971 INFO:teuthology.orchestra.run.smithi186.stdout: poppler-data noarch 0.4.9-9.el9 CentOS-AppStream 1.8 M 2023-11-02T09:24:44.972 INFO:teuthology.orchestra.run.smithi186.stdout: poppler-glib x86_64 21.01.0-19.el9 CentOS-AppStream 151 k 2023-11-02T09:24:44.972 INFO:teuthology.orchestra.run.smithi186.stdout: pulseaudio-libs x86_64 15.0-2.el9 CentOS-AppStream 666 k 2023-11-02T09:24:44.972 INFO:teuthology.orchestra.run.smithi186.stdout: pulseaudio-utils x86_64 15.0-2.el9 CentOS-AppStream 72 k 2023-11-02T09:24:44.972 INFO:teuthology.orchestra.run.smithi186.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-11-02T09:24:44.972 INFO:teuthology.orchestra.run.smithi186.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-11-02T09:24:44.973 INFO:teuthology.orchestra.run.smithi186.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-11-02T09:24:44.973 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-11-02T09:24:44.973 INFO:teuthology.orchestra.run.smithi186.stdout: python3-ceph-argparse x86_64 2:18.0.0-6872.g84d22000.el9 ceph 45 k 2023-11-02T09:24:44.973 INFO:teuthology.orchestra.run.smithi186.stdout: python3-ceph-common x86_64 2:18.0.0-6872.g84d22000.el9 ceph 127 k 2023-11-02T09:24:44.973 INFO:teuthology.orchestra.run.smithi186.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-11-02T09:24:44.974 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-11-02T09:24:44.974 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-11-02T09:24:44.974 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-11-02T09:24:44.974 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2023-11-02T09:24:44.974 INFO:teuthology.orchestra.run.smithi186.stdout: python3-devel x86_64 3.9.17-2.el9 CentOS-AppStream 205 k 2023-11-02T09:24:44.975 INFO:teuthology.orchestra.run.smithi186.stdout: python3-google-auth noarch 1:2.23.3-1.el9 epel 197 k 2023-11-02T09:24:44.975 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-11-02T09:24:44.975 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-11-02T09:24:44.975 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-11-02T09:24:44.975 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-11-02T09:24:44.976 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-11-02T09:24:44.976 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-11-02T09:24:44.976 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-11-02T09:24:44.976 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-11-02T09:24:44.976 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-11-02T09:24:44.977 INFO:teuthology.orchestra.run.smithi186.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-11-02T09:24:44.977 INFO:teuthology.orchestra.run.smithi186.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-11-02T09:24:44.977 INFO:teuthology.orchestra.run.smithi186.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-11-02T09:24:44.978 INFO:teuthology.orchestra.run.smithi186.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-11-02T09:24:44.978 INFO:teuthology.orchestra.run.smithi186.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-11-02T09:24:44.978 INFO:teuthology.orchestra.run.smithi186.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-11-02T09:24:44.978 INFO:teuthology.orchestra.run.smithi186.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-11-02T09:24:44.979 INFO:teuthology.orchestra.run.smithi186.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-11-02T09:24:44.979 INFO:teuthology.orchestra.run.smithi186.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-11-02T09:24:44.979 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-11-02T09:24:44.979 INFO:teuthology.orchestra.run.smithi186.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-11-02T09:24:44.979 INFO:teuthology.orchestra.run.smithi186.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-11-02T09:24:44.981 INFO:teuthology.orchestra.run.smithi186.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-11-02T09:24:44.981 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-11-02T09:24:44.981 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-11-02T09:24:44.982 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-11-02T09:24:44.982 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-11-02T09:24:44.982 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2023-11-02T09:24:44.982 INFO:teuthology.orchestra.run.smithi186.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-11-02T09:24:44.982 INFO:teuthology.orchestra.run.smithi186.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-11-02T09:24:44.983 INFO:teuthology.orchestra.run.smithi186.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-11-02T09:24:44.983 INFO:teuthology.orchestra.run.smithi186.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-11-02T09:24:44.983 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-11-02T09:24:44.983 INFO:teuthology.orchestra.run.smithi186.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-11-02T09:24:44.983 INFO:teuthology.orchestra.run.smithi186.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-11-02T09:24:44.984 INFO:teuthology.orchestra.run.smithi186.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-11-02T09:24:44.984 INFO:teuthology.orchestra.run.smithi186.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-11-02T09:24:44.984 INFO:teuthology.orchestra.run.smithi186.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-11-02T09:24:44.984 INFO:teuthology.orchestra.run.smithi186.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-11-02T09:24:44.984 INFO:teuthology.orchestra.run.smithi186.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-11-02T09:24:44.985 INFO:teuthology.orchestra.run.smithi186.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-11-02T09:24:44.985 INFO:teuthology.orchestra.run.smithi186.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-11-02T09:24:44.985 INFO:teuthology.orchestra.run.smithi186.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-11-02T09:24:44.985 INFO:teuthology.orchestra.run.smithi186.stdout: rtkit x86_64 0.11-28.el9 CentOS-AppStream 55 k 2023-11-02T09:24:44.985 INFO:teuthology.orchestra.run.smithi186.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-11-02T09:24:44.986 INFO:teuthology.orchestra.run.smithi186.stdout: sound-theme-freedesktop noarch 0.8-17.el9 CentOS-AppStream 377 k 2023-11-02T09:24:44.986 INFO:teuthology.orchestra.run.smithi186.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-11-02T09:24:44.986 INFO:teuthology.orchestra.run.smithi186.stdout: totem-pl-parser x86_64 3.26.6-2.el9 CentOS-AppStream 130 k 2023-11-02T09:24:44.986 INFO:teuthology.orchestra.run.smithi186.stdout: ttmkfdir x86_64 3.0.9-65.el9 CentOS-AppStream 52 k 2023-11-02T09:24:44.986 INFO:teuthology.orchestra.run.smithi186.stdout: tzdata-java noarch 2023c-1.el9 CentOS-AppStream 149 k 2023-11-02T09:24:44.987 INFO:teuthology.orchestra.run.smithi186.stdout: upower x86_64 0.99.11-11.el9 CentOS-AppStream 168 k 2023-11-02T09:24:44.987 INFO:teuthology.orchestra.run.smithi186.stdout: vulkan-loader x86_64 1.3.250.1-1.el9 appstream 141 k 2023-11-02T09:24:44.987 INFO:teuthology.orchestra.run.smithi186.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 CentOS-AppStream 305 k 2023-11-02T09:24:44.987 INFO:teuthology.orchestra.run.smithi186.stdout: wireplumber x86_64 0.4.14-1.el9 appstream 96 k 2023-11-02T09:24:44.987 INFO:teuthology.orchestra.run.smithi186.stdout: wireplumber-libs x86_64 0.4.14-1.el9 appstream 358 k 2023-11-02T09:24:44.988 INFO:teuthology.orchestra.run.smithi186.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 CentOS-AppStream 41 k 2023-11-02T09:24:44.988 INFO:teuthology.orchestra.run.smithi186.stdout: xdg-desktop-portal x86_64 1.12.4-1.el9 CentOS-AppStream 365 k 2023-11-02T09:24:44.989 INFO:teuthology.orchestra.run.smithi186.stdout: xkeyboard-config noarch 2.33-2.el9 CentOS-AppStream 780 k 2023-11-02T09:24:44.989 INFO:teuthology.orchestra.run.smithi186.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-11-02T09:24:44.989 INFO:teuthology.orchestra.run.smithi186.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 CentOS-AppStream 499 k 2023-11-02T09:24:44.989 INFO:teuthology.orchestra.run.smithi186.stdout:Installing weak dependencies: 2023-11-02T09:24:44.990 INFO:teuthology.orchestra.run.smithi186.stdout: dconf x86_64 0.40.0-6.el9 CentOS-AppStream 108 k 2023-11-02T09:24:44.990 INFO:teuthology.orchestra.run.smithi186.stdout: exiv2 x86_64 0.27.5-2.el9 CentOS-AppStream 978 k 2023-11-02T09:24:44.990 INFO:teuthology.orchestra.run.smithi186.stdout: flatpak x86_64 1.12.8-1.el9 appstream 1.7 M 2023-11-02T09:24:44.990 INFO:teuthology.orchestra.run.smithi186.stdout: gtk3 x86_64 3.24.31-2.el9 CentOS-AppStream 4.8 M 2023-11-02T09:24:44.990 INFO:teuthology.orchestra.run.smithi186.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 appstream 32 k 2023-11-02T09:24:44.991 INFO:teuthology.orchestra.run.smithi186.stdout: p11-kit-server x86_64 0.24.1-2.el9 CentOS-AppStream 198 k 2023-11-02T09:24:44.991 INFO:teuthology.orchestra.run.smithi186.stdout: pipewire x86_64 0.3.67-2.el9 CentOS-AppStream 86 k 2023-11-02T09:24:44.991 INFO:teuthology.orchestra.run.smithi186.stdout: pipewire-alsa x86_64 0.3.67-2.el9 CentOS-AppStream 55 k 2023-11-02T09:24:44.991 INFO:teuthology.orchestra.run.smithi186.stdout: pipewire-jack-audio-connection-kit x86_64 0.3.67-2.el9 CentOS-AppStream 126 k 2023-11-02T09:24:44.991 INFO:teuthology.orchestra.run.smithi186.stdout: pipewire-pulseaudio x86_64 0.3.67-2.el9 CentOS-AppStream 18 k 2023-11-02T09:24:44.992 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-11-02T09:24:44.992 INFO:teuthology.orchestra.run.smithi186.stdout: tracker x86_64 3.1.2-3.el9 CentOS-AppStream 537 k 2023-11-02T09:24:44.992 INFO:teuthology.orchestra.run.smithi186.stdout: tracker-miners x86_64 3.1.2-3.el9 CentOS-AppStream 887 k 2023-11-02T09:24:44.992 INFO:teuthology.orchestra.run.smithi186.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 CentOS-AppStream 130 k 2023-11-02T09:24:44.992 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-11-02T09:24:44.993 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction Summary 2023-11-02T09:24:44.993 INFO:teuthology.orchestra.run.smithi186.stdout:====================================================================================================== 2023-11-02T09:24:44.993 INFO:teuthology.orchestra.run.smithi186.stdout:Install 242 Packages 2023-11-02T09:24:44.993 INFO:teuthology.orchestra.run.smithi186.stdout:Upgrade 2 Packages 2023-11-02T09:24:44.993 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-11-02T09:24:44.994 INFO:teuthology.orchestra.run.smithi186.stdout:Total download size: 277 M 2023-11-02T09:24:44.994 INFO:teuthology.orchestra.run.smithi186.stdout:Downloading Packages: 2023-11-02T09:24:45.905 INFO:teuthology.orchestra.run.smithi186.stdout:(1/244): ceph-18.0.0-6872.g84d22000.el9.x86_64. 25 kB/s | 6.5 kB 00:00 2023-11-02T09:24:46.620 INFO:teuthology.orchestra.run.smithi186.stdout:(2/244): ceph-fuse-18.0.0-6872.g84d22000.el9.x8 1.2 MB/s | 856 kB 00:00 2023-11-02T09:24:47.303 INFO:teuthology.orchestra.run.smithi186.stdout:(3/244): ceph-base-18.0.0-6872.g84d22000.el9.x8 3.1 MB/s | 5.2 MB 00:01 2023-11-02T09:24:47.329 INFO:teuthology.orchestra.run.smithi186.stdout:(4/244): ceph-immutable-object-cache-18.0.0-687 200 kB/s | 142 kB 00:00 2023-11-02T09:24:47.529 INFO:teuthology.orchestra.run.smithi186.stdout:(5/244): ceph-mgr-18.0.0-6872.g84d22000.el9.x86 7.3 MB/s | 1.5 MB 00:00 2023-11-02T09:24:47.854 INFO:teuthology.orchestra.run.smithi186.stdout:(6/244): ceph-mds-18.0.0-6872.g84d22000.el9.x86 3.8 MB/s | 2.1 MB 00:00 2023-11-02T09:24:48.046 INFO:teuthology.orchestra.run.smithi186.stdout:(7/244): ceph-mon-18.0.0-6872.g84d22000.el9.x86 8.5 MB/s | 4.4 MB 00:00 2023-11-02T09:24:48.635 INFO:teuthology.orchestra.run.smithi156.stdout:lab-extras 35 kB/s | 1.7 kB 00:00 2023-11-02T09:24:49.063 INFO:teuthology.orchestra.run.smithi186.stdout:(8/244): ceph-radosgw-18.0.0-6872.g84d22000.el9 8.5 MB/s | 8.7 MB 00:01 2023-11-02T09:24:49.146 INFO:teuthology.orchestra.run.smithi186.stdout:(9/244): ceph-selinux-18.0.0-6872.g84d22000.el9 290 kB/s | 24 kB 00:00 2023-11-02T09:24:49.972 INFO:teuthology.orchestra.run.smithi186.stdout:(10/244): ceph-osd-18.0.0-6872.g84d22000.el9.x8 8.4 MB/s | 18 MB 00:02 2023-11-02T09:24:50.155 INFO:teuthology.orchestra.run.smithi186.stdout:(11/244): ceph-common-18.0.0-6872.g84d22000.el9 4.2 MB/s | 19 MB 00:04 2023-11-02T09:24:50.172 INFO:teuthology.orchestra.run.smithi186.stdout:(12/244): libcephfs-devel-18.0.0-6872.g84d22000 156 kB/s | 31 kB 00:00 2023-11-02T09:24:50.481 INFO:teuthology.orchestra.run.smithi186.stdout:(13/244): libcephsqlite-18.0.0-6872.g84d22000.e 532 kB/s | 164 kB 00:00 2023-11-02T09:24:50.506 INFO:teuthology.orchestra.run.smithi186.stdout:(14/244): libcephfs2-18.0.0-6872.g84d22000.el9. 2.0 MB/s | 716 kB 00:00 2023-11-02T09:24:50.648 INFO:teuthology.orchestra.run.smithi186.stdout:(15/244): librados-devel-18.0.0-6872.g84d22000. 760 kB/s | 127 kB 00:00 2023-11-02T09:24:50.732 INFO:teuthology.orchestra.run.smithi186.stdout:(16/244): libradosstriper1-18.0.0-6872.g84d2200 2.0 MB/s | 473 kB 00:00 2023-11-02T09:24:50.979 INFO:teuthology.orchestra.run.smithi156.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-02T09:24:50.980 INFO:teuthology.orchestra.run.smithi156.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-02T09:24:51.007 INFO:teuthology.orchestra.run.smithi186.stdout:(17/244): librgw2-18.0.0-6872.g84d22000.el9.x86 13 MB/s | 4.8 MB 00:00 2023-11-02T09:24:51.065 INFO:teuthology.orchestra.run.smithi186.stdout:(18/244): python3-ceph-common-18.0.0-6872.g84d2 2.1 MB/s | 127 kB 00:00 2023-11-02T09:24:51.074 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-11-02T09:24:51.089 INFO:teuthology.orchestra.run.smithi156.stdout:====================================================================================================== 2023-11-02T09:24:51.089 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repository Size 2023-11-02T09:24:51.090 INFO:teuthology.orchestra.run.smithi156.stdout:====================================================================================================== 2023-11-02T09:24:51.090 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2023-11-02T09:24:51.090 INFO:teuthology.orchestra.run.smithi156.stdout: ceph x86_64 2:18.0.0-6872.g84d22000.el9 ceph 6.5 k 2023-11-02T09:24:51.090 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-base x86_64 2:18.0.0-6872.g84d22000.el9 ceph 5.2 M 2023-11-02T09:24:51.090 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-fuse x86_64 2:18.0.0-6872.g84d22000.el9 ceph 856 k 2023-11-02T09:24:51.091 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6872.g84d22000.el9 ceph 142 k 2023-11-02T09:24:51.091 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr x86_64 2:18.0.0-6872.g84d22000.el9 ceph 1.5 M 2023-11-02T09:24:51.091 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6872.g84d22000.el9 ceph-noarch 132 k 2023-11-02T09:24:51.091 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6872.g84d22000.el9 ceph-noarch 1.8 M 2023-11-02T09:24:51.091 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6872.g84d22000.el9 ceph-noarch 7.4 M 2023-11-02T09:24:51.092 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-rook noarch 2:18.0.0-6872.g84d22000.el9 ceph-noarch 48 k 2023-11-02T09:24:51.092 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-radosgw x86_64 2:18.0.0-6872.g84d22000.el9 ceph 8.7 M 2023-11-02T09:24:51.092 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-test x86_64 2:18.0.0-6872.g84d22000.el9 ceph 41 M 2023-11-02T09:24:51.092 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-volume noarch 2:18.0.0-6872.g84d22000.el9 ceph-noarch 262 k 2023-11-02T09:24:51.092 INFO:teuthology.orchestra.run.smithi156.stdout: cephadm noarch 2:18.0.0-6872.g84d22000.el9 ceph-noarch 270 k 2023-11-02T09:24:51.093 INFO:teuthology.orchestra.run.smithi156.stdout: java-11-openjdk x86_64 1:11.0.18.0.10-3.el9 CentOS-AppStream 439 k 2023-11-02T09:24:51.093 INFO:teuthology.orchestra.run.smithi156.stdout: libcephfs-devel x86_64 2:18.0.0-6872.g84d22000.el9 ceph 31 k 2023-11-02T09:24:51.093 INFO:teuthology.orchestra.run.smithi156.stdout: libcephfs2 x86_64 2:18.0.0-6872.g84d22000.el9 ceph 716 k 2023-11-02T09:24:51.093 INFO:teuthology.orchestra.run.smithi156.stdout: librados-devel x86_64 2:18.0.0-6872.g84d22000.el9 ceph 127 k 2023-11-02T09:24:51.093 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cephfs x86_64 2:18.0.0-6872.g84d22000.el9 ceph 162 k 2023-11-02T09:24:51.093 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rados x86_64 2:18.0.0-6872.g84d22000.el9 ceph 320 k 2023-11-02T09:24:51.094 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rbd x86_64 2:18.0.0-6872.g84d22000.el9 ceph 298 k 2023-11-02T09:24:51.094 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rgw x86_64 2:18.0.0-6872.g84d22000.el9 ceph 99 k 2023-11-02T09:24:51.094 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-fuse x86_64 2:18.0.0-6872.g84d22000.el9 ceph 85 k 2023-11-02T09:24:51.094 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-mirror x86_64 2:18.0.0-6872.g84d22000.el9 ceph 3.0 M 2023-11-02T09:24:51.094 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-nbd x86_64 2:18.0.0-6872.g84d22000.el9 ceph 170 k 2023-11-02T09:24:51.095 INFO:teuthology.orchestra.run.smithi156.stdout:Upgrading: 2023-11-02T09:24:51.095 INFO:teuthology.orchestra.run.smithi156.stdout: librados2 x86_64 2:18.0.0-6872.g84d22000.el9 ceph 3.3 M 2023-11-02T09:24:51.095 INFO:teuthology.orchestra.run.smithi156.stdout: librbd1 x86_64 2:18.0.0-6872.g84d22000.el9 ceph 3.0 M 2023-11-02T09:24:51.095 INFO:teuthology.orchestra.run.smithi156.stdout:Installing dependencies: 2023-11-02T09:24:51.095 INFO:teuthology.orchestra.run.smithi156.stdout: ModemManager-glib x86_64 1.20.2-1.el9 CentOS-BaseOS 334 k 2023-11-02T09:24:51.096 INFO:teuthology.orchestra.run.smithi156.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 CentOS-AppStream 625 k 2023-11-02T09:24:51.096 INFO:teuthology.orchestra.run.smithi156.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 CentOS-AppStream 11 M 2023-11-02T09:24:51.096 INFO:teuthology.orchestra.run.smithi156.stdout: alsa-lib x86_64 1.2.9-1.el9 appstream 518 k 2023-11-02T09:24:51.096 INFO:teuthology.orchestra.run.smithi156.stdout: at-spi2-atk x86_64 2.38.0-4.el9 CentOS-AppStream 86 k 2023-11-02T09:24:51.096 INFO:teuthology.orchestra.run.smithi156.stdout: at-spi2-core x86_64 2.40.3-1.el9 CentOS-AppStream 176 k 2023-11-02T09:24:51.097 INFO:teuthology.orchestra.run.smithi156.stdout: atk x86_64 2.36.0-5.el9 CentOS-AppStream 270 k 2023-11-02T09:24:51.097 INFO:teuthology.orchestra.run.smithi156.stdout: avahi-glib x86_64 0.8-12.el9 appstream 15 k 2023-11-02T09:24:51.097 INFO:teuthology.orchestra.run.smithi156.stdout: bluez-libs x86_64 5.64-1.el9 CentOS-BaseOS 83 k 2023-11-02T09:24:51.097 INFO:teuthology.orchestra.run.smithi156.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-11-02T09:24:51.097 INFO:teuthology.orchestra.run.smithi156.stdout: bubblewrap x86_64 0.4.1-6.el9 CentOS-BaseOS 49 k 2023-11-02T09:24:51.097 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-common x86_64 2:18.0.0-6872.g84d22000.el9 ceph 19 M 2023-11-02T09:24:51.098 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6872.g84d22000.el9 ceph-noarch 23 k 2023-11-02T09:24:51.099 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mds x86_64 2:18.0.0-6872.g84d22000.el9 ceph 2.1 M 2023-11-02T09:24:51.099 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6872.g84d22000.el9 ceph-noarch 243 k 2023-11-02T09:24:51.099 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mon x86_64 2:18.0.0-6872.g84d22000.el9 ceph 4.4 M 2023-11-02T09:24:51.099 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-osd x86_64 2:18.0.0-6872.g84d22000.el9 ceph 18 M 2023-11-02T09:24:51.100 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6872.g84d22000.el9 ceph-noarch 15 k 2023-11-02T09:24:51.100 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-selinux x86_64 2:18.0.0-6872.g84d22000.el9 ceph 24 k 2023-11-02T09:24:51.100 INFO:teuthology.orchestra.run.smithi156.stdout: colord-libs x86_64 1.4.5-4.el9 CentOS-AppStream 228 k 2023-11-02T09:24:51.101 INFO:teuthology.orchestra.run.smithi156.stdout: copy-jdk-configs noarch 4.0-3.el9 CentOS-AppStream 27 k 2023-11-02T09:24:51.101 INFO:teuthology.orchestra.run.smithi156.stdout: cups-libs x86_64 1:2.3.3op2-21.el9 CentOS-BaseOS 262 k 2023-11-02T09:24:51.101 INFO:teuthology.orchestra.run.smithi156.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 CentOS-AppStream 524 k 2023-11-02T09:24:51.101 INFO:teuthology.orchestra.run.smithi156.stdout: exiv2-libs x86_64 0.27.5-2.el9 CentOS-AppStream 780 k 2023-11-02T09:24:51.101 INFO:teuthology.orchestra.run.smithi156.stdout: fdk-aac-free x86_64 2.0.0-8.el9 CentOS-AppStream 324 k 2023-11-02T09:24:51.102 INFO:teuthology.orchestra.run.smithi156.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2023-11-02T09:24:51.102 INFO:teuthology.orchestra.run.smithi156.stdout: flatpak-selinux noarch 1.12.8-1.el9 appstream 21 k 2023-11-02T09:24:51.102 INFO:teuthology.orchestra.run.smithi156.stdout: flatpak-session-helper x86_64 1.12.8-1.el9 appstream 74 k 2023-11-02T09:24:51.102 INFO:teuthology.orchestra.run.smithi156.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-11-02T09:24:51.103 INFO:teuthology.orchestra.run.smithi156.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-11-02T09:24:51.103 INFO:teuthology.orchestra.run.smithi156.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-11-02T09:24:51.103 INFO:teuthology.orchestra.run.smithi156.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-11-02T09:24:51.103 INFO:teuthology.orchestra.run.smithi156.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-11-02T09:24:51.103 INFO:teuthology.orchestra.run.smithi156.stdout: gdk-pixbuf2-modules x86_64 2.42.6-3.el9 CentOS-AppStream 84 k 2023-11-02T09:24:51.104 INFO:teuthology.orchestra.run.smithi156.stdout: geoclue2 x86_64 2.6.0-7.el9 CentOS-AppStream 122 k 2023-11-02T09:24:51.104 INFO:teuthology.orchestra.run.smithi156.stdout: giflib x86_64 5.2.1-9.el9 CentOS-AppStream 47 k 2023-11-02T09:24:51.104 INFO:teuthology.orchestra.run.smithi156.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-11-02T09:24:51.104 INFO:teuthology.orchestra.run.smithi156.stdout: graphene x86_64 1.10.6-2.el9 CentOS-AppStream 63 k 2023-11-02T09:24:51.105 INFO:teuthology.orchestra.run.smithi156.stdout: gsm x86_64 1.0.19-6.el9 CentOS-AppStream 33 k 2023-11-02T09:24:51.105 INFO:teuthology.orchestra.run.smithi156.stdout: gstreamer1 x86_64 1.22.1-2.el9 appstream 1.4 M 2023-11-02T09:24:51.106 INFO:teuthology.orchestra.run.smithi156.stdout: gstreamer1-plugins-base x86_64 1.22.1-1.el9 appstream 2.2 M 2023-11-02T09:24:51.106 INFO:teuthology.orchestra.run.smithi156.stdout: gtk-update-icon-cache x86_64 3.24.31-2.el9 CentOS-AppStream 34 k 2023-11-02T09:24:51.106 INFO:teuthology.orchestra.run.smithi156.stdout: hicolor-icon-theme noarch 0.17-13.el9 CentOS-AppStream 65 k 2023-11-02T09:24:51.106 INFO:teuthology.orchestra.run.smithi156.stdout: iso-codes noarch 4.6.0-3.el9 CentOS-AppStream 3.3 M 2023-11-02T09:24:51.107 INFO:teuthology.orchestra.run.smithi156.stdout: java-11-openjdk-headless x86_64 1:11.0.18.0.10-3.el9 CentOS-AppStream 40 M 2023-11-02T09:24:51.107 INFO:teuthology.orchestra.run.smithi156.stdout: javapackages-filesystem noarch 6.0.0-4.el9 CentOS-AppStream 10 k 2023-11-02T09:24:51.107 INFO:teuthology.orchestra.run.smithi156.stdout: jbigkit-libs x86_64 2.1-23.el9 CentOS-AppStream 52 k 2023-11-02T09:24:51.107 INFO:teuthology.orchestra.run.smithi156.stdout: jq x86_64 1.6-15.el9 appstream 187 k 2023-11-02T09:24:51.108 INFO:teuthology.orchestra.run.smithi156.stdout: lcms2 x86_64 2.12-3.el9 CentOS-AppStream 166 k 2023-11-02T09:24:51.108 INFO:teuthology.orchestra.run.smithi156.stdout: libX11-xcb x86_64 1.7.0-8.el9 appstream 11 k 2023-11-02T09:24:51.108 INFO:teuthology.orchestra.run.smithi156.stdout: libXcomposite x86_64 0.4.5-7.el9 CentOS-AppStream 23 k 2023-11-02T09:24:51.108 INFO:teuthology.orchestra.run.smithi156.stdout: libXcursor x86_64 1.2.0-7.el9 CentOS-AppStream 30 k 2023-11-02T09:24:51.108 INFO:teuthology.orchestra.run.smithi156.stdout: libXdamage x86_64 1.1.5-7.el9 CentOS-AppStream 22 k 2023-11-02T09:24:51.109 INFO:teuthology.orchestra.run.smithi156.stdout: libXfixes x86_64 5.0.3-16.el9 CentOS-AppStream 19 k 2023-11-02T09:24:51.109 INFO:teuthology.orchestra.run.smithi156.stdout: libXi x86_64 1.7.10-8.el9 CentOS-AppStream 38 k 2023-11-02T09:24:51.109 INFO:teuthology.orchestra.run.smithi156.stdout: libXinerama x86_64 1.1.4-10.el9 CentOS-AppStream 14 k 2023-11-02T09:24:51.109 INFO:teuthology.orchestra.run.smithi156.stdout: libXrandr x86_64 1.5.2-8.el9 CentOS-AppStream 27 k 2023-11-02T09:24:51.109 INFO:teuthology.orchestra.run.smithi156.stdout: libXtst x86_64 1.2.3-16.el9 CentOS-AppStream 20 k 2023-11-02T09:24:51.109 INFO:teuthology.orchestra.run.smithi156.stdout: libXv x86_64 1.0.11-16.el9 CentOS-AppStream 18 k 2023-11-02T09:24:51.110 INFO:teuthology.orchestra.run.smithi156.stdout: libXxf86vm x86_64 1.1.4-18.el9 CentOS-AppStream 18 k 2023-11-02T09:24:51.110 INFO:teuthology.orchestra.run.smithi156.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-11-02T09:24:51.110 INFO:teuthology.orchestra.run.smithi156.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-11-02T09:24:51.110 INFO:teuthology.orchestra.run.smithi156.stdout: libasyncns x86_64 0.8-22.el9 CentOS-AppStream 29 k 2023-11-02T09:24:51.111 INFO:teuthology.orchestra.run.smithi156.stdout: libcanberra x86_64 0.30-27.el9 appstream 86 k 2023-11-02T09:24:51.111 INFO:teuthology.orchestra.run.smithi156.stdout: libcephsqlite x86_64 2:18.0.0-6872.g84d22000.el9 ceph 164 k 2023-11-02T09:24:51.111 INFO:teuthology.orchestra.run.smithi156.stdout: libdrm x86_64 2.4.115-1.el9 appstream 160 k 2023-11-02T09:24:51.111 INFO:teuthology.orchestra.run.smithi156.stdout: libepoxy x86_64 1.5.5-4.el9 CentOS-AppStream 240 k 2023-11-02T09:24:51.111 INFO:teuthology.orchestra.run.smithi156.stdout: libexif x86_64 0.6.22-6.el9 CentOS-AppStream 431 k 2023-11-02T09:24:51.111 INFO:teuthology.orchestra.run.smithi156.stdout: libfontenc x86_64 1.1.3-17.el9 CentOS-AppStream 30 k 2023-11-02T09:24:51.112 INFO:teuthology.orchestra.run.smithi156.stdout: libgexiv2 x86_64 0.12.3-1.el9 CentOS-AppStream 82 k 2023-11-02T09:24:51.112 INFO:teuthology.orchestra.run.smithi156.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-11-02T09:24:51.112 INFO:teuthology.orchestra.run.smithi156.stdout: libglvnd x86_64 1:1.3.4-1.el9 CentOS-AppStream 134 k 2023-11-02T09:24:51.112 INFO:teuthology.orchestra.run.smithi156.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 CentOS-AppStream 36 k 2023-11-02T09:24:51.112 INFO:teuthology.orchestra.run.smithi156.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 CentOS-AppStream 141 k 2023-11-02T09:24:51.113 INFO:teuthology.orchestra.run.smithi156.stdout: libgsf x86_64 1.14.47-5.el9 CentOS-AppStream 245 k 2023-11-02T09:24:51.113 INFO:teuthology.orchestra.run.smithi156.stdout: libgxps x86_64 0.3.2-3.el9 CentOS-AppStream 78 k 2023-11-02T09:24:51.113 INFO:teuthology.orchestra.run.smithi156.stdout: libiptcdata x86_64 1.0.5-9.el9 CentOS-AppStream 61 k 2023-11-02T09:24:51.113 INFO:teuthology.orchestra.run.smithi156.stdout: libldac x86_64 2.0.2.3-10.el9 CentOS-AppStream 40 k 2023-11-02T09:24:51.113 INFO:teuthology.orchestra.run.smithi156.stdout: libnotify x86_64 0.7.9-8.el9 CentOS-AppStream 43 k 2023-11-02T09:24:51.114 INFO:teuthology.orchestra.run.smithi156.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-11-02T09:24:51.114 INFO:teuthology.orchestra.run.smithi156.stdout: libogg x86_64 2:1.3.4-6.el9 CentOS-AppStream 32 k 2023-11-02T09:24:51.114 INFO:teuthology.orchestra.run.smithi156.stdout: libosinfo x86_64 1.10.0-1.el9 CentOS-AppStream 312 k 2023-11-02T09:24:51.114 INFO:teuthology.orchestra.run.smithi156.stdout: libpciaccess x86_64 0.16-6.el9 CentOS-BaseOS 27 k 2023-11-02T09:24:51.114 INFO:teuthology.orchestra.run.smithi156.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-11-02T09:24:51.115 INFO:teuthology.orchestra.run.smithi156.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-11-02T09:24:51.115 INFO:teuthology.orchestra.run.smithi156.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2023-11-02T09:24:51.115 INFO:teuthology.orchestra.run.smithi156.stdout: libradosstriper1 x86_64 2:18.0.0-6872.g84d22000.el9 ceph 473 k 2023-11-02T09:24:51.115 INFO:teuthology.orchestra.run.smithi156.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-11-02T09:24:51.116 INFO:teuthology.orchestra.run.smithi156.stdout: librgw2 x86_64 2:18.0.0-6872.g84d22000.el9 ceph 4.8 M 2023-11-02T09:24:51.116 INFO:teuthology.orchestra.run.smithi156.stdout: libsbc x86_64 1.4-9.el9 CentOS-AppStream 44 k 2023-11-02T09:24:51.116 INFO:teuthology.orchestra.run.smithi156.stdout: libsndfile x86_64 1.0.31-7.el9 CentOS-AppStream 206 k 2023-11-02T09:24:51.116 INFO:teuthology.orchestra.run.smithi156.stdout: libtheora x86_64 1:1.1.1-31.el9 CentOS-AppStream 163 k 2023-11-02T09:24:51.116 INFO:teuthology.orchestra.run.smithi156.stdout: libtiff x86_64 4.4.0-10.el9 appstream 197 k 2023-11-02T09:24:51.116 INFO:teuthology.orchestra.run.smithi156.stdout: libtool-ltdl x86_64 2.4.6-45.el9 CentOS-AppStream 36 k 2023-11-02T09:24:51.117 INFO:teuthology.orchestra.run.smithi156.stdout: libtracker-sparql x86_64 3.1.2-3.el9 CentOS-AppStream 316 k 2023-11-02T09:24:51.117 INFO:teuthology.orchestra.run.smithi156.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-11-02T09:24:51.117 INFO:teuthology.orchestra.run.smithi156.stdout: libvisual x86_64 1:0.4.0-34.el9 CentOS-AppStream 143 k 2023-11-02T09:24:51.117 INFO:teuthology.orchestra.run.smithi156.stdout: libvorbis x86_64 1:1.3.7-5.el9 CentOS-AppStream 192 k 2023-11-02T09:24:51.117 INFO:teuthology.orchestra.run.smithi156.stdout: libwayland-client x86_64 1.21.0-1.el9 CentOS-AppStream 32 k 2023-11-02T09:24:51.118 INFO:teuthology.orchestra.run.smithi156.stdout: libwayland-cursor x86_64 1.21.0-1.el9 CentOS-AppStream 18 k 2023-11-02T09:24:51.118 INFO:teuthology.orchestra.run.smithi156.stdout: libwayland-egl x86_64 1.21.0-1.el9 CentOS-AppStream 12 k 2023-11-02T09:24:51.118 INFO:teuthology.orchestra.run.smithi156.stdout: libwayland-server x86_64 1.21.0-1.el9 CentOS-AppStream 41 k 2023-11-02T09:24:51.118 INFO:teuthology.orchestra.run.smithi156.stdout: libwebp x86_64 1.2.0-8.el9 appstream 277 k 2023-11-02T09:24:51.118 INFO:teuthology.orchestra.run.smithi156.stdout: libxkbcommon x86_64 1.0.3-4.el9 CentOS-AppStream 132 k 2023-11-02T09:24:51.119 INFO:teuthology.orchestra.run.smithi156.stdout: libxshmfence x86_64 1.3-10.el9 CentOS-AppStream 12 k 2023-11-02T09:24:51.119 INFO:teuthology.orchestra.run.smithi156.stdout: lksctp-tools x86_64 1.0.19-2.el9 CentOS-BaseOS 90 k 2023-11-02T09:24:51.119 INFO:teuthology.orchestra.run.smithi156.stdout: low-memory-monitor x86_64 2.1-4.el9 CentOS-AppStream 35 k 2023-11-02T09:24:51.119 INFO:teuthology.orchestra.run.smithi156.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-11-02T09:24:51.119 INFO:teuthology.orchestra.run.smithi156.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2023-11-02T09:24:51.120 INFO:teuthology.orchestra.run.smithi156.stdout: lua-posix x86_64 35.0-8.el9 CentOS-AppStream 131 k 2023-11-02T09:24:51.120 INFO:teuthology.orchestra.run.smithi156.stdout: mesa-libEGL x86_64 23.1.4-1.el9 appstream 125 k 2023-11-02T09:24:51.120 INFO:teuthology.orchestra.run.smithi156.stdout: mesa-libGL x86_64 23.1.4-1.el9 appstream 166 k 2023-11-02T09:24:51.120 INFO:teuthology.orchestra.run.smithi156.stdout: mesa-libgbm x86_64 23.1.4-1.el9 appstream 38 k 2023-11-02T09:24:51.120 INFO:teuthology.orchestra.run.smithi156.stdout: mesa-libglapi x86_64 23.1.4-1.el9 appstream 47 k 2023-11-02T09:24:51.121 INFO:teuthology.orchestra.run.smithi156.stdout: mesa-vulkan-drivers x86_64 23.1.4-1.el9 appstream 9.2 M 2023-11-02T09:24:51.121 INFO:teuthology.orchestra.run.smithi156.stdout: mkfontscale x86_64 1.2.1-3.el9 CentOS-AppStream 31 k 2023-11-02T09:24:51.121 INFO:teuthology.orchestra.run.smithi156.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-11-02T09:24:51.121 INFO:teuthology.orchestra.run.smithi156.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-11-02T09:24:51.121 INFO:teuthology.orchestra.run.smithi156.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-11-02T09:24:51.122 INFO:teuthology.orchestra.run.smithi156.stdout: openjpeg2 x86_64 2.4.0-7.el9 CentOS-AppStream 162 k 2023-11-02T09:24:51.122 INFO:teuthology.orchestra.run.smithi156.stdout: opus x86_64 1.3.1-10.el9 CentOS-AppStream 199 k 2023-11-02T09:24:51.122 INFO:teuthology.orchestra.run.smithi156.stdout: orc x86_64 0.4.31-6.el9 CentOS-AppStream 183 k 2023-11-02T09:24:51.122 INFO:teuthology.orchestra.run.smithi156.stdout: osinfo-db noarch 20230518-1.el9 appstream 503 k 2023-11-02T09:24:51.122 INFO:teuthology.orchestra.run.smithi156.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 CentOS-AppStream 68 k 2023-11-02T09:24:51.123 INFO:teuthology.orchestra.run.smithi156.stdout: ostree-libs x86_64 2023.6-1.el9 CentOS-AppStream 470 k 2023-11-02T09:24:51.123 INFO:teuthology.orchestra.run.smithi156.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-11-02T09:24:51.123 INFO:teuthology.orchestra.run.smithi156.stdout: pipewire-libs x86_64 0.3.67-2.el9 CentOS-AppStream 1.7 M 2023-11-02T09:24:51.123 INFO:teuthology.orchestra.run.smithi156.stdout: poppler x86_64 21.01.0-19.el9 CentOS-AppStream 1.1 M 2023-11-02T09:24:51.123 INFO:teuthology.orchestra.run.smithi156.stdout: poppler-data noarch 0.4.9-9.el9 CentOS-AppStream 1.8 M 2023-11-02T09:24:51.123 INFO:teuthology.orchestra.run.smithi156.stdout: poppler-glib x86_64 21.01.0-19.el9 CentOS-AppStream 151 k 2023-11-02T09:24:51.124 INFO:teuthology.orchestra.run.smithi156.stdout: pulseaudio-libs x86_64 15.0-2.el9 CentOS-AppStream 666 k 2023-11-02T09:24:51.124 INFO:teuthology.orchestra.run.smithi156.stdout: pulseaudio-utils x86_64 15.0-2.el9 CentOS-AppStream 72 k 2023-11-02T09:24:51.124 INFO:teuthology.orchestra.run.smithi156.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-11-02T09:24:51.124 INFO:teuthology.orchestra.run.smithi156.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-11-02T09:24:51.124 INFO:teuthology.orchestra.run.smithi156.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-11-02T09:24:51.125 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-11-02T09:24:51.125 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ceph-argparse x86_64 2:18.0.0-6872.g84d22000.el9 ceph 45 k 2023-11-02T09:24:51.125 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ceph-common x86_64 2:18.0.0-6872.g84d22000.el9 ceph 127 k 2023-11-02T09:24:51.125 INFO:teuthology.orchestra.run.smithi156.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-11-02T09:24:51.125 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-11-02T09:24:51.126 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-11-02T09:24:51.126 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-11-02T09:24:51.126 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2023-11-02T09:24:51.126 INFO:teuthology.orchestra.run.smithi156.stdout: python3-devel x86_64 3.9.17-2.el9 CentOS-AppStream 205 k 2023-11-02T09:24:51.126 INFO:teuthology.orchestra.run.smithi156.stdout: python3-google-auth noarch 1:2.23.3-1.el9 epel 197 k 2023-11-02T09:24:51.127 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-11-02T09:24:51.127 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-11-02T09:24:51.127 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-11-02T09:24:51.127 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-11-02T09:24:51.127 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-11-02T09:24:51.128 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-11-02T09:24:51.128 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-11-02T09:24:51.128 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-11-02T09:24:51.128 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-11-02T09:24:51.128 INFO:teuthology.orchestra.run.smithi156.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-11-02T09:24:51.129 INFO:teuthology.orchestra.run.smithi156.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-11-02T09:24:51.129 INFO:teuthology.orchestra.run.smithi156.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-11-02T09:24:51.129 INFO:teuthology.orchestra.run.smithi156.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-11-02T09:24:51.130 INFO:teuthology.orchestra.run.smithi156.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-11-02T09:24:51.130 INFO:teuthology.orchestra.run.smithi156.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-11-02T09:24:51.130 INFO:teuthology.orchestra.run.smithi156.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-11-02T09:24:51.130 INFO:teuthology.orchestra.run.smithi156.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-11-02T09:24:51.130 INFO:teuthology.orchestra.run.smithi156.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-11-02T09:24:51.131 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-11-02T09:24:51.131 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-11-02T09:24:51.131 INFO:teuthology.orchestra.run.smithi156.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-11-02T09:24:51.131 INFO:teuthology.orchestra.run.smithi156.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-11-02T09:24:51.131 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-11-02T09:24:51.132 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-11-02T09:24:51.132 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-11-02T09:24:51.132 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-11-02T09:24:51.132 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2023-11-02T09:24:51.132 INFO:teuthology.orchestra.run.smithi156.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-11-02T09:24:51.133 INFO:teuthology.orchestra.run.smithi156.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-11-02T09:24:51.133 INFO:teuthology.orchestra.run.smithi156.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-11-02T09:24:51.133 INFO:teuthology.orchestra.run.smithi156.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-11-02T09:24:51.133 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-11-02T09:24:51.133 INFO:teuthology.orchestra.run.smithi156.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-11-02T09:24:51.134 INFO:teuthology.orchestra.run.smithi156.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-11-02T09:24:51.134 INFO:teuthology.orchestra.run.smithi156.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-11-02T09:24:51.134 INFO:teuthology.orchestra.run.smithi156.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-11-02T09:24:51.134 INFO:teuthology.orchestra.run.smithi156.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-11-02T09:24:51.134 INFO:teuthology.orchestra.run.smithi156.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-11-02T09:24:51.135 INFO:teuthology.orchestra.run.smithi156.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-11-02T09:24:51.135 INFO:teuthology.orchestra.run.smithi156.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-11-02T09:24:51.135 INFO:teuthology.orchestra.run.smithi156.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-11-02T09:24:51.135 INFO:teuthology.orchestra.run.smithi156.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-11-02T09:24:51.135 INFO:teuthology.orchestra.run.smithi156.stdout: rtkit x86_64 0.11-28.el9 CentOS-AppStream 55 k 2023-11-02T09:24:51.136 INFO:teuthology.orchestra.run.smithi156.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-11-02T09:24:51.136 INFO:teuthology.orchestra.run.smithi156.stdout: sound-theme-freedesktop noarch 0.8-17.el9 CentOS-AppStream 377 k 2023-11-02T09:24:51.136 INFO:teuthology.orchestra.run.smithi156.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-11-02T09:24:51.136 INFO:teuthology.orchestra.run.smithi156.stdout: totem-pl-parser x86_64 3.26.6-2.el9 CentOS-AppStream 130 k 2023-11-02T09:24:51.136 INFO:teuthology.orchestra.run.smithi156.stdout: ttmkfdir x86_64 3.0.9-65.el9 CentOS-AppStream 52 k 2023-11-02T09:24:51.137 INFO:teuthology.orchestra.run.smithi156.stdout: tzdata-java noarch 2023c-1.el9 CentOS-AppStream 149 k 2023-11-02T09:24:51.137 INFO:teuthology.orchestra.run.smithi156.stdout: upower x86_64 0.99.11-11.el9 CentOS-AppStream 168 k 2023-11-02T09:24:51.137 INFO:teuthology.orchestra.run.smithi156.stdout: vulkan-loader x86_64 1.3.250.1-1.el9 appstream 141 k 2023-11-02T09:24:51.137 INFO:teuthology.orchestra.run.smithi156.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 CentOS-AppStream 305 k 2023-11-02T09:24:51.137 INFO:teuthology.orchestra.run.smithi156.stdout: wireplumber x86_64 0.4.14-1.el9 appstream 96 k 2023-11-02T09:24:51.137 INFO:teuthology.orchestra.run.smithi156.stdout: wireplumber-libs x86_64 0.4.14-1.el9 appstream 358 k 2023-11-02T09:24:51.138 INFO:teuthology.orchestra.run.smithi156.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 CentOS-AppStream 41 k 2023-11-02T09:24:51.138 INFO:teuthology.orchestra.run.smithi156.stdout: xdg-desktop-portal x86_64 1.12.4-1.el9 CentOS-AppStream 365 k 2023-11-02T09:24:51.138 INFO:teuthology.orchestra.run.smithi156.stdout: xkeyboard-config noarch 2.33-2.el9 CentOS-AppStream 780 k 2023-11-02T09:24:51.138 INFO:teuthology.orchestra.run.smithi156.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-11-02T09:24:51.138 INFO:teuthology.orchestra.run.smithi156.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 CentOS-AppStream 499 k 2023-11-02T09:24:51.139 INFO:teuthology.orchestra.run.smithi156.stdout:Installing weak dependencies: 2023-11-02T09:24:51.139 INFO:teuthology.orchestra.run.smithi156.stdout: dconf x86_64 0.40.0-6.el9 CentOS-AppStream 108 k 2023-11-02T09:24:51.139 INFO:teuthology.orchestra.run.smithi156.stdout: exiv2 x86_64 0.27.5-2.el9 CentOS-AppStream 978 k 2023-11-02T09:24:51.139 INFO:teuthology.orchestra.run.smithi156.stdout: flatpak x86_64 1.12.8-1.el9 appstream 1.7 M 2023-11-02T09:24:51.140 INFO:teuthology.orchestra.run.smithi156.stdout: gtk3 x86_64 3.24.31-2.el9 CentOS-AppStream 4.8 M 2023-11-02T09:24:51.140 INFO:teuthology.orchestra.run.smithi156.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 appstream 32 k 2023-11-02T09:24:51.140 INFO:teuthology.orchestra.run.smithi156.stdout: p11-kit-server x86_64 0.24.1-2.el9 CentOS-AppStream 198 k 2023-11-02T09:24:51.140 INFO:teuthology.orchestra.run.smithi156.stdout: pipewire x86_64 0.3.67-2.el9 CentOS-AppStream 86 k 2023-11-02T09:24:51.140 INFO:teuthology.orchestra.run.smithi156.stdout: pipewire-alsa x86_64 0.3.67-2.el9 CentOS-AppStream 55 k 2023-11-02T09:24:51.140 INFO:teuthology.orchestra.run.smithi156.stdout: pipewire-jack-audio-connection-kit x86_64 0.3.67-2.el9 CentOS-AppStream 126 k 2023-11-02T09:24:51.141 INFO:teuthology.orchestra.run.smithi156.stdout: pipewire-pulseaudio x86_64 0.3.67-2.el9 CentOS-AppStream 18 k 2023-11-02T09:24:51.141 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-11-02T09:24:51.141 INFO:teuthology.orchestra.run.smithi156.stdout: tracker x86_64 3.1.2-3.el9 CentOS-AppStream 537 k 2023-11-02T09:24:51.141 INFO:teuthology.orchestra.run.smithi156.stdout: tracker-miners x86_64 3.1.2-3.el9 CentOS-AppStream 887 k 2023-11-02T09:24:51.141 INFO:teuthology.orchestra.run.smithi156.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 CentOS-AppStream 130 k 2023-11-02T09:24:51.142 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:24:51.142 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-11-02T09:24:51.142 INFO:teuthology.orchestra.run.smithi156.stdout:====================================================================================================== 2023-11-02T09:24:51.142 INFO:teuthology.orchestra.run.smithi156.stdout:Install 242 Packages 2023-11-02T09:24:51.142 INFO:teuthology.orchestra.run.smithi156.stdout:Upgrade 2 Packages 2023-11-02T09:24:51.143 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:24:51.144 INFO:teuthology.orchestra.run.smithi186.stdout:(19/244): python3-ceph-argparse-18.0.0-6872.g84 126 kB/s | 45 kB 00:00 2023-11-02T09:24:51.144 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 277 M 2023-11-02T09:24:51.144 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-11-02T09:24:51.157 INFO:teuthology.orchestra.run.smithi186.stdout:(20/244): python3-cephfs-18.0.0-6872.g84d22000. 1.7 MB/s | 162 kB 00:00 2023-11-02T09:24:51.225 INFO:teuthology.orchestra.run.smithi186.stdout:(21/244): python3-rbd-18.0.0-6872.g84d22000.el9 4.4 MB/s | 298 kB 00:00 2023-11-02T09:24:51.258 INFO:teuthology.orchestra.run.smithi186.stdout:(22/244): python3-rados-18.0.0-6872.g84d22000.e 1.9 MB/s | 320 kB 00:00 2023-11-02T09:24:51.300 INFO:teuthology.orchestra.run.smithi186.stdout:(23/244): python3-rgw-18.0.0-6872.g84d22000.el9 1.3 MB/s | 99 kB 00:00 2023-11-02T09:24:51.342 INFO:teuthology.orchestra.run.smithi186.stdout:(24/244): rbd-fuse-18.0.0-6872.g84d22000.el9.x8 1.0 MB/s | 85 kB 00:00 2023-11-02T09:24:51.442 INFO:teuthology.orchestra.run.smithi186.stdout:(25/244): rbd-nbd-18.0.0-6872.g84d22000.el9.x86 1.7 MB/s | 170 kB 00:00 2023-11-02T09:24:51.560 INFO:teuthology.orchestra.run.smithi186.stdout:(26/244): rbd-mirror-18.0.0-6872.g84d22000.el9. 12 MB/s | 3.0 MB 00:00 2023-11-02T09:24:51.584 INFO:teuthology.orchestra.run.smithi186.stdout:(27/244): ceph-grafana-dashboards-18.0.0-6872.g 163 kB/s | 23 kB 00:00 2023-11-02T09:24:51.626 INFO:teuthology.orchestra.run.smithi186.stdout:(28/244): ceph-mgr-cephadm-18.0.0-6872.g84d2200 1.9 MB/s | 132 kB 00:00 2023-11-02T09:24:51.844 INFO:teuthology.orchestra.run.smithi156.stdout:(1/244): ceph-18.0.0-6872.g84d22000.el9.x86_64. 20 kB/s | 6.5 kB 00:00 2023-11-02T09:24:52.118 INFO:teuthology.orchestra.run.smithi186.stdout:(29/244): ceph-mgr-dashboard-18.0.0-6872.g84d22 3.3 MB/s | 1.8 MB 00:00 2023-11-02T09:24:52.302 INFO:teuthology.orchestra.run.smithi186.stdout:(30/244): ceph-mgr-diskprediction-local-18.0.0- 11 MB/s | 7.4 MB 00:00 2023-11-02T09:24:52.327 INFO:teuthology.orchestra.run.smithi186.stdout:(31/244): ceph-mgr-modules-core-18.0.0-6872.g84 1.1 MB/s | 243 kB 00:00 2023-11-02T09:24:52.419 INFO:teuthology.orchestra.run.smithi186.stdout:(32/244): ceph-mgr-rook-18.0.0-6872.g84d22000.e 408 kB/s | 48 kB 00:00 2023-11-02T09:24:52.436 INFO:teuthology.orchestra.run.smithi186.stdout:(33/244): ceph-prometheus-alerts-18.0.0-6872.g8 139 kB/s | 15 kB 00:00 2023-11-02T09:24:52.495 INFO:teuthology.orchestra.run.smithi186.stdout:(34/244): ceph-volume-18.0.0-6872.g84d22000.el9 3.4 MB/s | 262 kB 00:00 2023-11-02T09:24:52.569 INFO:teuthology.orchestra.run.smithi156.stdout:(2/244): ceph-fuse-18.0.0-6872.g84d22000.el9.x8 1.2 MB/s | 856 kB 00:00 2023-11-02T09:24:52.603 INFO:teuthology.orchestra.run.smithi186.stdout:(35/244): cephadm-18.0.0-6872.g84d22000.el9.noa 1.6 MB/s | 270 kB 00:00 2023-11-02T09:24:52.637 INFO:teuthology.orchestra.run.smithi186.stdout:(36/244): adwaita-cursor-theme-40.1.1-3.el9.noa 4.3 MB/s | 625 kB 00:00 2023-11-02T09:24:52.696 INFO:teuthology.orchestra.run.smithi186.stdout:(37/244): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 1.5 MB/s | 86 kB 00:00 2023-11-02T09:24:52.711 INFO:teuthology.orchestra.run.smithi156.stdout:(3/244): ceph-immutable-object-cache-18.0.0-687 1.0 MB/s | 142 kB 00:00 2023-11-02T09:24:52.821 INFO:teuthology.orchestra.run.smithi186.stdout:(38/244): adwaita-icon-theme-40.1.1-3.el9.noarc 49 MB/s | 11 MB 00:00 2023-11-02T09:24:52.846 INFO:teuthology.orchestra.run.smithi186.stdout:(39/244): at-spi2-core-2.40.3-1.el9.x86_64.rpm 1.2 MB/s | 176 kB 00:00 2023-11-02T09:24:52.880 INFO:teuthology.orchestra.run.smithi186.stdout:(40/244): boost-program-options-1.75.0-8.el9.x8 3.1 MB/s | 106 kB 00:00 2023-11-02T09:24:52.905 INFO:teuthology.orchestra.run.smithi186.stdout:(41/244): atk-2.36.0-5.el9.x86_64.rpm 4.5 MB/s | 270 kB 00:00 2023-11-02T09:24:52.930 INFO:teuthology.orchestra.run.smithi186.stdout:(42/244): colord-libs-1.4.5-4.el9.x86_64.rpm 4.5 MB/s | 228 kB 00:00 2023-11-02T09:24:52.947 INFO:teuthology.orchestra.run.smithi186.stdout:(43/244): copy-jdk-configs-4.0-3.el9.noarch.rpm 656 kB/s | 27 kB 00:00 2023-11-02T09:24:52.973 INFO:teuthology.orchestra.run.smithi186.stdout:(44/244): dconf-0.40.0-6.el9.x86_64.rpm 2.5 MB/s | 108 kB 00:00 2023-11-02T09:24:52.998 INFO:teuthology.orchestra.run.smithi186.stdout:(45/244): exempi-2.6.0-0.2.20211007gite23c213.e 10 MB/s | 524 kB 00:00 2023-11-02T09:24:53.040 INFO:teuthology.orchestra.run.smithi186.stdout:(46/244): exiv2-libs-0.27.5-2.el9.x86_64.rpm 18 MB/s | 780 kB 00:00 2023-11-02T09:24:53.073 INFO:teuthology.orchestra.run.smithi186.stdout:(47/244): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 9.5 MB/s | 324 kB 00:00 2023-11-02T09:24:53.098 INFO:teuthology.orchestra.run.smithi186.stdout:(48/244): flexiblas-3.0.4-8.el9.x86_64.rpm 1.3 MB/s | 32 kB 00:00 2023-11-02T09:24:53.141 INFO:teuthology.orchestra.run.smithi186.stdout:(49/244): exiv2-0.27.5-2.el9.x86_64.rpm 5.7 MB/s | 978 kB 00:00 2023-11-02T09:24:53.191 INFO:teuthology.orchestra.run.smithi186.stdout:(50/244): flexiblas-netlib-3.0.4-8.el9.x86_64.r 33 MB/s | 3.0 MB 00:00 2023-11-02T09:24:53.216 INFO:teuthology.orchestra.run.smithi186.stdout:(51/244): flexiblas-openblas-openmp-3.0.4-8.el9 235 kB/s | 17 kB 00:00 2023-11-02T09:24:53.242 INFO:teuthology.orchestra.run.smithi186.stdout:(52/244): gdk-pixbuf2-modules-2.42.6-3.el9.x86_ 1.6 MB/s | 84 kB 00:00 2023-11-02T09:24:53.267 INFO:teuthology.orchestra.run.smithi186.stdout:(53/244): geoclue2-2.6.0-7.el9.x86_64.rpm 2.4 MB/s | 122 kB 00:00 2023-11-02T09:24:53.292 INFO:teuthology.orchestra.run.smithi186.stdout:(54/244): giflib-5.2.1-9.el9.x86_64.rpm 950 kB/s | 47 kB 00:00 2023-11-02T09:24:53.317 INFO:teuthology.orchestra.run.smithi186.stdout:(55/244): graphene-1.10.6-2.el9.x86_64.rpm 1.2 MB/s | 63 kB 00:00 2023-11-02T09:24:53.343 INFO:teuthology.orchestra.run.smithi186.stdout:(56/244): gsm-1.0.19-6.el9.x86_64.rpm 660 kB/s | 33 kB 00:00 2023-11-02T09:24:53.368 INFO:teuthology.orchestra.run.smithi186.stdout:(57/244): gtk-update-icon-cache-3.24.31-2.el9.x 682 kB/s | 34 kB 00:00 2023-11-02T09:24:53.410 INFO:teuthology.orchestra.run.smithi186.stdout:(58/244): hicolor-icon-theme-0.17-13.el9.noarch 1.6 MB/s | 65 kB 00:00 2023-11-02T09:24:53.469 INFO:teuthology.orchestra.run.smithi186.stdout:(59/244): gtk3-3.24.31-2.el9.x86_64.rpm 39 MB/s | 4.8 MB 00:00 2023-11-02T09:24:53.519 INFO:teuthology.orchestra.run.smithi186.stdout:(60/244): iso-codes-4.6.0-3.el9.noarch.rpm 30 MB/s | 3.3 MB 00:00 2023-11-02T09:24:53.553 INFO:teuthology.orchestra.run.smithi186.stdout:(61/244): java-11-openjdk-11.0.18.0.10-3.el9.x8 5.3 MB/s | 439 kB 00:00 2023-11-02T09:24:53.949 INFO:teuthology.orchestra.run.smithi186.stdout:(62/244): ceph-test-18.0.0-6872.g84d22000.el9.x 8.5 MB/s | 41 MB 00:04 2023-11-02T09:24:54.003 INFO:teuthology.orchestra.run.smithi186.stdout:(63/244): javapackages-filesystem-6.0.0-4.el9.n 23 kB/s | 10 kB 00:00 2023-11-02T09:24:54.068 INFO:teuthology.orchestra.run.smithi186.stdout:(64/244): jbigkit-libs-2.1-23.el9.x86_64.rpm 449 kB/s | 52 kB 00:00 2023-11-02T09:24:54.095 INFO:teuthology.orchestra.run.smithi156.stdout:(4/244): ceph-mds-18.0.0-6872.g84d22000.el9.x86 1.5 MB/s | 2.1 MB 00:01 2023-11-02T09:24:54.119 INFO:teuthology.orchestra.run.smithi186.stdout:(65/244): lcms2-2.12-3.el9.x86_64.rpm 1.5 MB/s | 166 kB 00:00 2023-11-02T09:24:54.169 INFO:teuthology.orchestra.run.smithi186.stdout:(66/244): libXcomposite-0.4.5-7.el9.x86_64.rpm 232 kB/s | 23 kB 00:00 2023-11-02T09:24:54.545 INFO:teuthology.orchestra.run.smithi186.stdout:(67/244): java-11-openjdk-headless-11.0.18.0.10 39 MB/s | 40 MB 00:01 2023-11-02T09:24:54.570 INFO:teuthology.orchestra.run.smithi186.stdout:(68/244): libXcursor-1.2.0-7.el9.x86_64.rpm 66 kB/s | 30 kB 00:00 2023-11-02T09:24:54.595 INFO:teuthology.orchestra.run.smithi186.stdout:(69/244): libXdamage-1.1.5-7.el9.x86_64.rpm 51 kB/s | 22 kB 00:00 2023-11-02T09:24:54.620 INFO:teuthology.orchestra.run.smithi186.stdout:(70/244): libXfixes-5.0.3-16.el9.x86_64.rpm 374 kB/s | 19 kB 00:00 2023-11-02T09:24:54.646 INFO:teuthology.orchestra.run.smithi186.stdout:(71/244): libXi-1.7.10-8.el9.x86_64.rpm 513 kB/s | 38 kB 00:00 2023-11-02T09:24:54.671 INFO:teuthology.orchestra.run.smithi186.stdout:(72/244): libXinerama-1.1.4-10.el9.x86_64.rpm 186 kB/s | 14 kB 00:00 2023-11-02T09:24:54.686 INFO:teuthology.orchestra.run.smithi156.stdout:(5/244): ceph-mgr-18.0.0-6872.g84d22000.el9.x86 2.5 MB/s | 1.5 MB 00:00 2023-11-02T09:24:54.696 INFO:teuthology.orchestra.run.smithi186.stdout:(73/244): libXtst-1.2.3-16.el9.x86_64.rpm 408 kB/s | 20 kB 00:00 2023-11-02T09:24:54.722 INFO:teuthology.orchestra.run.smithi186.stdout:(74/244): libXrandr-1.5.2-8.el9.x86_64.rpm 363 kB/s | 27 kB 00:00 2023-11-02T09:24:54.747 INFO:teuthology.orchestra.run.smithi186.stdout:(75/244): libXv-1.0.11-16.el9.x86_64.rpm 239 kB/s | 18 kB 00:00 2023-11-02T09:24:54.772 INFO:teuthology.orchestra.run.smithi186.stdout:(76/244): libXxf86vm-1.1.4-18.el9.x86_64.rpm 236 kB/s | 18 kB 00:00 2023-11-02T09:24:54.797 INFO:teuthology.orchestra.run.smithi186.stdout:(77/244): libasyncns-0.8-22.el9.x86_64.rpm 589 kB/s | 29 kB 00:00 2023-11-02T09:24:54.822 INFO:teuthology.orchestra.run.smithi186.stdout:(78/244): libepoxy-1.5.5-4.el9.x86_64.rpm 3.1 MB/s | 240 kB 00:00 2023-11-02T09:24:54.848 INFO:teuthology.orchestra.run.smithi186.stdout:(79/244): libexif-0.6.22-6.el9.x86_64.rpm 5.6 MB/s | 431 kB 00:00 2023-11-02T09:24:54.864 INFO:teuthology.orchestra.run.smithi186.stdout:(80/244): libfontenc-1.1.3-17.el9.x86_64.rpm 732 kB/s | 30 kB 00:00 2023-11-02T09:24:54.890 INFO:teuthology.orchestra.run.smithi186.stdout:(81/244): libgexiv2-0.12.3-1.el9.x86_64.rpm 1.2 MB/s | 82 kB 00:00 2023-11-02T09:24:54.915 INFO:teuthology.orchestra.run.smithi186.stdout:(82/244): libglvnd-1.3.4-1.el9.x86_64.rpm 2.0 MB/s | 134 kB 00:00 2023-11-02T09:24:54.940 INFO:teuthology.orchestra.run.smithi186.stdout:(83/244): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 2.8 MB/s | 141 kB 00:00 2023-11-02T09:24:54.957 INFO:teuthology.orchestra.run.smithi186.stdout:(84/244): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 533 kB/s | 36 kB 00:00 2023-11-02T09:24:54.982 INFO:teuthology.orchestra.run.smithi186.stdout:(85/244): libgsf-1.14.47-5.el9.x86_64.rpm 3.6 MB/s | 245 kB 00:00 2023-11-02T09:24:55.007 INFO:teuthology.orchestra.run.smithi186.stdout:(86/244): libgxps-0.3.2-3.el9.x86_64.rpm 1.1 MB/s | 78 kB 00:00 2023-11-02T09:24:55.024 INFO:teuthology.orchestra.run.smithi186.stdout:(87/244): libiptcdata-1.0.5-9.el9.x86_64.rpm 1.4 MB/s | 61 kB 00:00 2023-11-02T09:24:55.041 INFO:teuthology.orchestra.run.smithi186.stdout:(88/244): libldac-2.0.2.3-10.el9.x86_64.rpm 690 kB/s | 40 kB 00:00 2023-11-02T09:24:55.058 INFO:teuthology.orchestra.run.smithi186.stdout:(89/244): libnotify-0.7.9-8.el9.x86_64.rpm 847 kB/s | 43 kB 00:00 2023-11-02T09:24:55.075 INFO:teuthology.orchestra.run.smithi186.stdout:(90/244): libogg-1.3.4-6.el9.x86_64.rpm 974 kB/s | 32 kB 00:00 2023-11-02T09:24:55.100 INFO:teuthology.orchestra.run.smithi186.stdout:(91/244): libosinfo-1.10.0-1.el9.x86_64.rpm 5.2 MB/s | 312 kB 00:00 2023-11-02T09:24:55.126 INFO:teuthology.orchestra.run.smithi186.stdout:(92/244): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.3 MB/s | 159 kB 00:00 2023-11-02T09:24:55.142 INFO:teuthology.orchestra.run.smithi186.stdout:(93/244): libsbc-1.4-9.el9.x86_64.rpm 1.0 MB/s | 44 kB 00:00 2023-11-02T09:24:55.176 INFO:teuthology.orchestra.run.smithi186.stdout:(94/244): librdkafka-1.6.1-102.el9.x86_64.rpm 8.6 MB/s | 661 kB 00:00 2023-11-02T09:24:55.201 INFO:teuthology.orchestra.run.smithi186.stdout:(95/244): libsndfile-1.0.31-7.el9.x86_64.rpm 2.7 MB/s | 206 kB 00:00 2023-11-02T09:24:55.218 INFO:teuthology.orchestra.run.smithi186.stdout:(96/244): libtheora-1.1.1-31.el9.x86_64.rpm 2.1 MB/s | 163 kB 00:00 2023-11-02T09:24:55.235 INFO:teuthology.orchestra.run.smithi186.stdout:(97/244): libtool-ltdl-2.4.6-45.el9.x86_64.rpm 1.1 MB/s | 36 kB 00:00 2023-11-02T09:24:55.260 INFO:teuthology.orchestra.run.smithi186.stdout:(98/244): libtracker-sparql-3.1.2-3.el9.x86_64. 5.3 MB/s | 316 kB 00:00 2023-11-02T09:24:55.286 INFO:teuthology.orchestra.run.smithi186.stdout:(99/244): libvisual-0.4.0-34.el9.x86_64.rpm 2.1 MB/s | 143 kB 00:00 2023-11-02T09:24:55.311 INFO:teuthology.orchestra.run.smithi186.stdout:(100/244): libwayland-client-1.21.0-1.el9.x86_6 645 kB/s | 32 kB 00:00 2023-11-02T09:24:55.336 INFO:teuthology.orchestra.run.smithi186.stdout:(101/244): libvorbis-1.3.7-5.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2023-11-02T09:24:55.353 INFO:teuthology.orchestra.run.smithi186.stdout:(102/244): libwayland-cursor-1.21.0-1.el9.x86_6 272 kB/s | 18 kB 00:00 2023-11-02T09:24:55.370 INFO:teuthology.orchestra.run.smithi186.stdout:(103/244): libwayland-egl-1.21.0-1.el9.x86_64.r 202 kB/s | 12 kB 00:00 2023-11-02T09:24:55.387 INFO:teuthology.orchestra.run.smithi186.stdout:(104/244): libwayland-server-1.21.0-1.el9.x86_6 1.2 MB/s | 41 kB 00:00 2023-11-02T09:24:55.421 INFO:teuthology.orchestra.run.smithi186.stdout:(105/244): libxkbcommon-1.0.3-4.el9.x86_64.rpm 1.9 MB/s | 132 kB 00:00 2023-11-02T09:24:55.446 INFO:teuthology.orchestra.run.smithi186.stdout:(106/244): libxshmfence-1.3-10.el9.x86_64.rpm 154 kB/s | 12 kB 00:00 2023-11-02T09:24:55.471 INFO:teuthology.orchestra.run.smithi186.stdout:(107/244): low-memory-monitor-2.1-4.el9.x86_64. 696 kB/s | 35 kB 00:00 2023-11-02T09:24:55.497 INFO:teuthology.orchestra.run.smithi186.stdout:(108/244): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.7 MB/s | 282 kB 00:00 2023-11-02T09:24:55.522 INFO:teuthology.orchestra.run.smithi186.stdout:(109/244): lua-posix-35.0-8.el9.x86_64.rpm 1.7 MB/s | 131 kB 00:00 2023-11-02T09:24:55.547 INFO:teuthology.orchestra.run.smithi186.stdout:(110/244): mkfontscale-1.2.1-3.el9.x86_64.rpm 625 kB/s | 31 kB 00:00 2023-11-02T09:24:55.572 INFO:teuthology.orchestra.run.smithi186.stdout:(111/244): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.8 MB/s | 217 kB 00:00 2023-11-02T09:24:55.598 INFO:teuthology.orchestra.run.smithi186.stdout:(112/244): openblas-0.3.21-2.el9.x86_64.rpm 456 kB/s | 34 kB 00:00 2023-11-02T09:24:55.623 INFO:teuthology.orchestra.run.smithi186.stdout:(113/244): openjpeg2-2.4.0-7.el9.x86_64.rpm 3.2 MB/s | 162 kB 00:00 2023-11-02T09:24:55.637 INFO:teuthology.orchestra.run.smithi156.stdout:(6/244): ceph-base-18.0.0-6872.g84d22000.el9.x8 1.3 MB/s | 5.2 MB 00:04 2023-11-02T09:24:55.703 INFO:teuthology.orchestra.run.smithi156.stdout:(7/244): ceph-mon-18.0.0-6872.g84d22000.el9.x86 4.3 MB/s | 4.4 MB 00:01 2023-11-02T09:24:55.723 INFO:teuthology.orchestra.run.smithi186.stdout:(114/244): openblas-openmp-0.3.21-2.el9.x86_64. 32 MB/s | 4.7 MB 00:00 2023-11-02T09:24:55.748 INFO:teuthology.orchestra.run.smithi186.stdout:(115/244): opus-1.3.1-10.el9.x86_64.rpm 1.3 MB/s | 199 kB 00:00 2023-11-02T09:24:55.773 INFO:teuthology.orchestra.run.smithi186.stdout:(116/244): orc-0.4.31-6.el9.x86_64.rpm 1.2 MB/s | 183 kB 00:00 2023-11-02T09:24:55.798 INFO:teuthology.orchestra.run.smithi186.stdout:(117/244): osinfo-db-tools-1.10.0-1.el9.x86_64. 918 kB/s | 68 kB 00:00 2023-11-02T09:24:55.824 INFO:teuthology.orchestra.run.smithi186.stdout:(118/244): p11-kit-server-0.24.1-2.el9.x86_64.r 3.9 MB/s | 198 kB 00:00 2023-11-02T09:24:55.849 INFO:teuthology.orchestra.run.smithi186.stdout:(119/244): ostree-libs-2023.6-1.el9.x86_64.rpm 6.1 MB/s | 470 kB 00:00 2023-11-02T09:24:55.874 INFO:teuthology.orchestra.run.smithi186.stdout:(120/244): pipewire-0.3.67-2.el9.x86_64.rpm 1.1 MB/s | 86 kB 00:00 2023-11-02T09:24:55.879 INFO:teuthology.orchestra.run.smithi156.stdout:(8/244): ceph-common-18.0.0-6872.g84d22000.el9. 4.4 MB/s | 19 MB 00:04 2023-11-02T09:24:55.899 INFO:teuthology.orchestra.run.smithi186.stdout:(121/244): pipewire-alsa-0.3.67-2.el9.x86_64.rp 734 kB/s | 55 kB 00:00 2023-11-02T09:24:55.925 INFO:teuthology.orchestra.run.smithi186.stdout:(122/244): pipewire-jack-audio-connection-kit-0 2.5 MB/s | 126 kB 00:00 2023-11-02T09:24:55.954 INFO:teuthology.orchestra.run.smithi156.stdout:(9/244): ceph-selinux-18.0.0-6872.g84d22000.el9 323 kB/s | 24 kB 00:00 2023-11-02T09:24:55.967 INFO:teuthology.orchestra.run.smithi186.stdout:(123/244): pipewire-libs-0.3.67-2.el9.x86_64.rp 19 MB/s | 1.7 MB 00:00 2023-11-02T09:24:55.992 INFO:teuthology.orchestra.run.smithi186.stdout:(124/244): pipewire-pulseaudio-0.3.67-2.el9.x86 197 kB/s | 18 kB 00:00 2023-11-02T09:24:56.025 INFO:teuthology.orchestra.run.smithi186.stdout:(125/244): poppler-21.01.0-19.el9.x86_64.rpm 11 MB/s | 1.1 MB 00:00 2023-11-02T09:24:56.044 INFO:teuthology.orchestra.run.smithi186.stdout:(126/244): poppler-glib-21.01.0-19.el9.x86_64.r 3.0 MB/s | 151 kB 00:00 2023-11-02T09:24:56.086 INFO:teuthology.orchestra.run.smithi186.stdout:(127/244): poppler-data-0.4.9-9.el9.noarch.rpm 20 MB/s | 1.8 MB 00:00 2023-11-02T09:24:56.112 INFO:teuthology.orchestra.run.smithi186.stdout:(128/244): pulseaudio-libs-15.0-2.el9.x86_64.rp 7.6 MB/s | 666 kB 00:00 2023-11-02T09:24:56.137 INFO:teuthology.orchestra.run.smithi186.stdout:(129/244): pulseaudio-utils-15.0-2.el9.x86_64.r 798 kB/s | 72 kB 00:00 2023-11-02T09:24:56.254 INFO:teuthology.orchestra.run.smithi186.stdout:(130/244): python3-babel-2.9.1-2.el9.noarch.rpm 35 MB/s | 5.8 MB 00:00 2023-11-02T09:24:56.280 INFO:teuthology.orchestra.run.smithi186.stdout:(131/244): python3-jinja2-2.11.3-4.el9.noarch.r 1.6 MB/s | 228 kB 00:00 2023-11-02T09:24:56.304 INFO:teuthology.orchestra.run.smithi186.stdout:(132/244): python3-devel-3.9.17-2.el9.x86_64.rp 1.2 MB/s | 205 kB 00:00 2023-11-02T09:24:56.321 INFO:teuthology.orchestra.run.smithi186.stdout:(133/244): python3-jsonpatch-1.21-16.el9.noarch 366 kB/s | 24 kB 00:00 2023-11-02T09:24:56.338 INFO:teuthology.orchestra.run.smithi186.stdout:(134/244): python3-jsonpointer-2.0-4.el9.noarch 310 kB/s | 18 kB 00:00 2023-11-02T09:24:56.355 INFO:teuthology.orchestra.run.smithi186.stdout:(135/244): python3-markupsafe-1.1.1-12.el9.x86_ 953 kB/s | 32 kB 00:00 2023-11-02T09:24:56.381 INFO:teuthology.orchestra.run.smithi186.stdout:(136/244): python3-mako-1.1.4-6.el9.noarch.rpm 2.4 MB/s | 144 kB 00:00 2023-11-02T09:24:56.481 INFO:teuthology.orchestra.run.smithi186.stdout:(137/244): python3-numpy-1.20.1-5.el9.x86_64.rp 34 MB/s | 4.8 MB 00:00 2023-11-02T09:24:56.506 INFO:teuthology.orchestra.run.smithi186.stdout:(138/244): python3-numpy-f2py-1.20.1-5.el9.x86_ 1.4 MB/s | 217 kB 00:00 2023-11-02T09:24:56.531 INFO:teuthology.orchestra.run.smithi186.stdout:(139/244): python3-oauthlib-3.1.1-5.el9.noarch. 1.2 MB/s | 174 kB 00:00 2023-11-02T09:24:56.556 INFO:teuthology.orchestra.run.smithi186.stdout:(140/244): python3-prettytable-0.7.2-27.el9.noa 551 kB/s | 41 kB 00:00 2023-11-02T09:24:56.582 INFO:teuthology.orchestra.run.smithi186.stdout:(141/244): python3-pyasn1-0.4.8-6.el9.noarch.rp 2.6 MB/s | 132 kB 00:00 2023-11-02T09:24:56.607 INFO:teuthology.orchestra.run.smithi186.stdout:(142/244): python3-pyasn1-modules-0.4.8-6.el9.n 2.7 MB/s | 211 kB 00:00 2023-11-02T09:24:56.632 INFO:teuthology.orchestra.run.smithi186.stdout:(143/244): python3-requests-oauthlib-1.3.0-12.e 574 kB/s | 43 kB 00:00 2023-11-02T09:24:56.658 INFO:teuthology.orchestra.run.smithi186.stdout:(144/244): python3-toml-0.10.2-6.el9.noarch.rpm 776 kB/s | 39 kB 00:00 2023-11-02T09:24:56.916 INFO:teuthology.orchestra.run.smithi186.stdout:(145/244): python3-scipy-1.6.2-8.el9.x86_64.rpm 51 MB/s | 16 MB 00:00 2023-11-02T09:24:56.941 INFO:teuthology.orchestra.run.smithi186.stdout:(146/244): rtkit-0.11-28.el9.x86_64.rpm 177 kB/s | 55 kB 00:00 2023-11-02T09:24:56.966 INFO:teuthology.orchestra.run.smithi186.stdout:(147/244): socat-1.7.4.1-5.el9.x86_64.rpm 980 kB/s | 300 kB 00:00 2023-11-02T09:24:57.000 INFO:teuthology.orchestra.run.smithi186.stdout:(148/244): sound-theme-freedesktop-0.8-17.el9.n 4.4 MB/s | 377 kB 00:00 2023-11-02T09:24:57.025 INFO:teuthology.orchestra.run.smithi186.stdout:(149/244): totem-pl-parser-3.26.6-2.el9.x86_64. 2.2 MB/s | 130 kB 00:00 2023-11-02T09:24:57.050 INFO:teuthology.orchestra.run.smithi186.stdout:(150/244): tracker-3.1.2-3.el9.x86_64.rpm 6.3 MB/s | 537 kB 00:00 2023-11-02T09:24:57.084 INFO:teuthology.orchestra.run.smithi186.stdout:(151/244): tracker-miners-3.1.2-3.el9.x86_64.rp 11 MB/s | 887 kB 00:00 2023-11-02T09:24:57.101 INFO:teuthology.orchestra.run.smithi186.stdout:(152/244): ttmkfdir-3.0.9-65.el9.x86_64.rpm 1.0 MB/s | 52 kB 00:00 2023-11-02T09:24:57.126 INFO:teuthology.orchestra.run.smithi186.stdout:(153/244): tzdata-java-2023c-1.el9.noarch.rpm 2.0 MB/s | 149 kB 00:00 2023-11-02T09:24:57.151 INFO:teuthology.orchestra.run.smithi186.stdout:(154/244): upower-0.99.11-11.el9.x86_64.rpm 2.5 MB/s | 168 kB 00:00 2023-11-02T09:24:57.168 INFO:teuthology.orchestra.run.smithi186.stdout:(155/244): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 1.0 MB/s | 41 kB 00:00 2023-11-02T09:24:57.194 INFO:teuthology.orchestra.run.smithi186.stdout:(156/244): webrtc-audio-processing-0.3.1-8.el9. 4.5 MB/s | 305 kB 00:00 2023-11-02T09:24:57.219 INFO:teuthology.orchestra.run.smithi186.stdout:(157/244): xdg-desktop-portal-1.12.4-1.el9.x86_ 5.3 MB/s | 365 kB 00:00 2023-11-02T09:24:57.244 INFO:teuthology.orchestra.run.smithi186.stdout:(158/244): xdg-desktop-portal-gtk-1.12.0-3.el9. 1.7 MB/s | 130 kB 00:00 2023-11-02T09:24:57.261 INFO:teuthology.orchestra.run.smithi186.stdout:(159/244): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 63 kB 00:00 2023-11-02T09:24:57.303 INFO:teuthology.orchestra.run.smithi186.stdout:(160/244): xkeyboard-config-2.33-2.el9.noarch.r 9.1 MB/s | 780 kB 00:00 2023-11-02T09:24:57.328 INFO:teuthology.orchestra.run.smithi186.stdout:(161/244): xorg-x11-fonts-Type1-7.5-33.el9.noar 5.9 MB/s | 499 kB 00:00 2023-11-02T09:24:57.353 INFO:teuthology.orchestra.run.smithi186.stdout:(162/244): ModemManager-glib-1.20.2-1.el9.x86_6 3.6 MB/s | 334 kB 00:00 2023-11-02T09:24:57.370 INFO:teuthology.orchestra.run.smithi186.stdout:(163/244): bubblewrap-0.4.1-6.el9.x86_64.rpm 1.2 MB/s | 49 kB 00:00 2023-11-02T09:24:57.396 INFO:teuthology.orchestra.run.smithi186.stdout:(164/244): bluez-libs-5.64-1.el9.x86_64.rpm 1.2 MB/s | 83 kB 00:00 2023-11-02T09:24:57.396 INFO:teuthology.orchestra.run.smithi156.stdout:(10/244): ceph-radosgw-18.0.0-6872.g84d22000.el 5.1 MB/s | 8.7 MB 00:01 2023-11-02T09:24:57.421 INFO:teuthology.orchestra.run.smithi186.stdout:(165/244): cups-libs-2.3.3op2-21.el9.x86_64.rpm 3.8 MB/s | 262 kB 00:00 2023-11-02T09:24:57.446 INFO:teuthology.orchestra.run.smithi186.stdout:(166/244): fuse-2.9.9-15.el9.x86_64.rpm 1.0 MB/s | 79 kB 00:00 2023-11-02T09:24:57.462 INFO:teuthology.orchestra.run.smithi156.stdout:(11/244): libcephfs-devel-18.0.0-6872.g84d22000 468 kB/s | 31 kB 00:00 2023-11-02T09:24:57.463 INFO:teuthology.orchestra.run.smithi186.stdout:(167/244): libpciaccess-0.16-6.el9.x86_64.rpm 642 kB/s | 27 kB 00:00 2023-11-02T09:24:57.497 INFO:teuthology.orchestra.run.smithi186.stdout:(168/244): libgfortran-11.4.1-2.3.el9.x86_64.rp 10 MB/s | 803 kB 00:00 2023-11-02T09:24:57.547 INFO:teuthology.orchestra.run.smithi186.stdout:(169/244): libquadmath-11.4.1-2.3.el9.x86_64.rp 1.9 MB/s | 195 kB 00:00 2023-11-02T09:24:57.572 INFO:teuthology.orchestra.run.smithi186.stdout:(170/244): lksctp-tools-1.0.19-2.el9.x86_64.rpm 838 kB/s | 90 kB 00:00 2023-11-02T09:24:57.589 INFO:teuthology.orchestra.run.smithi186.stdout:(171/244): python3-ply-3.11-14.el9.noarch.rpm 2.4 MB/s | 103 kB 00:00 2023-11-02T09:24:57.605 INFO:teuthology.orchestra.run.smithi156.stdout:(12/244): libcephfs2-18.0.0-6872.g84d22000.el9. 4.9 MB/s | 716 kB 00:00 2023-11-02T09:24:57.614 INFO:teuthology.orchestra.run.smithi186.stdout:(172/244): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.5 MB/s | 241 kB 00:00 2023-11-02T09:24:57.640 INFO:teuthology.orchestra.run.smithi186.stdout:(173/244): python3-pycparser-2.20-6.el9.noarch. 1.8 MB/s | 124 kB 00:00 2023-11-02T09:24:57.665 INFO:teuthology.orchestra.run.smithi186.stdout:(174/244): python3-requests-2.25.1-7.el9.noarch 1.5 MB/s | 113 kB 00:00 2023-11-02T09:24:57.671 INFO:teuthology.orchestra.run.smithi156.stdout:(13/244): libcephsqlite-18.0.0-6872.g84d22000.e 2.4 MB/s | 164 kB 00:00 2023-11-02T09:24:57.690 INFO:teuthology.orchestra.run.smithi186.stdout:(175/244): python3-urllib3-1.26.5-4.el9.noarch. 3.7 MB/s | 187 kB 00:00 2023-11-02T09:24:57.730 INFO:teuthology.orchestra.run.smithi156.stdout:(14/244): librados-devel-18.0.0-6872.g84d22000. 2.1 MB/s | 127 kB 00:00 2023-11-02T09:24:57.774 INFO:teuthology.orchestra.run.smithi186.stdout:(176/244): avahi-glib-0.8-12.el9.x86_64.rpm 178 kB/s | 15 kB 00:00 2023-11-02T09:24:57.847 INFO:teuthology.orchestra.run.smithi156.stdout:(15/244): libradosstriper1-18.0.0-6872.g84d2200 4.0 MB/s | 473 kB 00:00 2023-11-02T09:24:57.874 INFO:teuthology.orchestra.run.smithi186.stdout:(177/244): alsa-lib-1.2.9-1.el9.x86_64.rpm 2.4 MB/s | 518 kB 00:00 2023-11-02T09:24:57.899 INFO:teuthology.orchestra.run.smithi186.stdout:(178/244): flac-libs-1.3.3-12.el9.x86_64.rpm 1.7 MB/s | 218 kB 00:00 2023-11-02T09:24:57.958 INFO:teuthology.orchestra.run.smithi186.stdout:(179/244): flatpak-selinux-1.12.8-1.el9.noarch. 367 kB/s | 21 kB 00:00 2023-11-02T09:24:58.025 INFO:teuthology.orchestra.run.smithi186.stdout:(180/244): flatpak-session-helper-1.12.8-1.el9. 1.1 MB/s | 74 kB 00:00 2023-11-02T09:24:58.109 INFO:teuthology.orchestra.run.smithi186.stdout:(181/244): flatpak-1.12.8-1.el9.x86_64.rpm 7.3 MB/s | 1.7 MB 00:00 2023-11-02T09:24:58.292 INFO:teuthology.orchestra.run.smithi186.stdout:(182/244): gstreamer1-1.22.1-2.el9.x86_64.rpm 5.4 MB/s | 1.4 MB 00:00 2023-11-02T09:24:58.351 INFO:teuthology.orchestra.run.smithi186.stdout:(183/244): jq-1.6-15.el9.x86_64.rpm 3.1 MB/s | 187 kB 00:00 2023-11-02T09:24:58.401 INFO:teuthology.orchestra.run.smithi186.stdout:(184/244): libX11-xcb-1.7.0-8.el9.x86_64.rpm 218 kB/s | 11 kB 00:00 2023-11-02T09:24:58.443 INFO:teuthology.orchestra.run.smithi186.stdout:(185/244): libcanberra-0.30-27.el9.x86_64.rpm 2.0 MB/s | 86 kB 00:00 2023-11-02T09:24:58.502 INFO:teuthology.orchestra.run.smithi186.stdout:(186/244): libcanberra-gtk3-0.30-27.el9.x86_64. 545 kB/s | 32 kB 00:00 2023-11-02T09:24:58.560 INFO:teuthology.orchestra.run.smithi186.stdout:(187/244): libdrm-2.4.115-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2023-11-02T09:24:58.602 INFO:teuthology.orchestra.run.smithi186.stdout:(188/244): gstreamer1-plugins-base-1.22.1-1.el9 4.5 MB/s | 2.2 MB 00:00 2023-11-02T09:24:58.644 INFO:teuthology.orchestra.run.smithi186.stdout:(189/244): librabbitmq-0.11.0-7.el9.x86_64.rpm 542 kB/s | 45 kB 00:00 2023-11-02T09:24:58.682 INFO:teuthology.orchestra.run.smithi156.stdout:(16/244): librgw2-18.0.0-6872.g84d22000.el9.x86 5.7 MB/s | 4.8 MB 00:00 2023-11-02T09:24:58.756 INFO:teuthology.orchestra.run.smithi156.stdout:(17/244): python3-ceph-argparse-18.0.0-6872.g84 619 kB/s | 45 kB 00:00 2023-11-02T09:24:58.794 INFO:teuthology.orchestra.run.smithi186.stdout:(190/244): libtiff-4.4.0-10.el9.x86_64.rpm 1.0 MB/s | 197 kB 00:00 2023-11-02T09:24:58.814 INFO:teuthology.orchestra.run.smithi156.stdout:(18/244): python3-ceph-common-18.0.0-6872.g84d2 2.1 MB/s | 127 kB 00:00 2023-11-02T09:24:58.828 INFO:teuthology.orchestra.run.smithi186.stdout:(191/244): libwebp-1.2.0-8.el9.x86_64.rpm 1.5 MB/s | 277 kB 00:00 2023-11-02T09:24:58.853 INFO:teuthology.orchestra.run.smithi186.stdout:(192/244): lua-5.4.4-4.el9.x86_64.rpm 3.1 MB/s | 188 kB 00:00 2023-11-02T09:24:58.873 INFO:teuthology.orchestra.run.smithi156.stdout:(19/244): python3-cephfs-18.0.0-6872.g84d22000. 2.7 MB/s | 162 kB 00:00 2023-11-02T09:24:58.879 INFO:teuthology.orchestra.run.smithi186.stdout:(193/244): mesa-libEGL-23.1.4-1.el9.x86_64.rpm 2.4 MB/s | 125 kB 00:00 2023-11-02T09:24:58.904 INFO:teuthology.orchestra.run.smithi186.stdout:(194/244): mesa-libGL-23.1.4-1.el9.x86_64.rpm 3.2 MB/s | 166 kB 00:00 2023-11-02T09:24:58.929 INFO:teuthology.orchestra.run.smithi186.stdout:(195/244): mesa-libgbm-23.1.4-1.el9.x86_64.rpm 747 kB/s | 38 kB 00:00 2023-11-02T09:24:58.955 INFO:teuthology.orchestra.run.smithi186.stdout:(196/244): mesa-libglapi-23.1.4-1.el9.x86_64.rp 930 kB/s | 47 kB 00:00 2023-11-02T09:24:58.982 INFO:teuthology.orchestra.run.smithi156.stdout:(20/244): python3-rados-18.0.0-6872.g84d22000.e 2.9 MB/s | 320 kB 00:00 2023-11-02T09:24:59.005 INFO:teuthology.orchestra.run.smithi186.stdout:(197/244): osinfo-db-20230518-1.el9.noarch.rpm 9.9 MB/s | 503 kB 00:00 2023-11-02T09:24:59.056 INFO:teuthology.orchestra.run.smithi186.stdout:(198/244): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2023-11-02T09:24:59.065 INFO:teuthology.orchestra.run.smithi156.stdout:(21/244): python3-rbd-18.0.0-6872.g84d22000.el9 3.5 MB/s | 298 kB 00:00 2023-11-02T09:24:59.122 INFO:teuthology.orchestra.run.smithi186.stdout:(199/244): vulkan-loader-1.3.250.1-1.el9.x86_64 2.1 MB/s | 141 kB 00:00 2023-11-02T09:24:59.132 INFO:teuthology.orchestra.run.smithi156.stdout:(22/244): python3-rgw-18.0.0-6872.g84d22000.el9 1.5 MB/s | 99 kB 00:00 2023-11-02T09:24:59.172 INFO:teuthology.orchestra.run.smithi186.stdout:(200/244): wireplumber-0.4.14-1.el9.x86_64.rpm 1.9 MB/s | 96 kB 00:00 2023-11-02T09:24:59.207 INFO:teuthology.orchestra.run.smithi156.stdout:(23/244): rbd-fuse-18.0.0-6872.g84d22000.el9.x8 1.1 MB/s | 85 kB 00:00 2023-11-02T09:24:59.298 INFO:teuthology.orchestra.run.smithi186.stdout:(201/244): wireplumber-libs-0.4.14-1.el9.x86_64 2.8 MB/s | 358 kB 00:00 2023-11-02T09:24:59.498 INFO:teuthology.orchestra.run.smithi186.stdout:(202/244): fmt-8.1.1-5.el9.x86_64.rpm 554 kB/s | 111 kB 00:00 2023-11-02T09:24:59.615 INFO:teuthology.orchestra.run.smithi186.stdout:(203/244): gperftools-libs-2.9.1-2.el9.x86_64.r 2.6 MB/s | 309 kB 00:00 2023-11-02T09:24:59.807 INFO:teuthology.orchestra.run.smithi156.stdout:(24/244): rbd-mirror-18.0.0-6872.g84d22000.el9. 5.0 MB/s | 3.0 MB 00:00 2023-11-02T09:24:59.832 INFO:teuthology.orchestra.run.smithi186.stdout:(204/244): libarrow-9.0.0-9.el9.x86_64.rpm 20 MB/s | 4.4 MB 00:00 2023-11-02T09:24:59.874 INFO:teuthology.orchestra.run.smithi186.stdout:(205/244): python3-cryptography-36.0.1-4.el9.x8 562 kB/s | 1.2 MB 00:02 2023-11-02T09:24:59.875 INFO:teuthology.orchestra.run.smithi156.stdout:(25/244): rbd-nbd-18.0.0-6872.g84d22000.el9.x86 2.5 MB/s | 170 kB 00:00 2023-11-02T09:24:59.899 INFO:teuthology.orchestra.run.smithi186.stdout:(206/244): libarrow-doc-9.0.0-9.el9.noarch.rpm 365 kB/s | 24 kB 00:00 2023-11-02T09:24:59.933 INFO:teuthology.orchestra.run.smithi156.stdout:(26/244): ceph-grafana-dashboards-18.0.0-6872.g 399 kB/s | 23 kB 00:00 2023-11-02T09:24:59.958 INFO:teuthology.orchestra.run.smithi186.stdout:(207/244): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2023-11-02T09:24:59.992 INFO:teuthology.orchestra.run.smithi156.stdout:(27/244): ceph-mgr-cephadm-18.0.0-6872.g84d2200 2.2 MB/s | 132 kB 00:00 2023-11-02T09:25:00.050 INFO:teuthology.orchestra.run.smithi186.stdout:(208/244): liboath-2.6.7-2.el9.x86_64.rpm 277 kB/s | 49 kB 00:00 2023-11-02T09:25:00.083 INFO:teuthology.orchestra.run.smithi186.stdout:(209/244): parquet-libs-9.0.0-9.el9.x86_64.rpm 6.5 MB/s | 837 kB 00:00 2023-11-02T09:25:00.142 INFO:teuthology.orchestra.run.smithi186.stdout:(210/244): python3-bcrypt-3.2.2-1.el9.x86_64.rp 744 kB/s | 43 kB 00:00 2023-11-02T09:25:00.217 INFO:teuthology.orchestra.run.smithi186.stdout:(211/244): python3-cachetools-4.2.4-1.el9.noarc 430 kB/s | 32 kB 00:00 2023-11-02T09:25:00.251 INFO:teuthology.orchestra.run.smithi186.stdout:(212/244): python3-asyncssh-2.13.2-3.el9.noarch 2.7 MB/s | 548 kB 00:00 2023-11-02T09:25:00.285 INFO:teuthology.orchestra.run.smithi186.stdout:(213/244): python3-certifi-2021.10.8-2.el9.noar 224 kB/s | 15 kB 00:00 2023-11-02T09:25:00.318 INFO:teuthology.orchestra.run.smithi186.stdout:(214/244): python3-cheroot-8.6.0-4.el9.noarch.r 2.5 MB/s | 172 kB 00:00 2023-11-02T09:25:00.352 INFO:teuthology.orchestra.run.smithi186.stdout:(215/244): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2023-11-02T09:25:00.402 INFO:teuthology.orchestra.run.smithi186.stdout:(216/244): python3-google-auth-2.23.3-1.el9.noa 2.3 MB/s | 197 kB 00:00 2023-11-02T09:25:00.427 INFO:teuthology.orchestra.run.smithi186.stdout:(217/244): python3-jaraco-8.2.1-3.el9.noarch.rp 142 kB/s | 11 kB 00:00 2023-11-02T09:25:00.451 INFO:teuthology.orchestra.run.smithi156.stdout:(28/244): ceph-test-18.0.0-6872.g84d22000.el9.x 9.1 MB/s | 41 MB 00:04 2023-11-02T09:25:00.461 INFO:teuthology.orchestra.run.smithi186.stdout:(218/244): python3-jaraco-classes-3.2.1-5.el9.n 302 kB/s | 18 kB 00:00 2023-11-02T09:25:00.487 INFO:teuthology.orchestra.run.smithi186.stdout:(219/244): python3-jaraco-collections-3.0.0-8.e 395 kB/s | 23 kB 00:00 2023-11-02T09:25:00.493 INFO:teuthology.orchestra.run.smithi156.stdout:(29/244): ceph-mgr-dashboard-18.0.0-6872.g84d22 3.5 MB/s | 1.8 MB 00:00 2023-11-02T09:25:00.520 INFO:teuthology.orchestra.run.smithi186.stdout:(220/244): python3-jaraco-functools-3.5.0-2.el9 332 kB/s | 19 kB 00:00 2023-11-02T09:25:00.545 INFO:teuthology.orchestra.run.smithi186.stdout:(221/244): python3-jaraco-text-3.2.0-6.el9.noar 336 kB/s | 20 kB 00:00 2023-11-02T09:25:00.559 INFO:teuthology.orchestra.run.smithi156.stdout:(30/244): ceph-mgr-modules-core-18.0.0-6872.g84 3.6 MB/s | 243 kB 00:00 2023-11-02T09:25:00.581 INFO:teuthology.orchestra.run.smithi186.stdout:(222/244): python3-jwt+crypto-2.4.0-1.el9.noarc 149 kB/s | 9.0 kB 00:00 2023-11-02T09:25:00.606 INFO:teuthology.orchestra.run.smithi186.stdout:(223/244): python3-jwt-2.4.0-1.el9.noarch.rpm 672 kB/s | 41 kB 00:00 2023-11-02T09:25:00.618 INFO:teuthology.orchestra.run.smithi156.stdout:(31/244): ceph-mgr-rook-18.0.0-6872.g84d22000.e 821 kB/s | 48 kB 00:00 2023-11-02T09:25:00.673 INFO:teuthology.orchestra.run.smithi186.stdout:(224/244): python3-kubernetes-26.1.0-2.el9.noar 11 MB/s | 1.0 MB 00:00 2023-11-02T09:25:00.676 INFO:teuthology.orchestra.run.smithi156.stdout:(32/244): ceph-prometheus-alerts-18.0.0-6872.g8 259 kB/s | 15 kB 00:00 2023-11-02T09:25:00.698 INFO:teuthology.orchestra.run.smithi186.stdout:(225/244): python3-logutils-0.3.5-21.el9.noarch 504 kB/s | 46 kB 00:00 2023-11-02T09:25:00.746 INFO:teuthology.orchestra.run.smithi156.stdout:(33/244): ceph-volume-18.0.0-6872.g84d22000.el9 3.7 MB/s | 262 kB 00:00 2023-11-02T09:25:00.791 INFO:teuthology.orchestra.run.smithi186.stdout:(226/244): mesa-vulkan-drivers-23.1.4-1.el9.x86 5.0 MB/s | 9.2 MB 00:01 2023-11-02T09:25:00.813 INFO:teuthology.orchestra.run.smithi156.stdout:(34/244): cephadm-18.0.0-6872.g84d22000.el9.noa 4.0 MB/s | 270 kB 00:00 2023-11-02T09:25:00.816 INFO:teuthology.orchestra.run.smithi186.stdout:(227/244): python3-natsort-7.1.1-5.el9.noarch.r 493 kB/s | 58 kB 00:00 2023-11-02T09:25:00.841 INFO:teuthology.orchestra.run.smithi186.stdout:(228/244): python3-more-itertools-8.12.0-2.el9. 471 kB/s | 79 kB 00:00 2023-11-02T09:25:00.875 INFO:teuthology.orchestra.run.smithi186.stdout:(229/244): python3-portend-3.1.0-2.el9.noarch.r 279 kB/s | 16 kB 00:00 2023-11-02T09:25:00.908 INFO:teuthology.orchestra.run.smithi186.stdout:(230/244): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2023-11-02T09:25:00.930 INFO:teuthology.orchestra.run.smithi156.stdout:(35/244): adwaita-cursor-theme-40.1.1-3.el9.noa 5.2 MB/s | 625 kB 00:00 2023-11-02T09:25:00.933 INFO:teuthology.orchestra.run.smithi186.stdout:(231/244): python3-repoze-lru-0.7-16.el9.noarch 527 kB/s | 31 kB 00:00 2023-11-02T09:25:01.009 INFO:teuthology.orchestra.run.smithi186.stdout:(232/244): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2023-11-02T09:25:01.034 INFO:teuthology.orchestra.run.smithi186.stdout:(233/244): python3-rsa-4.9-2.el9.noarch.rpm 589 kB/s | 59 kB 00:00 2023-11-02T09:25:01.060 INFO:teuthology.orchestra.run.smithi186.stdout:(234/244): python3-pecan-1.4.2-3.el9.noarch.rpm 1.0 MB/s | 272 kB 00:00 2023-11-02T09:25:01.085 INFO:teuthology.orchestra.run.smithi186.stdout:(235/244): python3-tempora-5.0.0-2.el9.noarch.r 474 kB/s | 36 kB 00:00 2023-11-02T09:25:01.097 INFO:teuthology.orchestra.run.smithi156.stdout:(36/244): adwaita-icon-theme-40.1.1-3.el9.noarc 64 MB/s | 11 MB 00:00 2023-11-02T09:25:01.127 INFO:teuthology.orchestra.run.smithi186.stdout:(236/244): python3-typing-extensions-4.4.0-2.el 554 kB/s | 51 kB 00:00 2023-11-02T09:25:01.152 INFO:teuthology.orchestra.run.smithi186.stdout:(237/244): python3-webob-1.8.7-6.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2023-11-02T09:25:01.177 INFO:teuthology.orchestra.run.smithi186.stdout:(238/244): python3-websocket-client-1.2.3-2.el9 972 kB/s | 90 kB 00:00 2023-11-02T09:25:01.189 INFO:teuthology.orchestra.run.smithi156.stdout:(37/244): ceph-mgr-diskprediction-local-18.0.0- 10 MB/s | 7.4 MB 00:00 2023-11-02T09:25:01.202 INFO:teuthology.orchestra.run.smithi186.stdout:(239/244): python3-werkzeug-2.0.3-3.el9.1.noarc 5.5 MB/s | 427 kB 00:00 2023-11-02T09:25:01.214 INFO:teuthology.orchestra.run.smithi156.stdout:(38/244): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 732 kB/s | 86 kB 00:00 2023-11-02T09:25:01.228 INFO:teuthology.orchestra.run.smithi186.stdout:(240/244): python3-zc-lockfile-2.0-10.el9.noarc 265 kB/s | 20 kB 00:00 2023-11-02T09:25:01.240 INFO:teuthology.orchestra.run.smithi156.stdout:(39/244): at-spi2-core-2.40.3-1.el9.x86_64.rpm 3.5 MB/s | 176 kB 00:00 2023-11-02T09:25:01.262 INFO:teuthology.orchestra.run.smithi186.stdout:(241/244): re2-20211101-3.el9.x86_64.rpm 2.2 MB/s | 192 kB 00:00 2023-11-02T09:25:01.265 INFO:teuthology.orchestra.run.smithi156.stdout:(40/244): atk-2.36.0-5.el9.x86_64.rpm 5.3 MB/s | 270 kB 00:00 2023-11-02T09:25:01.290 INFO:teuthology.orchestra.run.smithi156.stdout:(41/244): boost-program-options-1.75.0-8.el9.x8 2.1 MB/s | 106 kB 00:00 2023-11-02T09:25:01.316 INFO:teuthology.orchestra.run.smithi156.stdout:(42/244): colord-libs-1.4.5-4.el9.x86_64.rpm 4.5 MB/s | 228 kB 00:00 2023-11-02T09:25:01.341 INFO:teuthology.orchestra.run.smithi156.stdout:(43/244): copy-jdk-configs-4.0-3.el9.noarch.rpm 543 kB/s | 27 kB 00:00 2023-11-02T09:25:01.358 INFO:teuthology.orchestra.run.smithi156.stdout:(44/244): dconf-0.40.0-6.el9.x86_64.rpm 2.5 MB/s | 108 kB 00:00 2023-11-02T09:25:01.362 INFO:teuthology.orchestra.run.smithi186.stdout:(242/244): thrift-0.15.0-2.el9.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2023-11-02T09:25:01.391 INFO:teuthology.orchestra.run.smithi156.stdout:(45/244): exempi-2.6.0-0.2.20211007gite23c213.e 10 MB/s | 524 kB 00:00 2023-11-02T09:25:01.425 INFO:teuthology.orchestra.run.smithi156.stdout:(46/244): exiv2-0.27.5-2.el9.x86_64.rpm 15 MB/s | 978 kB 00:00 2023-11-02T09:25:01.459 INFO:teuthology.orchestra.run.smithi156.stdout:(47/244): exiv2-libs-0.27.5-2.el9.x86_64.rpm 12 MB/s | 780 kB 00:00 2023-11-02T09:25:01.484 INFO:teuthology.orchestra.run.smithi156.stdout:(48/244): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 5.6 MB/s | 324 kB 00:00 2023-11-02T09:25:01.509 INFO:teuthology.orchestra.run.smithi156.stdout:(49/244): flexiblas-3.0.4-8.el9.x86_64.rpm 639 kB/s | 32 kB 00:00 2023-11-02T09:25:01.576 INFO:teuthology.orchestra.run.smithi156.stdout:(50/244): flexiblas-netlib-3.0.4-8.el9.x86_64.r 33 MB/s | 3.0 MB 00:00 2023-11-02T09:25:01.601 INFO:teuthology.orchestra.run.smithi156.stdout:(51/244): flexiblas-openblas-openmp-3.0.4-8.el9 192 kB/s | 17 kB 00:00 2023-11-02T09:25:01.612 INFO:teuthology.orchestra.run.smithi186.stdout:(243/244): librados2-18.0.0-6872.g84d22000.el9. 8.6 MB/s | 3.3 MB 00:00 2023-11-02T09:25:01.618 INFO:teuthology.orchestra.run.smithi156.stdout:(52/244): gdk-pixbuf2-modules-2.42.6-3.el9.x86_ 2.0 MB/s | 84 kB 00:00 2023-11-02T09:25:01.644 INFO:teuthology.orchestra.run.smithi156.stdout:(53/244): geoclue2-2.6.0-7.el9.x86_64.rpm 2.9 MB/s | 122 kB 00:00 2023-11-02T09:25:01.669 INFO:teuthology.orchestra.run.smithi156.stdout:(54/244): giflib-5.2.1-9.el9.x86_64.rpm 954 kB/s | 47 kB 00:00 2023-11-02T09:25:01.694 INFO:teuthology.orchestra.run.smithi156.stdout:(55/244): graphene-1.10.6-2.el9.x86_64.rpm 1.2 MB/s | 63 kB 00:00 2023-11-02T09:25:01.720 INFO:teuthology.orchestra.run.smithi156.stdout:(56/244): gsm-1.0.19-6.el9.x86_64.rpm 658 kB/s | 33 kB 00:00 2023-11-02T09:25:01.745 INFO:teuthology.orchestra.run.smithi156.stdout:(57/244): gtk-update-icon-cache-3.24.31-2.el9.x 684 kB/s | 34 kB 00:00 2023-11-02T09:25:01.820 INFO:teuthology.orchestra.run.smithi186.stdout:(244/244): librbd1-18.0.0-6872.g84d22000.el9.x8 5.4 MB/s | 3.0 MB 00:00 2023-11-02T09:25:01.823 INFO:teuthology.orchestra.run.smithi186.stdout:-------------------------------------------------------------------------------- 2023-11-02T09:25:01.824 INFO:teuthology.orchestra.run.smithi186.stdout:Total 16 MB/s | 277 MB 00:16 2023-11-02T09:25:01.828 INFO:teuthology.orchestra.run.smithi156.stdout:(58/244): gtk3-3.24.31-2.el9.x86_64.rpm 45 MB/s | 4.8 MB 00:00 2023-11-02T09:25:01.854 INFO:teuthology.orchestra.run.smithi156.stdout:(59/244): hicolor-icon-theme-0.17-13.el9.noarch 619 kB/s | 65 kB 00:00 2023-11-02T09:25:01.967 INFO:teuthology.orchestra.run.smithi156.stdout:(60/244): iso-codes-4.6.0-3.el9.noarch.rpm 24 MB/s | 3.3 MB 00:00 2023-11-02T09:25:01.996 INFO:teuthology.orchestra.run.smithi156.stdout:(61/244): java-11-openjdk-11.0.18.0.10-3.el9.x8 3.1 MB/s | 439 kB 00:00 2023-11-02T09:25:02.080 INFO:teuthology.orchestra.run.smithi156.stdout:(62/244): javapackages-filesystem-6.0.0-4.el9.n 130 kB/s | 10 kB 00:00 2023-11-02T09:25:02.191 INFO:teuthology.orchestra.run.smithi156.stdout:(63/244): jbigkit-libs-2.1-23.el9.x86_64.rpm 479 kB/s | 52 kB 00:00 2023-11-02T09:25:02.213 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction check 2023-11-02T09:25:02.361 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction check succeeded. 2023-11-02T09:25:02.361 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction test 2023-11-02T09:25:02.597 INFO:teuthology.orchestra.run.smithi156.stdout:(64/244): java-11-openjdk-headless-11.0.18.0.10 63 MB/s | 40 MB 00:00 2023-11-02T09:25:02.622 INFO:teuthology.orchestra.run.smithi156.stdout:(65/244): lcms2-2.12-3.el9.x86_64.rpm 387 kB/s | 166 kB 00:00 2023-11-02T09:25:02.648 INFO:teuthology.orchestra.run.smithi156.stdout:(66/244): libXcomposite-0.4.5-7.el9.x86_64.rpm 465 kB/s | 23 kB 00:00 2023-11-02T09:25:02.673 INFO:teuthology.orchestra.run.smithi156.stdout:(67/244): libXcursor-1.2.0-7.el9.x86_64.rpm 593 kB/s | 30 kB 00:00 2023-11-02T09:25:02.698 INFO:teuthology.orchestra.run.smithi156.stdout:(68/244): libXdamage-1.1.5-7.el9.x86_64.rpm 434 kB/s | 22 kB 00:00 2023-11-02T09:25:02.723 INFO:teuthology.orchestra.run.smithi156.stdout:(69/244): libXfixes-5.0.3-16.el9.x86_64.rpm 373 kB/s | 19 kB 00:00 2023-11-02T09:25:02.749 INFO:teuthology.orchestra.run.smithi156.stdout:(70/244): libXi-1.7.10-8.el9.x86_64.rpm 771 kB/s | 38 kB 00:00 2023-11-02T09:25:02.774 INFO:teuthology.orchestra.run.smithi156.stdout:(71/244): libXinerama-1.1.4-10.el9.x86_64.rpm 280 kB/s | 14 kB 00:00 2023-11-02T09:25:02.799 INFO:teuthology.orchestra.run.smithi156.stdout:(72/244): libXrandr-1.5.2-8.el9.x86_64.rpm 545 kB/s | 27 kB 00:00 2023-11-02T09:25:02.824 INFO:teuthology.orchestra.run.smithi156.stdout:(73/244): libXtst-1.2.3-16.el9.x86_64.rpm 406 kB/s | 20 kB 00:00 2023-11-02T09:25:02.850 INFO:teuthology.orchestra.run.smithi156.stdout:(74/244): libXv-1.0.11-16.el9.x86_64.rpm 361 kB/s | 18 kB 00:00 2023-11-02T09:25:02.875 INFO:teuthology.orchestra.run.smithi156.stdout:(75/244): libXxf86vm-1.1.4-18.el9.x86_64.rpm 355 kB/s | 18 kB 00:00 2023-11-02T09:25:02.900 INFO:teuthology.orchestra.run.smithi156.stdout:(76/244): libasyncns-0.8-22.el9.x86_64.rpm 586 kB/s | 29 kB 00:00 2023-11-02T09:25:02.925 INFO:teuthology.orchestra.run.smithi156.stdout:(77/244): libepoxy-1.5.5-4.el9.x86_64.rpm 4.7 MB/s | 240 kB 00:00 2023-11-02T09:25:02.959 INFO:teuthology.orchestra.run.smithi156.stdout:(78/244): libexif-0.6.22-6.el9.x86_64.rpm 7.2 MB/s | 431 kB 00:00 2023-11-02T09:25:02.985 INFO:teuthology.orchestra.run.smithi156.stdout:(79/244): libfontenc-1.1.3-17.el9.x86_64.rpm 518 kB/s | 30 kB 00:00 2023-11-02T09:25:03.010 INFO:teuthology.orchestra.run.smithi156.stdout:(80/244): libgexiv2-0.12.3-1.el9.x86_64.rpm 1.6 MB/s | 82 kB 00:00 2023-11-02T09:25:03.035 INFO:teuthology.orchestra.run.smithi156.stdout:(81/244): libglvnd-1.3.4-1.el9.x86_64.rpm 2.6 MB/s | 134 kB 00:00 2023-11-02T09:25:03.060 INFO:teuthology.orchestra.run.smithi156.stdout:(82/244): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 714 kB/s | 36 kB 00:00 2023-11-02T09:25:03.086 INFO:teuthology.orchestra.run.smithi156.stdout:(83/244): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 2.8 MB/s | 141 kB 00:00 2023-11-02T09:25:03.120 INFO:teuthology.orchestra.run.smithi156.stdout:(84/244): libgsf-1.14.47-5.el9.x86_64.rpm 4.1 MB/s | 245 kB 00:00 2023-11-02T09:25:03.145 INFO:teuthology.orchestra.run.smithi156.stdout:(85/244): libgxps-0.3.2-3.el9.x86_64.rpm 1.3 MB/s | 78 kB 00:00 2023-11-02T09:25:03.170 INFO:teuthology.orchestra.run.smithi156.stdout:(86/244): libiptcdata-1.0.5-9.el9.x86_64.rpm 1.2 MB/s | 61 kB 00:00 2023-11-02T09:25:03.195 INFO:teuthology.orchestra.run.smithi156.stdout:(87/244): libldac-2.0.2.3-10.el9.x86_64.rpm 803 kB/s | 40 kB 00:00 2023-11-02T09:25:03.221 INFO:teuthology.orchestra.run.smithi156.stdout:(88/244): libnotify-0.7.9-8.el9.x86_64.rpm 850 kB/s | 43 kB 00:00 2023-11-02T09:25:03.246 INFO:teuthology.orchestra.run.smithi156.stdout:(89/244): libogg-1.3.4-6.el9.x86_64.rpm 650 kB/s | 32 kB 00:00 2023-11-02T09:25:03.271 INFO:teuthology.orchestra.run.smithi156.stdout:(90/244): libosinfo-1.10.0-1.el9.x86_64.rpm 6.1 MB/s | 312 kB 00:00 2023-11-02T09:25:03.297 INFO:teuthology.orchestra.run.smithi156.stdout:(91/244): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 159 kB 00:00 2023-11-02T09:25:03.330 INFO:teuthology.orchestra.run.smithi156.stdout:(92/244): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 661 kB 00:00 2023-11-02T09:25:03.356 INFO:teuthology.orchestra.run.smithi156.stdout:(93/244): libsbc-1.4-9.el9.x86_64.rpm 761 kB/s | 44 kB 00:00 2023-11-02T09:25:03.381 INFO:teuthology.orchestra.run.smithi156.stdout:(94/244): libsndfile-1.0.31-7.el9.x86_64.rpm 4.0 MB/s | 206 kB 00:00 2023-11-02T09:25:03.398 INFO:teuthology.orchestra.run.smithi156.stdout:(95/244): libtheora-1.1.1-31.el9.x86_64.rpm 3.9 MB/s | 163 kB 00:00 2023-11-02T09:25:03.415 INFO:teuthology.orchestra.run.smithi156.stdout:(96/244): libtool-ltdl-2.4.6-45.el9.x86_64.rpm 1.1 MB/s | 36 kB 00:00 2023-11-02T09:25:03.440 INFO:teuthology.orchestra.run.smithi156.stdout:(97/244): libtracker-sparql-3.1.2-3.el9.x86_64. 7.4 MB/s | 316 kB 00:00 2023-11-02T09:25:03.465 INFO:teuthology.orchestra.run.smithi156.stdout:(98/244): libvisual-0.4.0-34.el9.x86_64.rpm 2.8 MB/s | 143 kB 00:00 2023-11-02T09:25:03.491 INFO:teuthology.orchestra.run.smithi156.stdout:(99/244): libvorbis-1.3.7-5.el9.x86_64.rpm 3.8 MB/s | 192 kB 00:00 2023-11-02T09:25:03.516 INFO:teuthology.orchestra.run.smithi156.stdout:(100/244): libwayland-client-1.21.0-1.el9.x86_6 650 kB/s | 32 kB 00:00 2023-11-02T09:25:03.541 INFO:teuthology.orchestra.run.smithi156.stdout:(101/244): libwayland-cursor-1.21.0-1.el9.x86_6 367 kB/s | 18 kB 00:00 2023-11-02T09:25:03.566 INFO:teuthology.orchestra.run.smithi156.stdout:(102/244): libwayland-egl-1.21.0-1.el9.x86_64.r 236 kB/s | 12 kB 00:00 2023-11-02T09:25:03.592 INFO:teuthology.orchestra.run.smithi156.stdout:(103/244): libwayland-server-1.21.0-1.el9.x86_6 811 kB/s | 41 kB 00:00 2023-11-02T09:25:03.617 INFO:teuthology.orchestra.run.smithi156.stdout:(104/244): libxkbcommon-1.0.3-4.el9.x86_64.rpm 2.6 MB/s | 132 kB 00:00 2023-11-02T09:25:03.642 INFO:teuthology.orchestra.run.smithi156.stdout:(105/244): libxshmfence-1.3-10.el9.x86_64.rpm 231 kB/s | 12 kB 00:00 2023-11-02T09:25:03.668 INFO:teuthology.orchestra.run.smithi156.stdout:(106/244): low-memory-monitor-2.1-4.el9.x86_64. 693 kB/s | 35 kB 00:00 2023-11-02T09:25:03.701 INFO:teuthology.orchestra.run.smithi156.stdout:(107/244): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.7 MB/s | 282 kB 00:00 2023-11-02T09:25:03.726 INFO:teuthology.orchestra.run.smithi156.stdout:(108/244): lua-posix-35.0-8.el9.x86_64.rpm 2.2 MB/s | 131 kB 00:00 2023-11-02T09:25:03.752 INFO:teuthology.orchestra.run.smithi156.stdout:(109/244): mkfontscale-1.2.1-3.el9.x86_64.rpm 627 kB/s | 31 kB 00:00 2023-11-02T09:25:03.777 INFO:teuthology.orchestra.run.smithi156.stdout:(110/244): oniguruma-6.9.6-1.el9.5.x86_64.rpm 4.2 MB/s | 217 kB 00:00 2023-11-02T09:25:03.802 INFO:teuthology.orchestra.run.smithi156.stdout:(111/244): openblas-0.3.21-2.el9.x86_64.rpm 684 kB/s | 34 kB 00:00 2023-11-02T09:25:03.886 INFO:teuthology.orchestra.run.smithi156.stdout:(112/244): openblas-openmp-0.3.21-2.el9.x86_64. 44 MB/s | 4.7 MB 00:00 2023-11-02T09:25:03.911 INFO:teuthology.orchestra.run.smithi156.stdout:(113/244): openjpeg2-2.4.0-7.el9.x86_64.rpm 1.5 MB/s | 162 kB 00:00 2023-11-02T09:25:03.937 INFO:teuthology.orchestra.run.smithi156.stdout:(114/244): opus-1.3.1-10.el9.x86_64.rpm 3.9 MB/s | 199 kB 00:00 2023-11-02T09:25:03.962 INFO:teuthology.orchestra.run.smithi156.stdout:(115/244): orc-0.4.31-6.el9.x86_64.rpm 3.6 MB/s | 183 kB 00:00 2023-11-02T09:25:03.987 INFO:teuthology.orchestra.run.smithi156.stdout:(116/244): osinfo-db-tools-1.10.0-1.el9.x86_64. 1.3 MB/s | 68 kB 00:00 2023-11-02T09:25:04.012 INFO:teuthology.orchestra.run.smithi156.stdout:(117/244): ostree-libs-2023.6-1.el9.x86_64.rpm 9.2 MB/s | 470 kB 00:00 2023-11-02T09:25:04.038 INFO:teuthology.orchestra.run.smithi156.stdout:(118/244): p11-kit-server-0.24.1-2.el9.x86_64.r 3.9 MB/s | 198 kB 00:00 2023-11-02T09:25:04.063 INFO:teuthology.orchestra.run.smithi156.stdout:(119/244): pipewire-0.3.67-2.el9.x86_64.rpm 1.7 MB/s | 86 kB 00:00 2023-11-02T09:25:04.088 INFO:teuthology.orchestra.run.smithi156.stdout:(120/244): pipewire-alsa-0.3.67-2.el9.x86_64.rp 1.1 MB/s | 55 kB 00:00 2023-11-02T09:25:04.114 INFO:teuthology.orchestra.run.smithi156.stdout:(121/244): pipewire-jack-audio-connection-kit-0 2.4 MB/s | 126 kB 00:00 2023-11-02T09:25:04.147 INFO:teuthology.orchestra.run.smithi156.stdout:(122/244): pipewire-libs-0.3.67-2.el9.x86_64.rp 30 MB/s | 1.7 MB 00:00 2023-11-02T09:25:04.172 INFO:teuthology.orchestra.run.smithi156.stdout:(123/244): pipewire-pulseaudio-0.3.67-2.el9.x86 318 kB/s | 18 kB 00:00 2023-11-02T09:25:04.206 INFO:teuthology.orchestra.run.smithi156.stdout:(124/244): poppler-21.01.0-19.el9.x86_64.rpm 18 MB/s | 1.1 MB 00:00 2023-11-02T09:25:04.248 INFO:teuthology.orchestra.run.smithi156.stdout:(125/244): poppler-data-0.4.9-9.el9.noarch.rpm 25 MB/s | 1.8 MB 00:00 2023-11-02T09:25:04.273 INFO:teuthology.orchestra.run.smithi156.stdout:(126/244): poppler-glib-21.01.0-19.el9.x86_64.r 2.3 MB/s | 151 kB 00:00 2023-11-02T09:25:04.299 INFO:teuthology.orchestra.run.smithi156.stdout:(127/244): pulseaudio-libs-15.0-2.el9.x86_64.rp 13 MB/s | 666 kB 00:00 2023-11-02T09:25:04.324 INFO:teuthology.orchestra.run.smithi156.stdout:(128/244): pulseaudio-utils-15.0-2.el9.x86_64.r 1.4 MB/s | 72 kB 00:00 2023-11-02T09:25:04.541 INFO:teuthology.orchestra.run.smithi156.stdout:(129/244): ceph-osd-18.0.0-6872.g84d22000.el9.x 2.0 MB/s | 18 MB 00:08 2023-11-02T09:25:04.625 INFO:teuthology.orchestra.run.smithi156.stdout:(130/244): python3-babel-2.9.1-2.el9.noarch.rpm 18 MB/s | 5.8 MB 00:00 2023-11-02T09:25:04.650 INFO:teuthology.orchestra.run.smithi156.stdout:(131/244): python3-devel-3.9.17-2.el9.x86_64.rp 636 kB/s | 205 kB 00:00 2023-11-02T09:25:04.675 INFO:teuthology.orchestra.run.smithi156.stdout:(132/244): python3-jinja2-2.11.3-4.el9.noarch.r 1.7 MB/s | 228 kB 00:00 2023-11-02T09:25:04.692 INFO:teuthology.orchestra.run.smithi156.stdout:(133/244): python3-jsonpatch-1.21-16.el9.noarch 594 kB/s | 24 kB 00:00 2023-11-02T09:25:04.709 INFO:teuthology.orchestra.run.smithi156.stdout:(134/244): python3-jsonpointer-2.0-4.el9.noarch 312 kB/s | 18 kB 00:00 2023-11-02T09:25:04.734 INFO:teuthology.orchestra.run.smithi156.stdout:(135/244): python3-mako-1.1.4-6.el9.noarch.rpm 2.4 MB/s | 144 kB 00:00 2023-11-02T09:25:04.756 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction test succeeded. 2023-11-02T09:25:04.756 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction 2023-11-02T09:25:04.759 INFO:teuthology.orchestra.run.smithi156.stdout:(136/244): python3-markupsafe-1.1.1-12.el9.x86_ 636 kB/s | 32 kB 00:00 2023-11-02T09:25:04.826 INFO:teuthology.orchestra.run.smithi156.stdout:(137/244): python3-numpy-1.20.1-5.el9.x86_64.rp 41 MB/s | 4.8 MB 00:00 2023-11-02T09:25:04.852 INFO:teuthology.orchestra.run.smithi156.stdout:(138/244): python3-numpy-f2py-1.20.1-5.el9.x86_ 1.9 MB/s | 217 kB 00:00 2023-11-02T09:25:04.877 INFO:teuthology.orchestra.run.smithi156.stdout:(139/244): python3-oauthlib-3.1.1-5.el9.noarch. 1.5 MB/s | 174 kB 00:00 2023-11-02T09:25:04.902 INFO:teuthology.orchestra.run.smithi156.stdout:(140/244): python3-prettytable-0.7.2-27.el9.noa 551 kB/s | 41 kB 00:00 2023-11-02T09:25:04.927 INFO:teuthology.orchestra.run.smithi156.stdout:(141/244): python3-pyasn1-0.4.8-6.el9.noarch.rp 2.6 MB/s | 132 kB 00:00 2023-11-02T09:25:04.952 INFO:teuthology.orchestra.run.smithi156.stdout:(142/244): python3-pyasn1-modules-0.4.8-6.el9.n 2.7 MB/s | 211 kB 00:00 2023-11-02T09:25:04.977 INFO:teuthology.orchestra.run.smithi156.stdout:(143/244): python3-requests-oauthlib-1.3.0-12.e 574 kB/s | 43 kB 00:00 2023-11-02T09:25:05.003 INFO:teuthology.orchestra.run.smithi156.stdout:(144/244): python3-toml-0.10.2-6.el9.noarch.rpm 777 kB/s | 39 kB 00:00 2023-11-02T09:25:05.078 INFO:teuthology.orchestra.run.smithi156.stdout:(145/244): rtkit-0.11-28.el9.x86_64.rpm 547 kB/s | 55 kB 00:00 2023-11-02T09:25:05.262 INFO:teuthology.orchestra.run.smithi156.stdout:(146/244): python3-scipy-1.6.2-8.el9.x86_64.rpm 51 MB/s | 16 MB 00:00 2023-11-02T09:25:05.287 INFO:teuthology.orchestra.run.smithi156.stdout:(147/244): socat-1.7.4.1-5.el9.x86_64.rpm 1.0 MB/s | 300 kB 00:00 2023-11-02T09:25:05.312 INFO:teuthology.orchestra.run.smithi156.stdout:(148/244): sound-theme-freedesktop-0.8-17.el9.n 1.6 MB/s | 377 kB 00:00 2023-11-02T09:25:05.337 INFO:teuthology.orchestra.run.smithi156.stdout:(149/244): totem-pl-parser-3.26.6-2.el9.x86_64. 1.7 MB/s | 130 kB 00:00 2023-11-02T09:25:05.387 INFO:teuthology.orchestra.run.smithi156.stdout:(150/244): tracker-miners-3.1.2-3.el9.x86_64.rp 12 MB/s | 887 kB 00:00 2023-11-02T09:25:05.413 INFO:teuthology.orchestra.run.smithi156.stdout:(151/244): tracker-3.1.2-3.el9.x86_64.rpm 5.3 MB/s | 537 kB 00:00 2023-11-02T09:25:05.438 INFO:teuthology.orchestra.run.smithi156.stdout:(152/244): ttmkfdir-3.0.9-65.el9.x86_64.rpm 526 kB/s | 52 kB 00:00 2023-11-02T09:25:05.463 INFO:teuthology.orchestra.run.smithi156.stdout:(153/244): tzdata-java-2023c-1.el9.noarch.rpm 2.0 MB/s | 149 kB 00:00 2023-11-02T09:25:05.491 INFO:teuthology.orchestra.run.smithi156.stdout:(154/244): upower-0.99.11-11.el9.x86_64.rpm 3.2 MB/s | 168 kB 00:00 2023-11-02T09:25:05.516 INFO:teuthology.orchestra.run.smithi156.stdout:(155/244): webrtc-audio-processing-0.3.1-8.el9. 3.9 MB/s | 305 kB 00:00 2023-11-02T09:25:05.541 INFO:teuthology.orchestra.run.smithi156.stdout:(156/244): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 538 kB/s | 41 kB 00:00 2023-11-02T09:25:05.575 INFO:teuthology.orchestra.run.smithi156.stdout:(157/244): xdg-desktop-portal-1.12.4-1.el9.x86_ 6.1 MB/s | 365 kB 00:00 2023-11-02T09:25:05.600 INFO:teuthology.orchestra.run.smithi156.stdout:(158/244): xdg-desktop-portal-gtk-1.12.0-3.el9. 1.5 MB/s | 130 kB 00:00 2023-11-02T09:25:05.625 INFO:teuthology.orchestra.run.smithi156.stdout:(159/244): xkeyboard-config-2.33-2.el9.noarch.r 9.2 MB/s | 780 kB 00:00 2023-11-02T09:25:05.651 INFO:teuthology.orchestra.run.smithi156.stdout:(160/244): xmlstarlet-1.6.1-20.el9.x86_64.rpm 846 kB/s | 63 kB 00:00 2023-11-02T09:25:05.676 INFO:teuthology.orchestra.run.smithi156.stdout:(161/244): xorg-x11-fonts-Type1-7.5-33.el9.noar 6.5 MB/s | 499 kB 00:00 2023-11-02T09:25:05.726 INFO:teuthology.orchestra.run.smithi156.stdout:(162/244): ModemManager-glib-1.20.2-1.el9.x86_6 4.4 MB/s | 334 kB 00:00 2023-11-02T09:25:05.751 INFO:teuthology.orchestra.run.smithi156.stdout:(163/244): bluez-libs-5.64-1.el9.x86_64.rpm 833 kB/s | 83 kB 00:00 2023-11-02T09:25:05.777 INFO:teuthology.orchestra.run.smithi156.stdout:(164/244): bubblewrap-0.4.1-6.el9.x86_64.rpm 493 kB/s | 49 kB 00:00 2023-11-02T09:25:05.802 INFO:teuthology.orchestra.run.smithi156.stdout:(165/244): cups-libs-2.3.3op2-21.el9.x86_64.rpm 3.4 MB/s | 262 kB 00:00 2023-11-02T09:25:05.827 INFO:teuthology.orchestra.run.smithi156.stdout:(166/244): fuse-2.9.9-15.el9.x86_64.rpm 1.6 MB/s | 79 kB 00:00 2023-11-02T09:25:05.852 INFO:teuthology.orchestra.run.smithi156.stdout:(167/244): libgfortran-11.4.1-2.3.el9.x86_64.rp 11 MB/s | 803 kB 00:00 2023-11-02T09:25:05.869 INFO:teuthology.orchestra.run.smithi156.stdout:(168/244): libpciaccess-0.16-6.el9.x86_64.rpm 401 kB/s | 27 kB 00:00 2023-11-02T09:25:05.894 INFO:teuthology.orchestra.run.smithi156.stdout:(169/244): libquadmath-11.4.1-2.3.el9.x86_64.rp 2.9 MB/s | 195 kB 00:00 2023-11-02T09:25:05.920 INFO:teuthology.orchestra.run.smithi156.stdout:(170/244): lksctp-tools-1.0.19-2.el9.x86_64.rpm 1.8 MB/s | 90 kB 00:00 2023-11-02T09:25:05.945 INFO:teuthology.orchestra.run.smithi156.stdout:(171/244): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.1 MB/s | 241 kB 00:00 2023-11-02T09:25:05.970 INFO:teuthology.orchestra.run.smithi156.stdout:(172/244): python3-ply-3.11-14.el9.noarch.rpm 1.3 MB/s | 103 kB 00:00 2023-11-02T09:25:05.996 INFO:teuthology.orchestra.run.smithi156.stdout:(173/244): python3-requests-2.25.1-7.el9.noarch 2.2 MB/s | 113 kB 00:00 2023-11-02T09:25:06.021 INFO:teuthology.orchestra.run.smithi156.stdout:(174/244): python3-pycparser-2.20-6.el9.noarch. 1.6 MB/s | 124 kB 00:00 2023-11-02T09:25:06.046 INFO:teuthology.orchestra.run.smithi156.stdout:(175/244): python3-urllib3-1.26.5-4.el9.noarch. 2.4 MB/s | 187 kB 00:00 2023-11-02T09:25:06.180 INFO:teuthology.orchestra.run.smithi156.stdout:(176/244): avahi-glib-0.8-12.el9.x86_64.rpm 111 kB/s | 15 kB 00:00 2023-11-02T09:25:06.313 INFO:teuthology.orchestra.run.smithi156.stdout:(177/244): alsa-lib-1.2.9-1.el9.x86_64.rpm 1.9 MB/s | 518 kB 00:00 2023-11-02T09:25:06.338 INFO:teuthology.orchestra.run.smithi156.stdout:(178/244): flac-libs-1.3.3-12.el9.x86_64.rpm 1.3 MB/s | 218 kB 00:00 2023-11-02T09:25:06.389 INFO:teuthology.orchestra.run.smithi156.stdout:(179/244): flatpak-selinux-1.12.8-1.el9.noarch. 426 kB/s | 21 kB 00:00 2023-11-02T09:25:06.447 INFO:teuthology.orchestra.run.smithi156.stdout:(180/244): flatpak-session-helper-1.12.8-1.el9. 1.2 MB/s | 74 kB 00:00 2023-11-02T09:25:06.548 INFO:teuthology.orchestra.run.smithi156.stdout:(181/244): flatpak-1.12.8-1.el9.x86_64.rpm 7.3 MB/s | 1.7 MB 00:00 2023-11-02T09:25:06.639 INFO:teuthology.orchestra.run.smithi156.stdout:(182/244): gstreamer1-1.22.1-2.el9.x86_64.rpm 7.4 MB/s | 1.4 MB 00:00 2023-11-02T09:25:06.698 INFO:teuthology.orchestra.run.smithi156.stdout:(183/244): jq-1.6-15.el9.x86_64.rpm 3.1 MB/s | 187 kB 00:00 2023-11-02T09:25:06.765 INFO:teuthology.orchestra.run.smithi156.stdout:(184/244): libX11-xcb-1.7.0-8.el9.x86_64.rpm 164 kB/s | 11 kB 00:00 2023-11-02T09:25:06.807 INFO:teuthology.orchestra.run.smithi156.stdout:(185/244): gstreamer1-plugins-base-1.22.1-1.el9 8.6 MB/s | 2.2 MB 00:00 2023-11-02T09:25:06.833 INFO:teuthology.orchestra.run.smithi156.stdout:(186/244): libcanberra-0.30-27.el9.x86_64.rpm 1.3 MB/s | 86 kB 00:00 2023-11-02T09:25:06.866 INFO:teuthology.orchestra.run.smithi156.stdout:(187/244): python3-cryptography-36.0.1-4.el9.x8 1.4 MB/s | 1.2 MB 00:00 2023-11-02T09:25:06.891 INFO:teuthology.orchestra.run.smithi156.stdout:(188/244): libcanberra-gtk3-0.30-27.el9.x86_64. 378 kB/s | 32 kB 00:00 2023-11-02T09:25:06.917 INFO:teuthology.orchestra.run.smithi156.stdout:(189/244): libdrm-2.4.115-1.el9.x86_64.rpm 1.9 MB/s | 160 kB 00:00 2023-11-02T09:25:06.950 INFO:teuthology.orchestra.run.smithi156.stdout:(190/244): libtiff-4.4.0-10.el9.x86_64.rpm 3.3 MB/s | 197 kB 00:00 2023-11-02T09:25:06.975 INFO:teuthology.orchestra.run.smithi156.stdout:(191/244): libwebp-1.2.0-8.el9.x86_64.rpm 4.6 MB/s | 277 kB 00:00 2023-11-02T09:25:07.009 INFO:teuthology.orchestra.run.smithi156.stdout:(192/244): lua-5.4.4-4.el9.x86_64.rpm 3.2 MB/s | 188 kB 00:00 2023-11-02T09:25:07.034 INFO:teuthology.orchestra.run.smithi156.stdout:(193/244): librabbitmq-0.11.0-7.el9.x86_64.rpm 269 kB/s | 45 kB 00:00 2023-11-02T09:25:07.185 INFO:teuthology.orchestra.run.smithi156.stdout:(194/244): mesa-libEGL-23.1.4-1.el9.x86_64.rpm 598 kB/s | 125 kB 00:00 2023-11-02T09:25:07.210 INFO:teuthology.orchestra.run.smithi156.stdout:(195/244): mesa-libgbm-23.1.4-1.el9.x86_64.rpm 214 kB/s | 38 kB 00:00 2023-11-02T09:25:07.236 INFO:teuthology.orchestra.run.smithi156.stdout:(196/244): mesa-libGL-23.1.4-1.el9.x86_64.rpm 736 kB/s | 166 kB 00:00 2023-11-02T09:25:07.252 INFO:teuthology.orchestra.run.smithi156.stdout:(197/244): mesa-libglapi-23.1.4-1.el9.x86_64.rp 694 kB/s | 47 kB 00:00 2023-11-02T09:25:07.303 INFO:teuthology.orchestra.run.smithi156.stdout:(198/244): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2023-11-02T09:25:07.328 INFO:teuthology.orchestra.run.smithi156.stdout:(199/244): osinfo-db-20230518-1.el9.noarch.rpm 5.3 MB/s | 503 kB 00:00 2023-11-02T09:25:07.389 INFO:teuthology.orchestra.run.smithi156.stdout:(200/244): wireplumber-0.4.14-1.el9.x86_64.rpm 1.6 MB/s | 96 kB 00:00 2023-11-02T09:25:07.412 INFO:teuthology.orchestra.run.smithi156.stdout:(201/244): vulkan-loader-1.3.250.1-1.el9.x86_64 1.3 MB/s | 141 kB 00:00 2023-11-02T09:25:07.446 INFO:teuthology.orchestra.run.smithi156.stdout:(202/244): wireplumber-libs-0.4.14-1.el9.x86_64 6.0 MB/s | 358 kB 00:00 2023-11-02T09:25:07.921 INFO:teuthology.orchestra.run.smithi156.stdout:(203/244): fmt-8.1.1-5.el9.x86_64.rpm 218 kB/s | 111 kB 00:00 2023-11-02T09:25:08.013 INFO:teuthology.orchestra.run.smithi156.stdout:(204/244): mesa-vulkan-drivers-23.1.4-1.el9.x86 12 MB/s | 9.2 MB 00:00 2023-11-02T09:25:08.096 INFO:teuthology.orchestra.run.smithi156.stdout:(205/244): gperftools-libs-2.9.1-2.el9.x86_64.r 475 kB/s | 309 kB 00:00 2023-11-02T09:25:08.246 INFO:teuthology.orchestra.run.smithi156.stdout:(206/244): liboath-2.6.7-2.el9.x86_64.rpm 393 kB/s | 49 kB 00:00 2023-11-02T09:25:08.363 INFO:teuthology.orchestra.run.smithi156.stdout:(207/244): libunwind-1.6.2-1.el9.x86_64.rpm 578 kB/s | 67 kB 00:00 2023-11-02T09:25:08.389 INFO:teuthology.orchestra.run.smithi156.stdout:(208/244): libarrow-doc-9.0.0-9.el9.noarch.rpm 65 kB/s | 24 kB 00:00 2023-11-02T09:25:08.564 INFO:teuthology.orchestra.run.smithi156.stdout:(209/244): libarrow-9.0.0-9.el9.x86_64.rpm 6.9 MB/s | 4.4 MB 00:00 2023-11-02T09:25:08.672 INFO:teuthology.orchestra.run.smithi156.stdout:(210/244): parquet-libs-9.0.0-9.el9.x86_64.rpm 2.6 MB/s | 837 kB 00:00 2023-11-02T09:25:08.690 INFO:teuthology.orchestra.run.smithi156.stdout:(211/244): python3-bcrypt-3.2.2-1.el9.x86_64.rp 347 kB/s | 43 kB 00:00 2023-11-02T09:25:08.773 INFO:teuthology.orchestra.run.smithi156.stdout:(212/244): python3-cachetools-4.2.4-1.el9.noarc 322 kB/s | 32 kB 00:00 2023-11-02T09:25:08.790 INFO:teuthology.orchestra.run.smithi156.stdout:(213/244): python3-certifi-2021.10.8-2.el9.noar 150 kB/s | 15 kB 00:00 2023-11-02T09:25:08.849 INFO:teuthology.orchestra.run.smithi156.stdout:(214/244): python3-asyncssh-2.13.2-3.el9.noarch 1.2 MB/s | 548 kB 00:00 2023-11-02T09:25:08.891 INFO:teuthology.orchestra.run.smithi156.stdout:(215/244): python3-cheroot-8.6.0-4.el9.noarch.r 1.4 MB/s | 172 kB 00:00 2023-11-02T09:25:08.925 INFO:teuthology.orchestra.run.smithi156.stdout:(216/244): python3-cherrypy-18.6.1-2.el9.noarch 2.6 MB/s | 358 kB 00:00 2023-11-02T09:25:08.975 INFO:teuthology.orchestra.run.smithi156.stdout:(217/244): python3-google-auth-2.23.3-1.el9.noa 1.5 MB/s | 197 kB 00:00 2023-11-02T09:25:08.992 INFO:teuthology.orchestra.run.smithi156.stdout:(218/244): python3-jaraco-8.2.1-3.el9.noarch.rp 106 kB/s | 11 kB 00:00 2023-11-02T09:25:09.025 INFO:teuthology.orchestra.run.smithi156.stdout:(219/244): python3-jaraco-classes-3.2.1-5.el9.n 175 kB/s | 18 kB 00:00 2023-11-02T09:25:09.084 INFO:teuthology.orchestra.run.smithi156.stdout:(220/244): python3-jaraco-collections-3.0.0-8.e 212 kB/s | 23 kB 00:00 2023-11-02T09:25:09.109 INFO:teuthology.orchestra.run.smithi156.stdout:(221/244): python3-jaraco-functools-3.5.0-2.el9 166 kB/s | 19 kB 00:00 2023-11-02T09:25:09.135 INFO:teuthology.orchestra.run.smithi156.stdout:(222/244): python3-jaraco-text-3.2.0-6.el9.noar 181 kB/s | 20 kB 00:00 2023-11-02T09:25:09.201 INFO:teuthology.orchestra.run.smithi156.stdout:(223/244): python3-jwt+crypto-2.4.0-1.el9.noarc 77 kB/s | 9.0 kB 00:00 2023-11-02T09:25:09.252 INFO:teuthology.orchestra.run.smithi156.stdout:(224/244): python3-jwt-2.4.0-1.el9.noarch.rpm 288 kB/s | 41 kB 00:00 2023-11-02T09:25:09.310 INFO:teuthology.orchestra.run.smithi156.stdout:(225/244): python3-kubernetes-26.1.0-2.el9.noar 5.8 MB/s | 1.0 MB 00:00 2023-11-02T09:25:09.336 INFO:teuthology.orchestra.run.smithi156.stdout:(226/244): python3-logutils-0.3.5-21.el9.noarch 346 kB/s | 46 kB 00:00 2023-11-02T09:25:09.361 INFO:teuthology.orchestra.run.smithi156.stdout:(227/244): python3-more-itertools-8.12.0-2.el9. 723 kB/s | 79 kB 00:00 2023-11-02T09:25:09.428 INFO:teuthology.orchestra.run.smithi156.stdout:(228/244): python3-natsort-7.1.1-5.el9.noarch.r 493 kB/s | 58 kB 00:00 2023-11-02T09:25:09.470 INFO:teuthology.orchestra.run.smithi156.stdout:(229/244): python3-portend-3.1.0-2.el9.noarch.r 151 kB/s | 16 kB 00:00 2023-11-02T09:25:09.495 INFO:teuthology.orchestra.run.smithi156.stdout:(230/244): python3-pecan-1.4.2-3.el9.noarch.rpm 1.7 MB/s | 272 kB 00:00 2023-11-02T09:25:09.537 INFO:teuthology.orchestra.run.smithi156.stdout:(231/244): python3-pyOpenSSL-21.0.0-1.el9.noarc 827 kB/s | 90 kB 00:00 2023-11-02T09:25:09.571 INFO:teuthology.orchestra.run.smithi156.stdout:(232/244): python3-repoze-lru-0.7-16.el9.noarch 306 kB/s | 31 kB 00:00 2023-11-02T09:25:09.621 INFO:teuthology.orchestra.run.smithi156.stdout:(233/244): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2023-11-02T09:25:09.646 INFO:teuthology.orchestra.run.smithi156.stdout:(234/244): python3-rsa-4.9-2.el9.noarch.rpm 542 kB/s | 59 kB 00:00 2023-11-02T09:25:09.672 INFO:teuthology.orchestra.run.smithi156.stdout:(235/244): python3-tempora-5.0.0-2.el9.noarch.r 355 kB/s | 36 kB 00:00 2023-11-02T09:25:09.730 INFO:teuthology.orchestra.run.smithi156.stdout:(236/244): python3-typing-extensions-4.4.0-2.el 469 kB/s | 51 kB 00:00 2023-11-02T09:25:09.755 INFO:teuthology.orchestra.run.smithi156.stdout:(237/244): python3-webob-1.8.7-6.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2023-11-02T09:25:09.772 INFO:teuthology.orchestra.run.smithi156.stdout:(238/244): python3-websocket-client-1.2.3-2.el9 892 kB/s | 90 kB 00:00 2023-11-02T09:25:09.864 INFO:teuthology.orchestra.run.smithi156.stdout:(239/244): python3-zc-lockfile-2.0-10.el9.noarc 184 kB/s | 20 kB 00:00 2023-11-02T09:25:09.890 INFO:teuthology.orchestra.run.smithi156.stdout:(240/244): python3-werkzeug-2.0.3-3.el9.1.noarc 2.6 MB/s | 427 kB 00:00 2023-11-02T09:25:09.915 INFO:teuthology.orchestra.run.smithi156.stdout:(241/244): re2-20211101-3.el9.x86_64.rpm 1.3 MB/s | 192 kB 00:00 2023-11-02T09:25:10.182 INFO:teuthology.orchestra.run.smithi156.stdout:(242/244): thrift-0.15.0-2.el9.x86_64.rpm 5.0 MB/s | 1.6 MB 00:00 2023-11-02T09:25:10.832 INFO:teuthology.orchestra.run.smithi156.stdout:(243/244): librados2-18.0.0-6872.g84d22000.el9. 3.5 MB/s | 3.3 MB 00:00 2023-11-02T09:25:11.516 INFO:teuthology.orchestra.run.smithi156.stdout:(244/244): librbd1-18.0.0-6872.g84d22000.el9.x8 1.9 MB/s | 3.0 MB 00:01 2023-11-02T09:25:11.522 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-11-02T09:25:11.522 INFO:teuthology.orchestra.run.smithi156.stdout:Total 14 MB/s | 277 MB 00:20 2023-11-02T09:25:11.933 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-11-02T09:25:12.086 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-11-02T09:25:12.086 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-11-02T09:25:13.167 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2023-11-02T09:25:13.302 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x86_64 1/1 2023-11-02T09:25:13.503 INFO:teuthology.orchestra.run.smithi186.stdout: Preparing : 1/1 2023-11-02T09:25:13.611 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/246 2023-11-02T09:25:13.650 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : alsa-lib-1.2.9-1.el9.x86_64 2/246 2023-11-02T09:25:13.668 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 3/246 2023-11-02T09:25:13.694 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 4/246 2023-11-02T09:25:13.723 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libXi-1.7.10-8.el9.x86_64 5/246 2023-11-02T09:25:13.759 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 6/246 2023-11-02T09:25:13.793 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/246 2023-11-02T09:25:13.819 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/246 2023-11-02T09:25:13.843 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/246 2023-11-02T09:25:13.902 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libX11-xcb-1.7.0-8.el9.x86_64 10/246 2023-11-02T09:25:14.226 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 11/246 2023-11-02T09:25:14.278 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : librados2-2:18.0.0-6872.g84d22000.el9.x86_64 12/246 2023-11-02T09:25:14.396 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: librados2-2:18.0.0-6872.g84d22000.el9.x86_64 12/246 2023-11-02T09:25:14.420 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libcephfs2-2:18.0.0-6872.g84d22000.el9.x86_64 13/246 2023-11-02T09:25:14.468 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-11-02T09:25:14.469 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-11-02T09:25:14.514 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: libcephfs2-2:18.0.0-6872.g84d22000.el9.x86_64 13/246 2023-11-02T09:25:14.558 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-rados-2:18.0.0-6872.g84d22000.el9.x86_64 14/246 2023-11-02T09:25:14.593 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 15/246 2023-11-02T09:25:14.733 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 16/246 2023-11-02T09:25:14.771 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 17/246 2023-11-02T09:25:14.795 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : opus-1.3.1-10.el9.x86_64 18/246 2023-11-02T09:25:14.828 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 19/246 2023-11-02T09:25:14.953 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : lcms2-2.12-3.el9.x86_64 20/246 2023-11-02T09:25:15.004 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : atk-2.36.0-5.el9.x86_64 21/246 2023-11-02T09:25:15.032 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libcephsqlite-2:18.0.0-6872.g84d22000.el9.x86_64 22/246 2023-11-02T09:25:15.117 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6872.g84d22000.el9.x86_64 22/246 2023-11-02T09:25:15.141 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libradosstriper1-2:18.0.0-6872.g84d22000.el9.x86 23/246 2023-11-02T09:25:15.187 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6872.g84d22000.el9.x86 23/246 2023-11-02T09:25:15.212 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 24/246 2023-11-02T09:25:15.302 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 25/246 2023-11-02T09:25:15.338 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 26/246 2023-11-02T09:25:15.374 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : liboath-2.6.7-2.el9.x86_64 27/246 2023-11-02T09:25:15.398 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 28/246 2023-11-02T09:25:15.469 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : mesa-libglapi-23.1.4-1.el9.x86_64 29/246 2023-11-02T09:25:15.521 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 30/246 2023-11-02T09:25:15.552 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 31/246 2023-11-02T09:25:15.595 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 32/246 2023-11-02T09:25:15.631 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 33/246 2023-11-02T09:25:15.665 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : fuse-2.9.9-15.el9.x86_64 34/246 2023-11-02T09:25:15.735 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : cups-libs-1:2.3.3op2-21.el9.x86_64 35/246 2023-11-02T09:25:15.769 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 36/246 2023-11-02T09:25:15.804 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 37/246 2023-11-02T09:25:15.838 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 38/246 2023-11-02T09:25:15.864 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 39/246 2023-11-02T09:25:15.891 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libtool-ltdl-2.4.6-45.el9.x86_64 40/246 2023-11-02T09:25:15.924 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 41/246 2023-11-02T09:25:15.949 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 42/246 2023-11-02T09:25:15.990 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 43/246 2023-11-02T09:25:16.023 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : dconf-0.40.0-6.el9.x86_64 44/246 2023-11-02T09:25:16.099 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 44/246 2023-11-02T09:25:16.156 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-ceph-common-2:18.0.0-6872.g84d22000.el9. 45/246 2023-11-02T09:25:16.209 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-ceph-argparse-2:18.0.0-6872.g84d22000.el 46/246 2023-11-02T09:25:16.281 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-cephfs-2:18.0.0-6872.g84d22000.el9.x86_6 47/246 2023-11-02T09:25:16.417 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 48/246 2023-11-02T09:25:16.468 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 49/246 2023-11-02T09:25:17.000 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-rsa-4.9-2.el9.noarch 50/246 2023-11-02T09:25:17.081 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 51/246 2023-11-02T09:25:17.143 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 52/246 2023-11-02T09:25:17.182 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 53/246 2023-11-02T09:25:17.218 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 54/246 2023-11-02T09:25:17.247 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 55/246 2023-11-02T09:25:17.272 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 56/246 2023-11-02T09:25:17.308 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 57/246 2023-11-02T09:25:17.345 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : librados-devel-2:18.0.0-6872.g84d22000.el9.x86_6 58/246 2023-11-02T09:25:17.377 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 59/246 2023-11-02T09:25:17.413 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 60/246 2023-11-02T09:25:17.453 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 61/246 2023-11-02T09:25:17.519 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 62/246 2023-11-02T09:25:17.549 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 63/246 2023-11-02T09:25:17.583 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 64/246 2023-11-02T09:25:17.700 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : re2-1:20211101-3.el9.x86_64 65/246 2023-11-02T09:25:17.737 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 66/246 2023-11-02T09:25:17.792 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 67/246 2023-11-02T09:25:17.866 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 68/246 2023-11-02T09:25:17.904 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 69/246 2023-11-02T09:25:17.941 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 70/246 2023-11-02T09:25:17.988 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 71/246 2023-11-02T09:25:18.034 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 72/246 2023-11-02T09:25:18.076 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 73/246 2023-11-02T09:25:18.211 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 74/246 2023-11-02T09:25:18.261 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 75/246 2023-11-02T09:25:18.302 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 76/246 2023-11-02T09:25:18.398 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 77/246 2023-11-02T09:25:18.436 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-google-auth-1:2.23.3-1.el9.noarch 78/246 2023-11-02T09:25:18.477 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 79/246 2023-11-02T09:25:18.518 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 80/246 2023-11-02T09:25:18.545 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 81/246 2023-11-02T09:25:19.014 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : fmt-8.1.1-5.el9.x86_64 82/246 2023-11-02T09:25:19.065 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : osinfo-db-20230518-1.el9.noarch 83/246 2023-11-02T09:25:19.097 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : lua-5.4.4-4.el9.x86_64 84/246 2023-11-02T09:25:19.127 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 85/246 2023-11-02T09:25:19.350 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : flatpak-session-helper-1.12.8-1.el9.x86_64 86/246 2023-11-02T09:25:19.382 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : flatpak-selinux-1.12.8-1.el9.noarch 87/246 2023-11-02T09:25:22.874 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2023-11-02T09:25:23.013 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x86_64 1/1 2023-11-02T09:25:23.217 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-11-02T09:25:23.342 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/246 2023-11-02T09:25:23.434 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : alsa-lib-1.2.9-1.el9.x86_64 2/246 2023-11-02T09:25:23.496 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 3/246 2023-11-02T09:25:23.520 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 4/246 2023-11-02T09:25:23.552 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libXi-1.7.10-8.el9.x86_64 5/246 2023-11-02T09:25:23.587 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 6/246 2023-11-02T09:25:23.621 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/246 2023-11-02T09:25:23.648 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/246 2023-11-02T09:25:23.671 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/246 2023-11-02T09:25:23.726 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libX11-xcb-1.7.0-8.el9.x86_64 10/246 2023-11-02T09:25:24.046 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 11/246 2023-11-02T09:25:24.115 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : librados2-2:18.0.0-6872.g84d22000.el9.x86_64 12/246 2023-11-02T09:25:24.225 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librados2-2:18.0.0-6872.g84d22000.el9.x86_64 12/246 2023-11-02T09:25:24.280 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libcephfs2-2:18.0.0-6872.g84d22000.el9.x86_64 13/246 2023-11-02T09:25:24.324 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libcephfs2-2:18.0.0-6872.g84d22000.el9.x86_64 13/246 2023-11-02T09:25:24.367 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-rados-2:18.0.0-6872.g84d22000.el9.x86_64 14/246 2023-11-02T09:25:24.396 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 15/246 2023-11-02T09:25:24.526 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 16/246 2023-11-02T09:25:24.567 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 17/246 2023-11-02T09:25:24.590 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : opus-1.3.1-10.el9.x86_64 18/246 2023-11-02T09:25:24.628 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 19/246 2023-11-02T09:25:24.742 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : lcms2-2.12-3.el9.x86_64 20/246 2023-11-02T09:25:24.791 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : atk-2.36.0-5.el9.x86_64 21/246 2023-11-02T09:25:24.819 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libcephsqlite-2:18.0.0-6872.g84d22000.el9.x86_64 22/246 2023-11-02T09:25:24.921 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6872.g84d22000.el9.x86_64 22/246 2023-11-02T09:25:24.945 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libradosstriper1-2:18.0.0-6872.g84d22000.el9.x86 23/246 2023-11-02T09:25:24.991 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6872.g84d22000.el9.x86 23/246 2023-11-02T09:25:25.015 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 24/246 2023-11-02T09:25:25.107 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 25/246 2023-11-02T09:25:25.142 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 26/246 2023-11-02T09:25:25.178 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : liboath-2.6.7-2.el9.x86_64 27/246 2023-11-02T09:25:25.210 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 28/246 2023-11-02T09:25:25.289 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : mesa-libglapi-23.1.4-1.el9.x86_64 29/246 2023-11-02T09:25:25.342 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 30/246 2023-11-02T09:25:25.372 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 31/246 2023-11-02T09:25:25.407 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 32/246 2023-11-02T09:25:25.443 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 33/246 2023-11-02T09:25:25.476 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : fuse-2.9.9-15.el9.x86_64 34/246 2023-11-02T09:25:25.548 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : cups-libs-1:2.3.3op2-21.el9.x86_64 35/246 2023-11-02T09:25:25.589 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 36/246 2023-11-02T09:25:25.625 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 37/246 2023-11-02T09:25:25.656 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 38/246 2023-11-02T09:25:25.684 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 39/246 2023-11-02T09:25:25.712 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libtool-ltdl-2.4.6-45.el9.x86_64 40/246 2023-11-02T09:25:25.745 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 41/246 2023-11-02T09:25:25.769 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 42/246 2023-11-02T09:25:25.817 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 43/246 2023-11-02T09:25:25.843 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : dconf-0.40.0-6.el9.x86_64 44/246 2023-11-02T09:25:25.919 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 44/246 2023-11-02T09:25:25.951 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-ceph-common-2:18.0.0-6872.g84d22000.el9. 45/246 2023-11-02T09:25:25.995 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-ceph-argparse-2:18.0.0-6872.g84d22000.el 46/246 2023-11-02T09:25:26.069 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cephfs-2:18.0.0-6872.g84d22000.el9.x86_6 47/246 2023-11-02T09:25:26.209 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 48/246 2023-11-02T09:25:26.256 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 49/246 2023-11-02T09:25:26.797 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-rsa-4.9-2.el9.noarch 50/246 2023-11-02T09:25:26.882 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 51/246 2023-11-02T09:25:26.953 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 52/246 2023-11-02T09:25:27.006 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 53/246 2023-11-02T09:25:27.043 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 54/246 2023-11-02T09:25:27.073 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 55/246 2023-11-02T09:25:27.098 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 56/246 2023-11-02T09:25:27.134 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 57/246 2023-11-02T09:25:27.172 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : librados-devel-2:18.0.0-6872.g84d22000.el9.x86_6 58/246 2023-11-02T09:25:27.202 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 59/246 2023-11-02T09:25:27.239 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 60/246 2023-11-02T09:25:27.278 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 61/246 2023-11-02T09:25:27.336 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 62/246 2023-11-02T09:25:27.371 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 63/246 2023-11-02T09:25:27.406 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 64/246 2023-11-02T09:25:27.512 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : re2-1:20211101-3.el9.x86_64 65/246 2023-11-02T09:25:27.551 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 66/246 2023-11-02T09:25:27.608 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 67/246 2023-11-02T09:25:27.680 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 68/246 2023-11-02T09:25:27.710 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 69/246 2023-11-02T09:25:27.747 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 70/246 2023-11-02T09:25:27.794 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 71/246 2023-11-02T09:25:27.839 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 72/246 2023-11-02T09:25:27.882 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 73/246 2023-11-02T09:25:28.027 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 74/246 2023-11-02T09:25:28.197 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: flatpak-selinux-1.12.8-1.el9.noarch 87/246 2023-11-02T09:25:28.217 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 75/246 2023-11-02T09:25:28.240 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : avahi-glib-0.8-12.el9.x86_64 88/246 2023-11-02T09:25:28.297 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-ply-3.11-14.el9.noarch 89/246 2023-11-02T09:25:28.353 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 90/246 2023-11-02T09:25:28.363 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 76/246 2023-11-02T09:25:28.541 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 77/246 2023-11-02T09:25:28.555 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 91/246 2023-11-02T09:25:28.581 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-google-auth-1:2.23.3-1.el9.noarch 78/246 2023-11-02T09:25:28.602 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 92/246 2023-11-02T09:25:28.625 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 79/246 2023-11-02T09:25:28.657 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 80/246 2023-11-02T09:25:28.684 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 81/246 2023-11-02T09:25:28.732 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 93/246 2023-11-02T09:25:28.780 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 94/246 2023-11-02T09:25:28.810 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 95/246 2023-11-02T09:25:28.843 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 96/246 2023-11-02T09:25:28.880 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 97/246 2023-11-02T09:25:28.914 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 98/246 2023-11-02T09:25:28.953 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libpciaccess-0.16-6.el9.x86_64 99/246 2023-11-02T09:25:28.981 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libdrm-2.4.115-1.el9.x86_64 100/246 2023-11-02T09:25:29.008 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : mesa-libgbm-23.1.4-1.el9.x86_64 101/246 2023-11-02T09:25:29.033 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : mesa-libEGL-23.1.4-1.el9.x86_64 102/246 2023-11-02T09:25:29.070 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 103/246 2023-11-02T09:25:29.169 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : fmt-8.1.1-5.el9.x86_64 82/246 2023-11-02T09:25:29.212 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : osinfo-db-20230518-1.el9.noarch 83/246 2023-11-02T09:25:29.246 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : lua-5.4.4-4.el9.x86_64 84/246 2023-11-02T09:25:29.277 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 85/246 2023-11-02T09:25:29.290 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : vulkan-loader-1.3.250.1-1.el9.x86_64 104/246 2023-11-02T09:25:29.319 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : flatpak-session-helper-1.12.8-1.el9.x86_64 86/246 2023-11-02T09:25:29.320 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : mesa-vulkan-drivers-23.1.4-1.el9.x86_64 105/246 2023-11-02T09:25:29.345 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : bubblewrap-0.4.1-6.el9.x86_64 106/246 2023-11-02T09:25:29.346 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : flatpak-selinux-1.12.8-1.el9.noarch 87/246 2023-11-02T09:25:29.377 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : bluez-libs-5.64-1.el9.x86_64 107/246 2023-11-02T09:25:29.407 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 108/246 2023-11-02T09:25:29.605 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 109/246 2023-11-02T09:25:29.642 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 110/246 2023-11-02T09:25:29.675 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 111/246 2023-11-02T09:25:29.704 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 112/246 2023-11-02T09:25:29.752 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 113/246 2023-11-02T09:25:29.800 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : upower-0.99.11-11.el9.x86_64 114/246 2023-11-02T09:25:29.817 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 114/246 2023-11-02T09:25:29.817 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2023-11-02T09:25:29.818 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-11-02T09:25:29.987 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : tzdata-java-2023c-1.el9.noarch 115/246 2023-11-02T09:25:30.060 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 116/246 2023-11-02T09:25:30.114 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 117/246 2023-11-02T09:25:30.139 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 118/246 2023-11-02T09:25:30.161 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 118/246 2023-11-02T09:25:30.191 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 119/246 2023-11-02T09:25:30.548 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: rtkit-0.11-28.el9.x86_64 120/246 2023-11-02T09:25:30.578 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : rtkit-0.11-28.el9.x86_64 120/246 2023-11-02T09:25:30.589 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: rtkit-0.11-28.el9.x86_64 120/246 2023-11-02T09:25:30.589 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2023-11-02T09:25:30.590 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-11-02T09:25:30.634 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 121/246 2023-11-02T09:25:30.709 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 122/246 2023-11-02T09:25:30.753 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 123/246 2023-11-02T09:25:30.786 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 124/246 2023-11-02T09:25:30.827 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 125/246 2023-11-02T09:25:30.862 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 126/246 2023-11-02T09:25:30.951 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 127/246 2023-11-02T09:25:30.982 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 128/246 2023-11-02T09:25:31.083 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 129/246 2023-11-02T09:25:31.132 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 130/246 2023-11-02T09:25:31.862 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 131/246 2023-11-02T09:25:31.905 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 132/246 2023-11-02T09:25:31.938 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 133/246 2023-11-02T09:25:32.036 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 134/246 2023-11-02T09:25:32.236 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 135/246 2023-11-02T09:25:32.277 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 136/246 2023-11-02T09:25:32.310 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : p11-kit-server-0.24.1-2.el9.x86_64 137/246 2023-11-02T09:25:32.350 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ostree-libs-2023.6-1.el9.x86_64 138/246 2023-11-02T09:25:32.398 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 139/246 2023-11-02T09:25:32.437 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 140/246 2023-11-02T09:25:32.471 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : orc-0.4.31-6.el9.x86_64 141/246 2023-11-02T09:25:32.504 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 142/246 2023-11-02T09:25:32.684 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : openblas-0.3.21-2.el9.x86_64 143/246 2023-11-02T09:25:32.710 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 144/246 2023-11-02T09:25:32.788 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 145/246 2023-11-02T09:25:33.445 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 146/246 2023-11-02T09:25:33.583 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 147/246 2023-11-02T09:25:34.828 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 148/246 2023-11-02T09:25:34.911 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 149/246 2023-11-02T09:25:34.942 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 150/246 2023-11-02T09:25:34.996 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : jq-1.6-15.el9.x86_64 151/246 2023-11-02T09:25:35.024 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : lua-posix-35.0-8.el9.x86_64 152/246 2023-11-02T09:25:35.053 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 153/246 2023-11-02T09:25:35.107 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 154/246 2023-11-02T09:25:35.118 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 154/246 2023-11-02T09:25:35.118 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2023-11-02T09:25:35.119 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-11-02T09:25:35.151 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 155/246 2023-11-02T09:25:35.180 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libsbc-1.4-9.el9.x86_64 156/246 2023-11-02T09:25:35.477 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 157/246 2023-11-02T09:25:35.510 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : librbd1-2:18.0.0-6872.g84d22000.el9.x86_64 158/246 2023-11-02T09:25:35.591 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: librbd1-2:18.0.0-6872.g84d22000.el9.x86_64 158/246 2023-11-02T09:25:35.624 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-rbd-2:18.0.0-6872.g84d22000.el9.x86_64 159/246 2023-11-02T09:25:35.654 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 160/246 2023-11-02T09:25:36.049 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 161/246 2023-11-02T09:25:36.075 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 161/246 2023-11-02T09:25:36.097 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 161/246 2023-11-02T09:25:36.126 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 162/246 2023-11-02T09:25:36.187 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libiptcdata-1.0.5-9.el9.x86_64 163/246 2023-11-02T09:25:36.217 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 164/246 2023-11-02T09:25:36.243 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 165/246 2023-11-02T09:25:36.285 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 166/246 2023-11-02T09:25:36.299 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 167/246 2023-11-02T09:25:36.560 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 167/246 2023-11-02T09:25:36.609 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libexif-0.6.22-6.el9.x86_64 168/246 2023-11-02T09:25:36.637 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libepoxy-1.5.5-4.el9.x86_64 169/246 2023-11-02T09:25:36.664 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libasyncns-0.8-22.el9.x86_64 170/246 2023-11-02T09:25:36.691 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 171/246 2023-11-02T09:25:36.724 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 172/246 2023-11-02T09:25:36.748 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : mesa-libGL-23.1.4-1.el9.x86_64 173/246 2023-11-02T09:25:36.773 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libXv-1.0.11-16.el9.x86_64 174/246 2023-11-02T09:25:36.799 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 175/246 2023-11-02T09:25:36.827 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 176/246 2023-11-02T09:25:36.854 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 177/246 2023-11-02T09:25:36.894 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libtiff-4.4.0-10.el9.x86_64 178/246 2023-11-02T09:25:36.930 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : gdk-pixbuf2-modules-2.42.6-3.el9.x86_64 179/246 2023-11-02T09:25:36.994 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 180/246 2023-11-02T09:25:37.022 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : poppler-21.01.0-19.el9.x86_64 181/246 2023-11-02T09:25:37.057 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : poppler-glib-21.01.0-19.el9.x86_64 182/246 2023-11-02T09:25:37.946 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : javapackages-filesystem-6.0.0-4.el9.noarch 183/246 2023-11-02T09:25:37.992 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x8 184/246 2023-11-02T09:25:38.194 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: flatpak-selinux-1.12.8-1.el9.noarch 87/246 2023-11-02T09:25:38.247 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : avahi-glib-0.8-12.el9.x86_64 88/246 2023-11-02T09:25:38.303 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-ply-3.11-14.el9.noarch 89/246 2023-11-02T09:25:38.360 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 90/246 2023-11-02T09:25:38.556 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 91/246 2023-11-02T09:25:38.609 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 92/246 2023-11-02T09:25:38.751 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 93/246 2023-11-02T09:25:38.777 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x8 184/246 2023-11-02T09:25:38.795 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 94/246 2023-11-02T09:25:38.824 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 95/246 2023-11-02T09:25:38.873 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 96/246 2023-11-02T09:25:38.900 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 185/246 2023-11-02T09:25:38.932 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 97/246 2023-11-02T09:25:38.961 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 186/246 2023-11-02T09:25:38.965 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 98/246 2023-11-02T09:25:38.987 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : gtk-update-icon-cache-3.24.31-2.el9.x86_64 187/246 2023-11-02T09:25:39.007 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libpciaccess-0.16-6.el9.x86_64 99/246 2023-11-02T09:25:39.015 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : gsm-1.0.19-6.el9.x86_64 188/246 2023-11-02T09:25:39.039 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libdrm-2.4.115-1.el9.x86_64 100/246 2023-11-02T09:25:39.068 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : mesa-libgbm-23.1.4-1.el9.x86_64 101/246 2023-11-02T09:25:39.090 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libsndfile-1.0.31-7.el9.x86_64 189/246 2023-11-02T09:25:39.100 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : mesa-libEGL-23.1.4-1.el9.x86_64 102/246 2023-11-02T09:25:39.129 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 190/246 2023-11-02T09:25:39.139 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 103/246 2023-11-02T09:25:39.164 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : pulseaudio-utils-15.0-2.el9.x86_64 191/246 2023-11-02T09:25:39.199 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libcanberra-0.30-27.el9.x86_64 192/246 2023-11-02T09:25:39.216 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 192/246 2023-11-02T09:25:39.326 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : graphene-1.10.6-2.el9.x86_64 193/246 2023-11-02T09:25:39.365 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : gstreamer1-plugins-base-1.22.1-1.el9.x86_64 194/246 2023-11-02T09:25:39.393 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : vulkan-loader-1.3.250.1-1.el9.x86_64 104/246 2023-11-02T09:25:39.401 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : giflib-5.2.1-9.el9.x86_64 195/246 2023-11-02T09:25:39.428 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : mesa-vulkan-drivers-23.1.4-1.el9.x86_64 105/246 2023-11-02T09:25:39.429 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 196/246 2023-11-02T09:25:39.453 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : bubblewrap-0.4.1-6.el9.x86_64 106/246 2023-11-02T09:25:39.485 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : bluez-libs-5.64-1.el9.x86_64 107/246 2023-11-02T09:25:39.516 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 108/246 2023-11-02T09:25:39.717 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 109/246 2023-11-02T09:25:39.761 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 110/246 2023-11-02T09:25:39.792 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 111/246 2023-11-02T09:25:39.822 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 112/246 2023-11-02T09:25:39.857 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: pipewire-0.3.67-2.el9.x86_64 197/246 2023-11-02T09:25:39.873 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 113/246 2023-11-02T09:25:39.884 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : pipewire-0.3.67-2.el9.x86_64 197/246 2023-11-02T09:25:39.898 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: pipewire-0.3.67-2.el9.x86_64 197/246 2023-11-02T09:25:39.898 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2023-11-02T09:25:39.899 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-11-02T09:25:39.901 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : upower-0.99.11-11.el9.x86_64 114/246 2023-11-02T09:25:39.916 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 114/246 2023-11-02T09:25:39.916 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2023-11-02T09:25:39.917 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:25:40.088 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : tzdata-java-2023c-1.el9.noarch 115/246 2023-11-02T09:25:40.110 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : pipewire-libs-0.3.67-2.el9.x86_64 198/246 2023-11-02T09:25:40.161 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 116/246 2023-11-02T09:25:40.176 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 199/246 2023-11-02T09:25:40.206 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 117/246 2023-11-02T09:25:40.232 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 118/246 2023-11-02T09:25:40.255 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 118/246 2023-11-02T09:25:40.256 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 200/246 2023-11-02T09:25:40.284 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 119/246 2023-11-02T09:25:40.287 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : xdg-desktop-portal-1.12.4-1.el9.x86_64 201/246 2023-11-02T09:25:40.307 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: xdg-desktop-portal-1.12.4-1.el9.x86_64 201/246 2023-11-02T09:25:40.714 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: rtkit-0.11-28.el9.x86_64 120/246 2023-11-02T09:25:40.746 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : rtkit-0.11-28.el9.x86_64 120/246 2023-11-02T09:25:40.758 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: rtkit-0.11-28.el9.x86_64 120/246 2023-11-02T09:25:40.759 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2023-11-02T09:25:40.763 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:25:40.802 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 121/246 2023-11-02T09:25:40.837 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: flatpak-1.12.8-1.el9.x86_64 202/246 2023-11-02T09:25:40.877 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 122/246 2023-11-02T09:25:40.879 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : flatpak-1.12.8-1.el9.x86_64 202/246 2023-11-02T09:25:40.912 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 123/246 2023-11-02T09:25:40.925 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 203/246 2023-11-02T09:25:40.946 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 124/246 2023-11-02T09:25:40.987 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 125/246 2023-11-02T09:25:41.000 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 204/246 2023-11-02T09:25:41.022 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 126/246 2023-11-02T09:25:41.032 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : tracker-3.1.2-3.el9.x86_64 205/246 2023-11-02T09:25:41.110 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 127/246 2023-11-02T09:25:41.133 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 205/246 2023-11-02T09:25:41.179 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : tracker-miners-3.1.2-3.el9.x86_64 206/246 2023-11-02T09:25:41.183 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 128/246 2023-11-02T09:25:41.192 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: tracker-miners-3.1.2-3.el9.x86_64 206/246 2023-11-02T09:25:41.227 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 207/246 2023-11-02T09:25:41.284 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 129/246 2023-11-02T09:25:41.335 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 130/246 2023-11-02T09:25:41.653 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 208/246 2023-11-02T09:25:41.689 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : librgw2-2:18.0.0-6872.g84d22000.el9.x86_64 209/246 2023-11-02T09:25:41.760 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: librgw2-2:18.0.0-6872.g84d22000.el9.x86_64 209/246 2023-11-02T09:25:41.783 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-rgw-2:18.0.0-6872.g84d22000.el9.x86_64 210/246 2023-11-02T09:25:42.070 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 131/246 2023-11-02T09:25:42.114 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 132/246 2023-11-02T09:25:42.148 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 133/246 2023-11-02T09:25:42.248 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 134/246 2023-11-02T09:25:42.439 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 135/246 2023-11-02T09:25:42.479 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 136/246 2023-11-02T09:25:42.511 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : p11-kit-server-0.24.1-2.el9.x86_64 137/246 2023-11-02T09:25:42.552 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ostree-libs-2023.6-1.el9.x86_64 138/246 2023-11-02T09:25:42.600 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 139/246 2023-11-02T09:25:42.647 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 140/246 2023-11-02T09:25:42.681 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : orc-0.4.31-6.el9.x86_64 141/246 2023-11-02T09:25:42.722 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 142/246 2023-11-02T09:25:42.904 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : openblas-0.3.21-2.el9.x86_64 143/246 2023-11-02T09:25:42.936 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 144/246 2023-11-02T09:25:43.015 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 145/246 2023-11-02T09:25:43.674 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 146/246 2023-11-02T09:25:43.777 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 147/246 2023-11-02T09:25:43.855 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-common-2:18.0.0-6872.g84d22000.el9.x86_64 211/246 2023-11-02T09:25:43.888 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-common-2:18.0.0-6872.g84d22000.el9.x86_64 211/246 2023-11-02T09:25:44.441 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-common-2:18.0.0-6872.g84d22000.el9.x86_64 211/246 2023-11-02T09:25:44.483 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-base-2:18.0.0-6872.g84d22000.el9.x86_64 212/246 2023-11-02T09:25:44.563 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-base-2:18.0.0-6872.g84d22000.el9.x86_64 212/246 2023-11-02T09:25:44.563 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-11-02T09:25:44.563 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-11-02T09:25:44.564 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-11-02T09:25:44.592 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-selinux-2:18.0.0-6872.g84d22000.el9.x86_64 213/246 2023-11-02T09:25:45.069 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 148/246 2023-11-02T09:25:45.165 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 149/246 2023-11-02T09:25:45.196 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 150/246 2023-11-02T09:25:45.254 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : jq-1.6-15.el9.x86_64 151/246 2023-11-02T09:25:45.287 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : lua-posix-35.0-8.el9.x86_64 152/246 2023-11-02T09:25:45.314 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 153/246 2023-11-02T09:25:45.336 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 154/246 2023-11-02T09:25:45.346 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 154/246 2023-11-02T09:25:45.347 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2023-11-02T09:25:45.347 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:25:45.389 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 155/246 2023-11-02T09:25:45.417 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libsbc-1.4-9.el9.x86_64 156/246 2023-11-02T09:25:45.722 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 157/246 2023-11-02T09:25:45.755 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : librbd1-2:18.0.0-6872.g84d22000.el9.x86_64 158/246 2023-11-02T09:25:45.846 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librbd1-2:18.0.0-6872.g84d22000.el9.x86_64 158/246 2023-11-02T09:25:45.879 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-rbd-2:18.0.0-6872.g84d22000.el9.x86_64 159/246 2023-11-02T09:25:45.908 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 160/246 2023-11-02T09:25:46.323 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 161/246 2023-11-02T09:25:46.354 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 161/246 2023-11-02T09:25:46.383 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 161/246 2023-11-02T09:25:46.412 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 162/246 2023-11-02T09:25:46.474 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libiptcdata-1.0.5-9.el9.x86_64 163/246 2023-11-02T09:25:46.511 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 164/246 2023-11-02T09:25:46.537 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 165/246 2023-11-02T09:25:46.578 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 166/246 2023-11-02T09:25:46.602 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 167/246 2023-11-02T09:25:46.850 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 167/246 2023-11-02T09:25:46.904 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libexif-0.6.22-6.el9.x86_64 168/246 2023-11-02T09:25:46.932 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libepoxy-1.5.5-4.el9.x86_64 169/246 2023-11-02T09:25:46.957 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libasyncns-0.8-22.el9.x86_64 170/246 2023-11-02T09:25:46.985 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 171/246 2023-11-02T09:25:47.018 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 172/246 2023-11-02T09:25:47.042 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : mesa-libGL-23.1.4-1.el9.x86_64 173/246 2023-11-02T09:25:47.068 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libXv-1.0.11-16.el9.x86_64 174/246 2023-11-02T09:25:47.093 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 175/246 2023-11-02T09:25:47.121 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 176/246 2023-11-02T09:25:47.149 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 177/246 2023-11-02T09:25:47.196 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libtiff-4.4.0-10.el9.x86_64 178/246 2023-11-02T09:25:47.232 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : gdk-pixbuf2-modules-2.42.6-3.el9.x86_64 179/246 2023-11-02T09:25:47.280 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 180/246 2023-11-02T09:25:47.308 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : poppler-21.01.0-19.el9.x86_64 181/246 2023-11-02T09:25:47.333 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : poppler-glib-21.01.0-19.el9.x86_64 182/246 2023-11-02T09:25:48.214 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : javapackages-filesystem-6.0.0-4.el9.noarch 183/246 2023-11-02T09:25:48.253 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x8 184/246 2023-11-02T09:25:49.007 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x8 184/246 2023-11-02T09:25:49.141 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 185/246 2023-11-02T09:25:49.198 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 186/246 2023-11-02T09:25:49.224 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : gtk-update-icon-cache-3.24.31-2.el9.x86_64 187/246 2023-11-02T09:25:49.252 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : gsm-1.0.19-6.el9.x86_64 188/246 2023-11-02T09:25:49.319 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libsndfile-1.0.31-7.el9.x86_64 189/246 2023-11-02T09:25:49.357 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 190/246 2023-11-02T09:25:49.397 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : pulseaudio-utils-15.0-2.el9.x86_64 191/246 2023-11-02T09:25:49.427 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libcanberra-0.30-27.el9.x86_64 192/246 2023-11-02T09:25:49.446 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 192/246 2023-11-02T09:25:49.554 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : graphene-1.10.6-2.el9.x86_64 193/246 2023-11-02T09:25:49.594 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : gstreamer1-plugins-base-1.22.1-1.el9.x86_64 194/246 2023-11-02T09:25:49.621 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : giflib-5.2.1-9.el9.x86_64 195/246 2023-11-02T09:25:49.650 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 196/246 2023-11-02T09:25:50.062 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: pipewire-0.3.67-2.el9.x86_64 197/246 2023-11-02T09:25:50.087 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : pipewire-0.3.67-2.el9.x86_64 197/246 2023-11-02T09:25:50.103 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: pipewire-0.3.67-2.el9.x86_64 197/246 2023-11-02T09:25:50.103 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2023-11-02T09:25:50.103 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:25:50.323 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : pipewire-libs-0.3.67-2.el9.x86_64 198/246 2023-11-02T09:25:50.391 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 199/246 2023-11-02T09:25:50.471 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 200/246 2023-11-02T09:25:50.502 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : xdg-desktop-portal-1.12.4-1.el9.x86_64 201/246 2023-11-02T09:25:50.523 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: xdg-desktop-portal-1.12.4-1.el9.x86_64 201/246 2023-11-02T09:25:51.001 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: flatpak-1.12.8-1.el9.x86_64 202/246 2023-11-02T09:25:51.052 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : flatpak-1.12.8-1.el9.x86_64 202/246 2023-11-02T09:25:51.112 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 203/246 2023-11-02T09:25:51.183 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 204/246 2023-11-02T09:25:51.220 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : tracker-3.1.2-3.el9.x86_64 205/246 2023-11-02T09:25:51.330 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 205/246 2023-11-02T09:25:51.368 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : tracker-miners-3.1.2-3.el9.x86_64 206/246 2023-11-02T09:25:51.382 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: tracker-miners-3.1.2-3.el9.x86_64 206/246 2023-11-02T09:25:51.424 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 207/246 2023-11-02T09:25:51.857 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 208/246 2023-11-02T09:25:51.886 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : librgw2-2:18.0.0-6872.g84d22000.el9.x86_64 209/246 2023-11-02T09:25:51.957 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librgw2-2:18.0.0-6872.g84d22000.el9.x86_64 209/246 2023-11-02T09:25:51.980 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-rgw-2:18.0.0-6872.g84d22000.el9.x86_64 210/246 2023-11-02T09:25:54.125 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-common-2:18.0.0-6872.g84d22000.el9.x86_64 211/246 2023-11-02T09:25:54.168 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-common-2:18.0.0-6872.g84d22000.el9.x86_64 211/246 2023-11-02T09:25:54.714 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-common-2:18.0.0-6872.g84d22000.el9.x86_64 211/246 2023-11-02T09:25:54.747 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-base-2:18.0.0-6872.g84d22000.el9.x86_64 212/246 2023-11-02T09:25:54.835 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-base-2:18.0.0-6872.g84d22000.el9.x86_64 212/246 2023-11-02T09:25:54.836 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-11-02T09:25:54.836 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-11-02T09:25:54.836 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:25:54.865 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-selinux-2:18.0.0-6872.g84d22000.el9.x86_64 213/246 2023-11-02T09:25:57.597 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6872.g84d22000.el9.x86_64 213/246 2023-11-02T09:25:57.598 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /sys 2023-11-02T09:25:57.598 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /proc 2023-11-02T09:25:57.598 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /mnt 2023-11-02T09:25:57.598 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /var/tmp 2023-11-02T09:25:57.598 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /home 2023-11-02T09:25:57.599 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /root 2023-11-02T09:25:57.599 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /tmp 2023-11-02T09:25:57.599 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-11-02T09:25:57.748 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-volume-2:18.0.0-6872.g84d22000.el9.noarch 214/246 2023-11-02T09:25:57.763 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-volume-2:18.0.0-6872.g84d22000.el9.noarch 214/246 2023-11-02T09:25:57.763 INFO:teuthology.orchestra.run.smithi186.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-02T09:25:57.764 INFO:teuthology.orchestra.run.smithi186.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-11-02T09:25:57.764 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-11-02T09:25:59.282 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-osd-2:18.0.0-6872.g84d22000.el9.x86_64 215/246 2023-11-02T09:25:59.308 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-osd-2:18.0.0-6872.g84d22000.el9.x86_64 215/246 2023-11-02T09:25:59.308 INFO:teuthology.orchestra.run.smithi186.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-02T09:25:59.308 INFO:teuthology.orchestra.run.smithi186.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-11-02T09:25:59.308 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-02T09:25:59.309 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-02T09:25:59.309 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-11-02T09:25:59.508 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mds-2:18.0.0-6872.g84d22000.el9.x86_64 216/246 2023-11-02T09:25:59.531 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-mds-2:18.0.0-6872.g84d22000.el9.x86_64 216/246 2023-11-02T09:25:59.531 INFO:teuthology.orchestra.run.smithi186.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-02T09:25:59.531 INFO:teuthology.orchestra.run.smithi186.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-11-02T09:25:59.532 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-02T09:25:59.532 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-02T09:25:59.532 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-11-02T09:25:59.984 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mon-2:18.0.0-6872.g84d22000.el9.x86_64 217/246 2023-11-02T09:26:00.008 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-mon-2:18.0.0-6872.g84d22000.el9.x86_64 217/246 2023-11-02T09:26:00.008 INFO:teuthology.orchestra.run.smithi186.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-02T09:26:00.008 INFO:teuthology.orchestra.run.smithi186.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-11-02T09:26:00.008 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-02T09:26:00.009 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-02T09:26:00.009 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-11-02T09:26:02.889 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 218/246 2023-11-02T09:26:02.991 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 219/246 2023-11-02T09:26:03.026 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 220/246 2023-11-02T09:26:03.043 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 220/246 2023-11-02T09:26:03.238 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 221/246 2023-11-02T09:26:03.275 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : gtk3-3.24.31-2.el9.x86_64 222/246 2023-11-02T09:26:03.698 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: cephadm-2:18.0.0-6872.g84d22000.el9.noarch 223/246 2023-11-02T09:26:03.723 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : cephadm-2:18.0.0-6872.g84d22000.el9.noarch 223/246 2023-11-02T09:26:03.752 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6872.g84d22000.e 224/246 2023-11-02T09:26:03.814 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6872.g84d22000. 225/246 2023-11-02T09:26:03.838 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6872.g84d22000.el9.noa 226/246 2023-11-02T09:26:04.062 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6872.g84d22000.el9.noa 226/246 2023-11-02T09:26:04.089 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6872.g84d22000.el9.n 227/246 2023-11-02T09:26:05.056 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6872.g84d22000.el9.n 227/246 2023-11-02T09:26:05.090 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6872.g84d 228/246 2023-11-02T09:26:05.189 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6872.g84d 228/246 2023-11-02T09:26:05.347 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6872.g84d22000.el 229/246 2023-11-02T09:26:05.375 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mgr-2:18.0.0-6872.g84d22000.el9.x86_64 230/246 2023-11-02T09:26:05.398 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6872.g84d22000.el9.x86_64 230/246 2023-11-02T09:26:05.398 INFO:teuthology.orchestra.run.smithi186.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-02T09:26:05.399 INFO:teuthology.orchestra.run.smithi186.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-11-02T09:26:05.399 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-02T09:26:05.399 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-02T09:26:05.399 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-11-02T09:26:05.442 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mgr-rook-2:18.0.0-6872.g84d22000.el9.noarch 231/246 2023-11-02T09:26:05.452 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6872.g84d22000.el9.noarch 231/246 2023-11-02T09:26:05.495 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-2:18.0.0-6872.g84d22000.el9.x86_64 232/246 2023-11-02T09:26:05.519 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : java-11-openjdk-1:11.0.18.0.10-3.el9.x86_64 233/246 2023-11-02T09:26:06.290 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: java-11-openjdk-1:11.0.18.0.10-3.el9.x86_64 233/246 2023-11-02T09:26:06.319 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-radosgw-2:18.0.0-6872.g84d22000.el9.x86_64 234/246 2023-11-02T09:26:06.342 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6872.g84d22000.el9.x86_64 234/246 2023-11-02T09:26:06.342 INFO:teuthology.orchestra.run.smithi186.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-02T09:26:06.342 INFO:teuthology.orchestra.run.smithi186.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-11-02T09:26:06.343 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-02T09:26:06.343 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-02T09:26:06.343 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-11-02T09:26:06.379 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6872.g84d22 235/246 2023-11-02T09:26:06.402 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6872.g84d22 235/246 2023-11-02T09:26:06.402 INFO:teuthology.orchestra.run.smithi186.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-02T09:26:06.403 INFO:teuthology.orchestra.run.smithi186.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-11-02T09:26:06.403 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-11-02T09:26:06.713 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : rbd-mirror-2:18.0.0-6872.g84d22000.el9.x86_64 236/246 2023-11-02T09:26:06.735 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6872.g84d22000.el9.x86_64 236/246 2023-11-02T09:26:06.735 INFO:teuthology.orchestra.run.smithi186.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-02T09:26:06.736 INFO:teuthology.orchestra.run.smithi186.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-11-02T09:26:06.736 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-02T09:26:06.737 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-02T09:26:06.737 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-11-02T09:26:08.223 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6872.g84d22000.el9.x86_64 213/246 2023-11-02T09:26:08.223 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /sys 2023-11-02T09:26:08.223 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /proc 2023-11-02T09:26:08.224 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /mnt 2023-11-02T09:26:08.224 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /var/tmp 2023-11-02T09:26:08.224 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /home 2023-11-02T09:26:08.224 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /root 2023-11-02T09:26:08.225 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /tmp 2023-11-02T09:26:08.225 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:26:08.382 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-volume-2:18.0.0-6872.g84d22000.el9.noarch 214/246 2023-11-02T09:26:08.398 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-volume-2:18.0.0-6872.g84d22000.el9.noarch 214/246 2023-11-02T09:26:08.398 INFO:teuthology.orchestra.run.smithi156.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-02T09:26:08.399 INFO:teuthology.orchestra.run.smithi156.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-11-02T09:26:08.399 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:26:09.977 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-osd-2:18.0.0-6872.g84d22000.el9.x86_64 215/246 2023-11-02T09:26:10.003 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-osd-2:18.0.0-6872.g84d22000.el9.x86_64 215/246 2023-11-02T09:26:10.004 INFO:teuthology.orchestra.run.smithi156.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-02T09:26:10.004 INFO:teuthology.orchestra.run.smithi156.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-11-02T09:26:10.004 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-02T09:26:10.005 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-02T09:26:10.005 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:26:10.202 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mds-2:18.0.0-6872.g84d22000.el9.x86_64 216/246 2023-11-02T09:26:10.226 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mds-2:18.0.0-6872.g84d22000.el9.x86_64 216/246 2023-11-02T09:26:10.227 INFO:teuthology.orchestra.run.smithi156.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-02T09:26:10.227 INFO:teuthology.orchestra.run.smithi156.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-11-02T09:26:10.227 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-02T09:26:10.227 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-02T09:26:10.227 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:26:10.629 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-test-2:18.0.0-6872.g84d22000.el9.x86_64 237/246 2023-11-02T09:26:10.670 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mon-2:18.0.0-6872.g84d22000.el9.x86_64 217/246 2023-11-02T09:26:10.673 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : pipewire-alsa-0.3.67-2.el9.x86_64 238/246 2023-11-02T09:26:10.692 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mon-2:18.0.0-6872.g84d22000.el9.x86_64 217/246 2023-11-02T09:26:10.693 INFO:teuthology.orchestra.run.smithi156.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-02T09:26:10.693 INFO:teuthology.orchestra.run.smithi156.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-11-02T09:26:10.693 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-02T09:26:10.693 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-02T09:26:10.693 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:26:10.712 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : pipewire-jack-audio-connection-kit-0.3.67-2.el9. 239/246 2023-11-02T09:26:10.735 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : pipewire-pulseaudio-0.3.67-2.el9.x86_64 240/246 2023-11-02T09:26:10.749 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: pipewire-pulseaudio-0.3.67-2.el9.x86_64 240/246 2023-11-02T09:26:10.750 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2023-11-02T09:26:10.750 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-11-02T09:26:10.801 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : rbd-fuse-2:18.0.0-6872.g84d22000.el9.x86_64 241/246 2023-11-02T09:26:10.832 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : rbd-nbd-2:18.0.0-6872.g84d22000.el9.x86_64 242/246 2023-11-02T09:26:10.925 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libcephfs-devel-2:18.0.0-6872.g84d22000.el9.x86_ 243/246 2023-11-02T09:26:10.957 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-fuse-2:18.0.0-6872.g84d22000.el9.x86_64 244/246 2023-11-02T09:26:10.957 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 245/246 2023-11-02T09:26:11.049 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 245/246 2023-11-02T09:26:11.049 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 246/246 2023-11-02T09:26:11.140 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 246/246 2023-11-02T09:26:11.157 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 246/246 2023-11-02T09:26:11.162 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 246/246 2023-11-02T09:26:11.178 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x8 246/246 2023-11-02T09:26:11.187 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 246/246 2023-11-02T09:26:11.187 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2023-11-02T09:26:11.188 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2023-11-02T09:26:11.188 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-11-02T09:26:11.303 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: java-11-openjdk-1:11.0.18.0.10-3.el9.x86_64 246/246 2023-11-02T09:26:13.579 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 218/246 2023-11-02T09:26:13.674 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 219/246 2023-11-02T09:26:13.701 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 220/246 2023-11-02T09:26:13.718 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 220/246 2023-11-02T09:26:13.906 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 221/246 2023-11-02T09:26:13.950 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : gtk3-3.24.31-2.el9.x86_64 222/246 2023-11-02T09:26:14.366 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: cephadm-2:18.0.0-6872.g84d22000.el9.noarch 223/246 2023-11-02T09:26:14.399 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : cephadm-2:18.0.0-6872.g84d22000.el9.noarch 223/246 2023-11-02T09:26:14.436 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6872.g84d22000.e 224/246 2023-11-02T09:26:14.498 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6872.g84d22000. 225/246 2023-11-02T09:26:14.522 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6872.g84d22000.el9.noa 226/246 2023-11-02T09:26:14.747 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6872.g84d22000.el9.noa 226/246 2023-11-02T09:26:14.773 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6872.g84d22000.el9.n 227/246 2023-11-02T09:26:15.733 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6872.g84d22000.el9.n 227/246 2023-11-02T09:26:15.757 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6872.g84d 228/246 2023-11-02T09:26:15.858 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6872.g84d 228/246 2023-11-02T09:26:16.014 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6872.g84d22000.el 229/246 2023-11-02T09:26:16.050 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-2:18.0.0-6872.g84d22000.el9.x86_64 230/246 2023-11-02T09:26:16.074 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6872.g84d22000.el9.x86_64 230/246 2023-11-02T09:26:16.074 INFO:teuthology.orchestra.run.smithi156.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-02T09:26:16.075 INFO:teuthology.orchestra.run.smithi156.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-11-02T09:26:16.075 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-02T09:26:16.075 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-02T09:26:16.075 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:26:16.118 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-rook-2:18.0.0-6872.g84d22000.el9.noarch 231/246 2023-11-02T09:26:16.129 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6872.g84d22000.el9.noarch 231/246 2023-11-02T09:26:16.168 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-2:18.0.0-6872.g84d22000.el9.x86_64 232/246 2023-11-02T09:26:16.194 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : java-11-openjdk-1:11.0.18.0.10-3.el9.x86_64 233/246 2023-11-02T09:26:16.962 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: java-11-openjdk-1:11.0.18.0.10-3.el9.x86_64 233/246 2023-11-02T09:26:16.995 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-radosgw-2:18.0.0-6872.g84d22000.el9.x86_64 234/246 2023-11-02T09:26:17.018 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6872.g84d22000.el9.x86_64 234/246 2023-11-02T09:26:17.018 INFO:teuthology.orchestra.run.smithi156.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-02T09:26:17.018 INFO:teuthology.orchestra.run.smithi156.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-11-02T09:26:17.019 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-02T09:26:17.019 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-02T09:26:17.019 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:26:17.063 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6872.g84d22 235/246 2023-11-02T09:26:17.085 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6872.g84d22 235/246 2023-11-02T09:26:17.086 INFO:teuthology.orchestra.run.smithi156.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-02T09:26:17.086 INFO:teuthology.orchestra.run.smithi156.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-11-02T09:26:17.086 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:26:17.200 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 246/246 2023-11-02T09:26:17.200 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-2:18.0.0-6872.g84d22000.el9.x86_64 1/246 2023-11-02T09:26:17.200 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-base-2:18.0.0-6872.g84d22000.el9.x86_64 2/246 2023-11-02T09:26:17.201 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-common-2:18.0.0-6872.g84d22000.el9.x86_64 3/246 2023-11-02T09:26:17.201 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-fuse-2:18.0.0-6872.g84d22000.el9.x86_64 4/246 2023-11-02T09:26:17.201 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6872.g84d22 5/246 2023-11-02T09:26:17.201 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mds-2:18.0.0-6872.g84d22000.el9.x86_64 6/246 2023-11-02T09:26:17.201 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mgr-2:18.0.0-6872.g84d22000.el9.x86_64 7/246 2023-11-02T09:26:17.202 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mon-2:18.0.0-6872.g84d22000.el9.x86_64 8/246 2023-11-02T09:26:17.202 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-osd-2:18.0.0-6872.g84d22000.el9.x86_64 9/246 2023-11-02T09:26:17.202 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-radosgw-2:18.0.0-6872.g84d22000.el9.x86_64 10/246 2023-11-02T09:26:17.202 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-selinux-2:18.0.0-6872.g84d22000.el9.x86_64 11/246 2023-11-02T09:26:17.202 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-test-2:18.0.0-6872.g84d22000.el9.x86_64 12/246 2023-11-02T09:26:17.203 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libcephfs-devel-2:18.0.0-6872.g84d22000.el9.x86_ 13/246 2023-11-02T09:26:17.203 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libcephfs2-2:18.0.0-6872.g84d22000.el9.x86_64 14/246 2023-11-02T09:26:17.203 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libcephsqlite-2:18.0.0-6872.g84d22000.el9.x86_64 15/246 2023-11-02T09:26:17.203 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librados-devel-2:18.0.0-6872.g84d22000.el9.x86_6 16/246 2023-11-02T09:26:17.203 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libradosstriper1-2:18.0.0-6872.g84d22000.el9.x86 17/246 2023-11-02T09:26:17.204 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librgw2-2:18.0.0-6872.g84d22000.el9.x86_64 18/246 2023-11-02T09:26:17.204 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6872.g84d22000.el 19/246 2023-11-02T09:26:17.204 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-ceph-common-2:18.0.0-6872.g84d22000.el9. 20/246 2023-11-02T09:26:17.204 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-cephfs-2:18.0.0-6872.g84d22000.el9.x86_6 21/246 2023-11-02T09:26:17.204 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-rados-2:18.0.0-6872.g84d22000.el9.x86_64 22/246 2023-11-02T09:26:17.205 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-rbd-2:18.0.0-6872.g84d22000.el9.x86_64 23/246 2023-11-02T09:26:17.205 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-rgw-2:18.0.0-6872.g84d22000.el9.x86_64 24/246 2023-11-02T09:26:17.205 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : rbd-fuse-2:18.0.0-6872.g84d22000.el9.x86_64 25/246 2023-11-02T09:26:17.205 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : rbd-mirror-2:18.0.0-6872.g84d22000.el9.x86_64 26/246 2023-11-02T09:26:17.205 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : rbd-nbd-2:18.0.0-6872.g84d22000.el9.x86_64 27/246 2023-11-02T09:26:17.224 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6872.g84d22000. 28/246 2023-11-02T09:26:17.224 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6872.g84d22000.el9.noa 29/246 2023-11-02T09:26:17.224 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6872.g84d22000.el9.n 30/246 2023-11-02T09:26:17.225 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6872.g84d 31/246 2023-11-02T09:26:17.225 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6872.g84d22000.el 32/246 2023-11-02T09:26:17.225 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6872.g84d22000.el9.noarch 33/246 2023-11-02T09:26:17.225 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6872.g84d22000.e 34/246 2023-11-02T09:26:17.225 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-volume-2:18.0.0-6872.g84d22000.el9.noarch 35/246 2023-11-02T09:26:17.226 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : cephadm-2:18.0.0-6872.g84d22000.el9.noarch 36/246 2023-11-02T09:26:17.226 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 37/246 2023-11-02T09:26:17.226 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 38/246 2023-11-02T09:26:17.226 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 39/246 2023-11-02T09:26:17.226 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 40/246 2023-11-02T09:26:17.227 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : atk-2.36.0-5.el9.x86_64 41/246 2023-11-02T09:26:17.227 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/246 2023-11-02T09:26:17.227 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 43/246 2023-11-02T09:26:17.227 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 44/246 2023-11-02T09:26:17.227 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 45/246 2023-11-02T09:26:17.227 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 46/246 2023-11-02T09:26:17.228 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 47/246 2023-11-02T09:26:17.228 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 48/246 2023-11-02T09:26:17.228 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 49/246 2023-11-02T09:26:17.228 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 50/246 2023-11-02T09:26:17.228 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 51/246 2023-11-02T09:26:17.229 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 52/246 2023-11-02T09:26:17.229 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-3.el9.x86_64 53/246 2023-11-02T09:26:17.229 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 54/246 2023-11-02T09:26:17.229 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 55/246 2023-11-02T09:26:17.229 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 56/246 2023-11-02T09:26:17.230 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 57/246 2023-11-02T09:26:17.230 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : gtk-update-icon-cache-3.24.31-2.el9.x86_64 58/246 2023-11-02T09:26:17.230 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : gtk3-3.24.31-2.el9.x86_64 59/246 2023-11-02T09:26:17.230 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 60/246 2023-11-02T09:26:17.230 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 61/246 2023-11-02T09:26:17.231 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : java-11-openjdk-1:11.0.18.0.10-3.el9.x86_64 62/246 2023-11-02T09:26:17.231 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x8 63/246 2023-11-02T09:26:17.231 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : javapackages-filesystem-6.0.0-4.el9.noarch 64/246 2023-11-02T09:26:17.231 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 65/246 2023-11-02T09:26:17.231 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : lcms2-2.12-3.el9.x86_64 66/246 2023-11-02T09:26:17.232 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 67/246 2023-11-02T09:26:17.232 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 68/246 2023-11-02T09:26:17.232 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 69/246 2023-11-02T09:26:17.232 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 70/246 2023-11-02T09:26:17.232 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 71/246 2023-11-02T09:26:17.233 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 72/246 2023-11-02T09:26:17.233 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 73/246 2023-11-02T09:26:17.233 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 74/246 2023-11-02T09:26:17.233 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 75/246 2023-11-02T09:26:17.233 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 76/246 2023-11-02T09:26:17.234 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 77/246 2023-11-02T09:26:17.234 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libepoxy-1.5.5-4.el9.x86_64 78/246 2023-11-02T09:26:17.234 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 79/246 2023-11-02T09:26:17.234 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 80/246 2023-11-02T09:26:17.234 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 81/246 2023-11-02T09:26:17.234 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 82/246 2023-11-02T09:26:17.235 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 83/246 2023-11-02T09:26:17.235 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 84/246 2023-11-02T09:26:17.235 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 85/246 2023-11-02T09:26:17.235 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 86/246 2023-11-02T09:26:17.236 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libiptcdata-1.0.5-9.el9.x86_64 87/246 2023-11-02T09:26:17.236 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 88/246 2023-11-02T09:26:17.236 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 89/246 2023-11-02T09:26:17.236 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 90/246 2023-11-02T09:26:17.236 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 91/246 2023-11-02T09:26:17.237 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 92/246 2023-11-02T09:26:17.237 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 93/246 2023-11-02T09:26:17.237 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libsbc-1.4-9.el9.x86_64 94/246 2023-11-02T09:26:17.237 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libsndfile-1.0.31-7.el9.x86_64 95/246 2023-11-02T09:26:17.237 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 96/246 2023-11-02T09:26:17.238 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libtool-ltdl-2.4.6-45.el9.x86_64 97/246 2023-11-02T09:26:17.238 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 98/246 2023-11-02T09:26:17.238 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 99/246 2023-11-02T09:26:17.238 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 100/246 2023-11-02T09:26:17.238 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 101/246 2023-11-02T09:26:17.239 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 102/246 2023-11-02T09:26:17.239 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 103/246 2023-11-02T09:26:17.239 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 104/246 2023-11-02T09:26:17.239 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 105/246 2023-11-02T09:26:17.239 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 106/246 2023-11-02T09:26:17.239 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 107/246 2023-11-02T09:26:17.240 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 108/246 2023-11-02T09:26:17.240 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 109/246 2023-11-02T09:26:17.240 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 110/246 2023-11-02T09:26:17.240 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 111/246 2023-11-02T09:26:17.240 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 112/246 2023-11-02T09:26:17.241 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 113/246 2023-11-02T09:26:17.241 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 114/246 2023-11-02T09:26:17.241 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : opus-1.3.1-10.el9.x86_64 115/246 2023-11-02T09:26:17.241 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : orc-0.4.31-6.el9.x86_64 116/246 2023-11-02T09:26:17.241 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 117/246 2023-11-02T09:26:17.241 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ostree-libs-2023.6-1.el9.x86_64 118/246 2023-11-02T09:26:17.242 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : p11-kit-server-0.24.1-2.el9.x86_64 119/246 2023-11-02T09:26:17.242 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : pipewire-0.3.67-2.el9.x86_64 120/246 2023-11-02T09:26:17.242 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : pipewire-alsa-0.3.67-2.el9.x86_64 121/246 2023-11-02T09:26:17.242 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : pipewire-jack-audio-connection-kit-0.3.67-2.el9. 122/246 2023-11-02T09:26:17.242 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : pipewire-libs-0.3.67-2.el9.x86_64 123/246 2023-11-02T09:26:17.243 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : pipewire-pulseaudio-0.3.67-2.el9.x86_64 124/246 2023-11-02T09:26:17.243 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : poppler-21.01.0-19.el9.x86_64 125/246 2023-11-02T09:26:17.243 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 126/246 2023-11-02T09:26:17.243 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : poppler-glib-21.01.0-19.el9.x86_64 127/246 2023-11-02T09:26:17.243 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 128/246 2023-11-02T09:26:17.244 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : pulseaudio-utils-15.0-2.el9.x86_64 129/246 2023-11-02T09:26:17.244 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 130/246 2023-11-02T09:26:17.244 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 131/246 2023-11-02T09:26:17.244 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 132/246 2023-11-02T09:26:17.244 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 133/246 2023-11-02T09:26:17.245 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 134/246 2023-11-02T09:26:17.245 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 135/246 2023-11-02T09:26:17.245 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 136/246 2023-11-02T09:26:17.245 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 137/246 2023-11-02T09:26:17.245 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 138/246 2023-11-02T09:26:17.246 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 139/246 2023-11-02T09:26:17.246 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 140/246 2023-11-02T09:26:17.246 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 141/246 2023-11-02T09:26:17.246 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 142/246 2023-11-02T09:26:17.246 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 143/246 2023-11-02T09:26:17.246 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 144/246 2023-11-02T09:26:17.247 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 145/246 2023-11-02T09:26:17.247 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : rtkit-0.11-28.el9.x86_64 146/246 2023-11-02T09:26:17.247 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 147/246 2023-11-02T09:26:17.247 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 148/246 2023-11-02T09:26:17.247 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 149/246 2023-11-02T09:26:17.248 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 150/246 2023-11-02T09:26:17.248 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : tracker-miners-3.1.2-3.el9.x86_64 151/246 2023-11-02T09:26:17.248 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 152/246 2023-11-02T09:26:17.248 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : tzdata-java-2023c-1.el9.noarch 153/246 2023-11-02T09:26:17.248 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : upower-0.99.11-11.el9.x86_64 154/246 2023-11-02T09:26:17.248 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 155/246 2023-11-02T09:26:17.249 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 156/246 2023-11-02T09:26:17.249 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : xdg-desktop-portal-1.12.4-1.el9.x86_64 157/246 2023-11-02T09:26:17.249 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 158/246 2023-11-02T09:26:17.249 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 159/246 2023-11-02T09:26:17.249 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 160/246 2023-11-02T09:26:17.250 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 161/246 2023-11-02T09:26:17.250 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 162/246 2023-11-02T09:26:17.250 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : bluez-libs-5.64-1.el9.x86_64 163/246 2023-11-02T09:26:17.250 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : bubblewrap-0.4.1-6.el9.x86_64 164/246 2023-11-02T09:26:17.250 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : cups-libs-1:2.3.3op2-21.el9.x86_64 165/246 2023-11-02T09:26:17.250 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 166/246 2023-11-02T09:26:17.251 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 167/246 2023-11-02T09:26:17.251 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libpciaccess-0.16-6.el9.x86_64 168/246 2023-11-02T09:26:17.251 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 169/246 2023-11-02T09:26:17.251 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 170/246 2023-11-02T09:26:17.251 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 171/246 2023-11-02T09:26:17.252 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-ply-3.11-14.el9.noarch 172/246 2023-11-02T09:26:17.252 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 173/246 2023-11-02T09:26:17.252 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 174/246 2023-11-02T09:26:17.252 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 175/246 2023-11-02T09:26:17.252 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 176/246 2023-11-02T09:26:17.253 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : alsa-lib-1.2.9-1.el9.x86_64 177/246 2023-11-02T09:26:17.253 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : avahi-glib-0.8-12.el9.x86_64 178/246 2023-11-02T09:26:17.253 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 179/246 2023-11-02T09:26:17.253 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : flatpak-1.12.8-1.el9.x86_64 180/246 2023-11-02T09:26:17.253 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : flatpak-selinux-1.12.8-1.el9.noarch 181/246 2023-11-02T09:26:17.253 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : flatpak-session-helper-1.12.8-1.el9.x86_64 182/246 2023-11-02T09:26:17.254 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 183/246 2023-11-02T09:26:17.254 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : gstreamer1-plugins-base-1.22.1-1.el9.x86_64 184/246 2023-11-02T09:26:17.254 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : jq-1.6-15.el9.x86_64 185/246 2023-11-02T09:26:17.254 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libX11-xcb-1.7.0-8.el9.x86_64 186/246 2023-11-02T09:26:17.255 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 187/246 2023-11-02T09:26:17.255 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 188/246 2023-11-02T09:26:17.255 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libdrm-2.4.115-1.el9.x86_64 189/246 2023-11-02T09:26:17.255 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 190/246 2023-11-02T09:26:17.255 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libtiff-4.4.0-10.el9.x86_64 191/246 2023-11-02T09:26:17.255 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 192/246 2023-11-02T09:26:17.256 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : lua-5.4.4-4.el9.x86_64 193/246 2023-11-02T09:26:17.256 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : mesa-libEGL-23.1.4-1.el9.x86_64 194/246 2023-11-02T09:26:17.256 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : mesa-libGL-23.1.4-1.el9.x86_64 195/246 2023-11-02T09:26:17.256 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : mesa-libgbm-23.1.4-1.el9.x86_64 196/246 2023-11-02T09:26:17.256 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : mesa-libglapi-23.1.4-1.el9.x86_64 197/246 2023-11-02T09:26:17.257 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : mesa-vulkan-drivers-23.1.4-1.el9.x86_64 198/246 2023-11-02T09:26:17.257 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : osinfo-db-20230518-1.el9.noarch 199/246 2023-11-02T09:26:17.257 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 200/246 2023-11-02T09:26:17.257 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : vulkan-loader-1.3.250.1-1.el9.x86_64 201/246 2023-11-02T09:26:17.257 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 202/246 2023-11-02T09:26:17.257 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 203/246 2023-11-02T09:26:17.258 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 204/246 2023-11-02T09:26:17.258 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 205/246 2023-11-02T09:26:17.258 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 206/246 2023-11-02T09:26:17.258 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 207/246 2023-11-02T09:26:17.258 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 208/246 2023-11-02T09:26:17.259 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 209/246 2023-11-02T09:26:17.259 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 210/246 2023-11-02T09:26:17.259 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 211/246 2023-11-02T09:26:17.259 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 212/246 2023-11-02T09:26:17.259 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 213/246 2023-11-02T09:26:17.260 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 214/246 2023-11-02T09:26:17.260 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 215/246 2023-11-02T09:26:17.260 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 216/246 2023-11-02T09:26:17.260 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-google-auth-1:2.23.3-1.el9.noarch 217/246 2023-11-02T09:26:17.260 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 218/246 2023-11-02T09:26:17.260 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 219/246 2023-11-02T09:26:17.261 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 220/246 2023-11-02T09:26:17.261 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 221/246 2023-11-02T09:26:17.261 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 222/246 2023-11-02T09:26:17.261 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 223/246 2023-11-02T09:26:17.261 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 224/246 2023-11-02T09:26:17.261 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 225/246 2023-11-02T09:26:17.262 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 226/246 2023-11-02T09:26:17.262 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 227/246 2023-11-02T09:26:17.262 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 228/246 2023-11-02T09:26:17.262 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 229/246 2023-11-02T09:26:17.262 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 230/246 2023-11-02T09:26:17.263 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 231/246 2023-11-02T09:26:17.263 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 232/246 2023-11-02T09:26:17.263 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 233/246 2023-11-02T09:26:17.263 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 234/246 2023-11-02T09:26:17.263 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 235/246 2023-11-02T09:26:17.264 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 236/246 2023-11-02T09:26:17.264 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 237/246 2023-11-02T09:26:17.264 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 238/246 2023-11-02T09:26:17.264 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 239/246 2023-11-02T09:26:17.264 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 240/246 2023-11-02T09:26:17.264 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : re2-1:20211101-3.el9.x86_64 241/246 2023-11-02T09:26:17.265 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 242/246 2023-11-02T09:26:17.265 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librados2-2:18.0.0-6872.g84d22000.el9.x86_64 243/246 2023-11-02T09:26:17.265 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 244/246 2023-11-02T09:26:17.265 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librbd1-2:18.0.0-6872.g84d22000.el9.x86_64 245/246 2023-11-02T09:26:17.380 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : rbd-mirror-2:18.0.0-6872.g84d22000.el9.x86_64 236/246 2023-11-02T09:26:17.403 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6872.g84d22000.el9.x86_64 236/246 2023-11-02T09:26:17.403 INFO:teuthology.orchestra.run.smithi156.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-02T09:26:17.403 INFO:teuthology.orchestra.run.smithi156.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-11-02T09:26:17.403 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-02T09:26:17.404 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-02T09:26:17.404 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:26:20.490 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 246/246 2023-11-02T09:26:20.490 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-11-02T09:26:20.491 INFO:teuthology.orchestra.run.smithi186.stdout:Upgraded: 2023-11-02T09:26:20.491 INFO:teuthology.orchestra.run.smithi186.stdout: librados2-2:18.0.0-6872.g84d22000.el9.x86_64 2023-11-02T09:26:20.491 INFO:teuthology.orchestra.run.smithi186.stdout: librbd1-2:18.0.0-6872.g84d22000.el9.x86_64 2023-11-02T09:26:20.491 INFO:teuthology.orchestra.run.smithi186.stdout:Installed: 2023-11-02T09:26:20.491 INFO:teuthology.orchestra.run.smithi186.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2023-11-02T09:26:20.492 INFO:teuthology.orchestra.run.smithi186.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2023-11-02T09:26:20.492 INFO:teuthology.orchestra.run.smithi186.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2023-11-02T09:26:20.492 INFO:teuthology.orchestra.run.smithi186.stdout: alsa-lib-1.2.9-1.el9.x86_64 2023-11-02T09:26:20.492 INFO:teuthology.orchestra.run.smithi186.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2023-11-02T09:26:20.492 INFO:teuthology.orchestra.run.smithi186.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2023-11-02T09:26:20.493 INFO:teuthology.orchestra.run.smithi186.stdout: atk-2.36.0-5.el9.x86_64 2023-11-02T09:26:20.493 INFO:teuthology.orchestra.run.smithi186.stdout: avahi-glib-0.8-12.el9.x86_64 2023-11-02T09:26:20.493 INFO:teuthology.orchestra.run.smithi186.stdout: bluez-libs-5.64-1.el9.x86_64 2023-11-02T09:26:20.493 INFO:teuthology.orchestra.run.smithi186.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-11-02T09:26:20.493 INFO:teuthology.orchestra.run.smithi186.stdout: bubblewrap-0.4.1-6.el9.x86_64 2023-11-02T09:26:20.494 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-2:18.0.0-6872.g84d22000.el9.x86_64 2023-11-02T09:26:20.494 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-base-2:18.0.0-6872.g84d22000.el9.x86_64 2023-11-02T09:26:20.494 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-common-2:18.0.0-6872.g84d22000.el9.x86_64 2023-11-02T09:26:20.494 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-fuse-2:18.0.0-6872.g84d22000.el9.x86_64 2023-11-02T09:26:20.495 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-grafana-dashboards-2:18.0.0-6872.g84d22000.el9.noarch 2023-11-02T09:26:20.495 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-immutable-object-cache-2:18.0.0-6872.g84d22000.el9.x86_64 2023-11-02T09:26:20.495 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mds-2:18.0.0-6872.g84d22000.el9.x86_64 2023-11-02T09:26:20.495 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-2:18.0.0-6872.g84d22000.el9.x86_64 2023-11-02T09:26:20.495 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-cephadm-2:18.0.0-6872.g84d22000.el9.noarch 2023-11-02T09:26:20.495 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-dashboard-2:18.0.0-6872.g84d22000.el9.noarch 2023-11-02T09:26:20.496 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6872.g84d22000.el9.noarch 2023-11-02T09:26:20.496 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-modules-core-2:18.0.0-6872.g84d22000.el9.noarch 2023-11-02T09:26:20.496 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-rook-2:18.0.0-6872.g84d22000.el9.noarch 2023-11-02T09:26:20.496 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mon-2:18.0.0-6872.g84d22000.el9.x86_64 2023-11-02T09:26:20.496 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-osd-2:18.0.0-6872.g84d22000.el9.x86_64 2023-11-02T09:26:20.497 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-prometheus-alerts-2:18.0.0-6872.g84d22000.el9.noarch 2023-11-02T09:26:20.497 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-radosgw-2:18.0.0-6872.g84d22000.el9.x86_64 2023-11-02T09:26:20.497 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-selinux-2:18.0.0-6872.g84d22000.el9.x86_64 2023-11-02T09:26:20.497 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-test-2:18.0.0-6872.g84d22000.el9.x86_64 2023-11-02T09:26:20.497 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-volume-2:18.0.0-6872.g84d22000.el9.noarch 2023-11-02T09:26:20.498 INFO:teuthology.orchestra.run.smithi186.stdout: cephadm-2:18.0.0-6872.g84d22000.el9.noarch 2023-11-02T09:26:20.498 INFO:teuthology.orchestra.run.smithi186.stdout: colord-libs-1.4.5-4.el9.x86_64 2023-11-02T09:26:20.498 INFO:teuthology.orchestra.run.smithi186.stdout: copy-jdk-configs-4.0-3.el9.noarch 2023-11-02T09:26:20.498 INFO:teuthology.orchestra.run.smithi186.stdout: cups-libs-1:2.3.3op2-21.el9.x86_64 2023-11-02T09:26:20.498 INFO:teuthology.orchestra.run.smithi186.stdout: dconf-0.40.0-6.el9.x86_64 2023-11-02T09:26:20.499 INFO:teuthology.orchestra.run.smithi186.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2023-11-02T09:26:20.499 INFO:teuthology.orchestra.run.smithi186.stdout: exiv2-0.27.5-2.el9.x86_64 2023-11-02T09:26:20.499 INFO:teuthology.orchestra.run.smithi186.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2023-11-02T09:26:20.499 INFO:teuthology.orchestra.run.smithi186.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2023-11-02T09:26:20.499 INFO:teuthology.orchestra.run.smithi186.stdout: flac-libs-1.3.3-12.el9.x86_64 2023-11-02T09:26:20.500 INFO:teuthology.orchestra.run.smithi186.stdout: flatpak-1.12.8-1.el9.x86_64 2023-11-02T09:26:20.500 INFO:teuthology.orchestra.run.smithi186.stdout: flatpak-selinux-1.12.8-1.el9.noarch 2023-11-02T09:26:20.500 INFO:teuthology.orchestra.run.smithi186.stdout: flatpak-session-helper-1.12.8-1.el9.x86_64 2023-11-02T09:26:20.500 INFO:teuthology.orchestra.run.smithi186.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-11-02T09:26:20.500 INFO:teuthology.orchestra.run.smithi186.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-11-02T09:26:20.501 INFO:teuthology.orchestra.run.smithi186.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-11-02T09:26:20.501 INFO:teuthology.orchestra.run.smithi186.stdout: fmt-8.1.1-5.el9.x86_64 2023-11-02T09:26:20.501 INFO:teuthology.orchestra.run.smithi186.stdout: fuse-2.9.9-15.el9.x86_64 2023-11-02T09:26:20.501 INFO:teuthology.orchestra.run.smithi186.stdout: gdk-pixbuf2-modules-2.42.6-3.el9.x86_64 2023-11-02T09:26:20.501 INFO:teuthology.orchestra.run.smithi186.stdout: geoclue2-2.6.0-7.el9.x86_64 2023-11-02T09:26:20.502 INFO:teuthology.orchestra.run.smithi186.stdout: giflib-5.2.1-9.el9.x86_64 2023-11-02T09:26:20.502 INFO:teuthology.orchestra.run.smithi186.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-11-02T09:26:20.502 INFO:teuthology.orchestra.run.smithi186.stdout: graphene-1.10.6-2.el9.x86_64 2023-11-02T09:26:20.502 INFO:teuthology.orchestra.run.smithi186.stdout: gsm-1.0.19-6.el9.x86_64 2023-11-02T09:26:20.502 INFO:teuthology.orchestra.run.smithi186.stdout: gstreamer1-1.22.1-2.el9.x86_64 2023-11-02T09:26:20.503 INFO:teuthology.orchestra.run.smithi186.stdout: gstreamer1-plugins-base-1.22.1-1.el9.x86_64 2023-11-02T09:26:20.503 INFO:teuthology.orchestra.run.smithi186.stdout: gtk-update-icon-cache-3.24.31-2.el9.x86_64 2023-11-02T09:26:20.503 INFO:teuthology.orchestra.run.smithi186.stdout: gtk3-3.24.31-2.el9.x86_64 2023-11-02T09:26:20.503 INFO:teuthology.orchestra.run.smithi186.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2023-11-02T09:26:20.503 INFO:teuthology.orchestra.run.smithi186.stdout: iso-codes-4.6.0-3.el9.noarch 2023-11-02T09:26:20.504 INFO:teuthology.orchestra.run.smithi186.stdout: java-11-openjdk-1:11.0.18.0.10-3.el9.x86_64 2023-11-02T09:26:20.504 INFO:teuthology.orchestra.run.smithi186.stdout: java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x86_64 2023-11-02T09:26:20.504 INFO:teuthology.orchestra.run.smithi186.stdout: javapackages-filesystem-6.0.0-4.el9.noarch 2023-11-02T09:26:20.504 INFO:teuthology.orchestra.run.smithi186.stdout: jbigkit-libs-2.1-23.el9.x86_64 2023-11-02T09:26:20.504 INFO:teuthology.orchestra.run.smithi186.stdout: jq-1.6-15.el9.x86_64 2023-11-02T09:26:20.504 INFO:teuthology.orchestra.run.smithi186.stdout: lcms2-2.12-3.el9.x86_64 2023-11-02T09:26:20.505 INFO:teuthology.orchestra.run.smithi186.stdout: libX11-xcb-1.7.0-8.el9.x86_64 2023-11-02T09:26:20.505 INFO:teuthology.orchestra.run.smithi186.stdout: libXcomposite-0.4.5-7.el9.x86_64 2023-11-02T09:26:20.505 INFO:teuthology.orchestra.run.smithi186.stdout: libXcursor-1.2.0-7.el9.x86_64 2023-11-02T09:26:20.505 INFO:teuthology.orchestra.run.smithi186.stdout: libXdamage-1.1.5-7.el9.x86_64 2023-11-02T09:26:20.505 INFO:teuthology.orchestra.run.smithi186.stdout: libXfixes-5.0.3-16.el9.x86_64 2023-11-02T09:26:20.506 INFO:teuthology.orchestra.run.smithi186.stdout: libXi-1.7.10-8.el9.x86_64 2023-11-02T09:26:20.506 INFO:teuthology.orchestra.run.smithi186.stdout: libXinerama-1.1.4-10.el9.x86_64 2023-11-02T09:26:20.506 INFO:teuthology.orchestra.run.smithi186.stdout: libXrandr-1.5.2-8.el9.x86_64 2023-11-02T09:26:20.506 INFO:teuthology.orchestra.run.smithi186.stdout: libXtst-1.2.3-16.el9.x86_64 2023-11-02T09:26:20.506 INFO:teuthology.orchestra.run.smithi186.stdout: libXv-1.0.11-16.el9.x86_64 2023-11-02T09:26:20.507 INFO:teuthology.orchestra.run.smithi186.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2023-11-02T09:26:20.507 INFO:teuthology.orchestra.run.smithi186.stdout: libarrow-9.0.0-9.el9.x86_64 2023-11-02T09:26:20.507 INFO:teuthology.orchestra.run.smithi186.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-11-02T09:26:20.507 INFO:teuthology.orchestra.run.smithi186.stdout: libasyncns-0.8-22.el9.x86_64 2023-11-02T09:26:20.507 INFO:teuthology.orchestra.run.smithi186.stdout: libcanberra-0.30-27.el9.x86_64 2023-11-02T09:26:20.507 INFO:teuthology.orchestra.run.smithi186.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2023-11-02T09:26:20.508 INFO:teuthology.orchestra.run.smithi186.stdout: libcephfs-devel-2:18.0.0-6872.g84d22000.el9.x86_64 2023-11-02T09:26:20.508 INFO:teuthology.orchestra.run.smithi186.stdout: libcephfs2-2:18.0.0-6872.g84d22000.el9.x86_64 2023-11-02T09:26:20.508 INFO:teuthology.orchestra.run.smithi186.stdout: libcephsqlite-2:18.0.0-6872.g84d22000.el9.x86_64 2023-11-02T09:26:20.508 INFO:teuthology.orchestra.run.smithi186.stdout: libdrm-2.4.115-1.el9.x86_64 2023-11-02T09:26:20.508 INFO:teuthology.orchestra.run.smithi186.stdout: libepoxy-1.5.5-4.el9.x86_64 2023-11-02T09:26:20.509 INFO:teuthology.orchestra.run.smithi186.stdout: libexif-0.6.22-6.el9.x86_64 2023-11-02T09:26:20.509 INFO:teuthology.orchestra.run.smithi186.stdout: libfontenc-1.1.3-17.el9.x86_64 2023-11-02T09:26:20.509 INFO:teuthology.orchestra.run.smithi186.stdout: libgexiv2-0.12.3-1.el9.x86_64 2023-11-02T09:26:20.509 INFO:teuthology.orchestra.run.smithi186.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-11-02T09:26:20.509 INFO:teuthology.orchestra.run.smithi186.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2023-11-02T09:26:20.510 INFO:teuthology.orchestra.run.smithi186.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2023-11-02T09:26:20.510 INFO:teuthology.orchestra.run.smithi186.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2023-11-02T09:26:20.510 INFO:teuthology.orchestra.run.smithi186.stdout: libgsf-1.14.47-5.el9.x86_64 2023-11-02T09:26:20.510 INFO:teuthology.orchestra.run.smithi186.stdout: libgxps-0.3.2-3.el9.x86_64 2023-11-02T09:26:20.510 INFO:teuthology.orchestra.run.smithi186.stdout: libiptcdata-1.0.5-9.el9.x86_64 2023-11-02T09:26:20.511 INFO:teuthology.orchestra.run.smithi186.stdout: libldac-2.0.2.3-10.el9.x86_64 2023-11-02T09:26:20.511 INFO:teuthology.orchestra.run.smithi186.stdout: libnotify-0.7.9-8.el9.x86_64 2023-11-02T09:26:20.511 INFO:teuthology.orchestra.run.smithi186.stdout: liboath-2.6.7-2.el9.x86_64 2023-11-02T09:26:20.511 INFO:teuthology.orchestra.run.smithi186.stdout: libogg-2:1.3.4-6.el9.x86_64 2023-11-02T09:26:20.511 INFO:teuthology.orchestra.run.smithi186.stdout: libosinfo-1.10.0-1.el9.x86_64 2023-11-02T09:26:20.512 INFO:teuthology.orchestra.run.smithi186.stdout: libpciaccess-0.16-6.el9.x86_64 2023-11-02T09:26:20.512 INFO:teuthology.orchestra.run.smithi186.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-11-02T09:26:20.512 INFO:teuthology.orchestra.run.smithi186.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-11-02T09:26:20.512 INFO:teuthology.orchestra.run.smithi186.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-11-02T09:26:20.512 INFO:teuthology.orchestra.run.smithi186.stdout: librados-devel-2:18.0.0-6872.g84d22000.el9.x86_64 2023-11-02T09:26:20.513 INFO:teuthology.orchestra.run.smithi186.stdout: libradosstriper1-2:18.0.0-6872.g84d22000.el9.x86_64 2023-11-02T09:26:20.513 INFO:teuthology.orchestra.run.smithi186.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-11-02T09:26:20.513 INFO:teuthology.orchestra.run.smithi186.stdout: librgw2-2:18.0.0-6872.g84d22000.el9.x86_64 2023-11-02T09:26:20.513 INFO:teuthology.orchestra.run.smithi186.stdout: libsbc-1.4-9.el9.x86_64 2023-11-02T09:26:20.513 INFO:teuthology.orchestra.run.smithi186.stdout: libsndfile-1.0.31-7.el9.x86_64 2023-11-02T09:26:20.514 INFO:teuthology.orchestra.run.smithi186.stdout: libtheora-1:1.1.1-31.el9.x86_64 2023-11-02T09:26:20.514 INFO:teuthology.orchestra.run.smithi186.stdout: libtiff-4.4.0-10.el9.x86_64 2023-11-02T09:26:20.514 INFO:teuthology.orchestra.run.smithi186.stdout: libtool-ltdl-2.4.6-45.el9.x86_64 2023-11-02T09:26:20.514 INFO:teuthology.orchestra.run.smithi186.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2023-11-02T09:26:20.515 INFO:teuthology.orchestra.run.smithi186.stdout: libunwind-1.6.2-1.el9.x86_64 2023-11-02T09:26:20.515 INFO:teuthology.orchestra.run.smithi186.stdout: libvisual-1:0.4.0-34.el9.x86_64 2023-11-02T09:26:20.515 INFO:teuthology.orchestra.run.smithi186.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2023-11-02T09:26:20.515 INFO:teuthology.orchestra.run.smithi186.stdout: libwayland-client-1.21.0-1.el9.x86_64 2023-11-02T09:26:20.515 INFO:teuthology.orchestra.run.smithi186.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2023-11-02T09:26:20.516 INFO:teuthology.orchestra.run.smithi186.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2023-11-02T09:26:20.516 INFO:teuthology.orchestra.run.smithi186.stdout: libwayland-server-1.21.0-1.el9.x86_64 2023-11-02T09:26:20.516 INFO:teuthology.orchestra.run.smithi186.stdout: libwebp-1.2.0-8.el9.x86_64 2023-11-02T09:26:20.516 INFO:teuthology.orchestra.run.smithi186.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2023-11-02T09:26:20.516 INFO:teuthology.orchestra.run.smithi186.stdout: libxshmfence-1.3-10.el9.x86_64 2023-11-02T09:26:20.516 INFO:teuthology.orchestra.run.smithi186.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2023-11-02T09:26:20.517 INFO:teuthology.orchestra.run.smithi186.stdout: low-memory-monitor-2.1-4.el9.x86_64 2023-11-02T09:26:20.517 INFO:teuthology.orchestra.run.smithi186.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-11-02T09:26:20.517 INFO:teuthology.orchestra.run.smithi186.stdout: lua-5.4.4-4.el9.x86_64 2023-11-02T09:26:20.517 INFO:teuthology.orchestra.run.smithi186.stdout: lua-posix-35.0-8.el9.x86_64 2023-11-02T09:26:20.517 INFO:teuthology.orchestra.run.smithi186.stdout: mesa-libEGL-23.1.4-1.el9.x86_64 2023-11-02T09:26:20.518 INFO:teuthology.orchestra.run.smithi186.stdout: mesa-libGL-23.1.4-1.el9.x86_64 2023-11-02T09:26:20.518 INFO:teuthology.orchestra.run.smithi186.stdout: mesa-libgbm-23.1.4-1.el9.x86_64 2023-11-02T09:26:20.518 INFO:teuthology.orchestra.run.smithi186.stdout: mesa-libglapi-23.1.4-1.el9.x86_64 2023-11-02T09:26:20.518 INFO:teuthology.orchestra.run.smithi186.stdout: mesa-vulkan-drivers-23.1.4-1.el9.x86_64 2023-11-02T09:26:20.518 INFO:teuthology.orchestra.run.smithi186.stdout: mkfontscale-1.2.1-3.el9.x86_64 2023-11-02T09:26:20.519 INFO:teuthology.orchestra.run.smithi186.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-11-02T09:26:20.519 INFO:teuthology.orchestra.run.smithi186.stdout: openblas-0.3.21-2.el9.x86_64 2023-11-02T09:26:20.519 INFO:teuthology.orchestra.run.smithi186.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-11-02T09:26:20.519 INFO:teuthology.orchestra.run.smithi186.stdout: openjpeg2-2.4.0-7.el9.x86_64 2023-11-02T09:26:20.519 INFO:teuthology.orchestra.run.smithi186.stdout: opus-1.3.1-10.el9.x86_64 2023-11-02T09:26:20.520 INFO:teuthology.orchestra.run.smithi186.stdout: orc-0.4.31-6.el9.x86_64 2023-11-02T09:26:20.520 INFO:teuthology.orchestra.run.smithi186.stdout: osinfo-db-20230518-1.el9.noarch 2023-11-02T09:26:20.520 INFO:teuthology.orchestra.run.smithi186.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2023-11-02T09:26:20.520 INFO:teuthology.orchestra.run.smithi186.stdout: ostree-libs-2023.6-1.el9.x86_64 2023-11-02T09:26:20.520 INFO:teuthology.orchestra.run.smithi186.stdout: p11-kit-server-0.24.1-2.el9.x86_64 2023-11-02T09:26:20.521 INFO:teuthology.orchestra.run.smithi186.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-11-02T09:26:20.521 INFO:teuthology.orchestra.run.smithi186.stdout: pipewire-0.3.67-2.el9.x86_64 2023-11-02T09:26:20.521 INFO:teuthology.orchestra.run.smithi186.stdout: pipewire-alsa-0.3.67-2.el9.x86_64 2023-11-02T09:26:20.521 INFO:teuthology.orchestra.run.smithi186.stdout: pipewire-jack-audio-connection-kit-0.3.67-2.el9.x86_64 2023-11-02T09:26:20.521 INFO:teuthology.orchestra.run.smithi186.stdout: pipewire-libs-0.3.67-2.el9.x86_64 2023-11-02T09:26:20.522 INFO:teuthology.orchestra.run.smithi186.stdout: pipewire-pulseaudio-0.3.67-2.el9.x86_64 2023-11-02T09:26:20.522 INFO:teuthology.orchestra.run.smithi186.stdout: poppler-21.01.0-19.el9.x86_64 2023-11-02T09:26:20.522 INFO:teuthology.orchestra.run.smithi186.stdout: poppler-data-0.4.9-9.el9.noarch 2023-11-02T09:26:20.522 INFO:teuthology.orchestra.run.smithi186.stdout: poppler-glib-21.01.0-19.el9.x86_64 2023-11-02T09:26:20.522 INFO:teuthology.orchestra.run.smithi186.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2023-11-02T09:26:20.523 INFO:teuthology.orchestra.run.smithi186.stdout: pulseaudio-utils-15.0-2.el9.x86_64 2023-11-02T09:26:20.523 INFO:teuthology.orchestra.run.smithi186.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-11-02T09:26:20.523 INFO:teuthology.orchestra.run.smithi186.stdout: python3-babel-2.9.1-2.el9.noarch 2023-11-02T09:26:20.523 INFO:teuthology.orchestra.run.smithi186.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-11-02T09:26:20.523 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-11-02T09:26:20.524 INFO:teuthology.orchestra.run.smithi186.stdout: python3-ceph-argparse-2:18.0.0-6872.g84d22000.el9.x86_64 2023-11-02T09:26:20.524 INFO:teuthology.orchestra.run.smithi186.stdout: python3-ceph-common-2:18.0.0-6872.g84d22000.el9.x86_64 2023-11-02T09:26:20.524 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cephfs-2:18.0.0-6872.g84d22000.el9.x86_64 2023-11-02T09:26:20.524 INFO:teuthology.orchestra.run.smithi186.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-11-02T09:26:20.524 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-11-02T09:26:20.525 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-11-02T09:26:20.525 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-11-02T09:26:20.525 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-11-02T09:26:20.525 INFO:teuthology.orchestra.run.smithi186.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-11-02T09:26:20.525 INFO:teuthology.orchestra.run.smithi186.stdout: python3-google-auth-1:2.23.3-1.el9.noarch 2023-11-02T09:26:20.526 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-11-02T09:26:20.526 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-11-02T09:26:20.526 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-11-02T09:26:20.526 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-11-02T09:26:20.526 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-11-02T09:26:20.527 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-11-02T09:26:20.527 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-11-02T09:26:20.527 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-11-02T09:26:20.527 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-11-02T09:26:20.529 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-11-02T09:26:20.529 INFO:teuthology.orchestra.run.smithi186.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-11-02T09:26:20.529 INFO:teuthology.orchestra.run.smithi186.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-11-02T09:26:20.529 INFO:teuthology.orchestra.run.smithi186.stdout: python3-mako-1.1.4-6.el9.noarch 2023-11-02T09:26:20.530 INFO:teuthology.orchestra.run.smithi186.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-11-02T09:26:20.530 INFO:teuthology.orchestra.run.smithi186.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-11-02T09:26:20.530 INFO:teuthology.orchestra.run.smithi186.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-11-02T09:26:20.530 INFO:teuthology.orchestra.run.smithi186.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-11-02T09:26:20.530 INFO:teuthology.orchestra.run.smithi186.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-11-02T09:26:20.531 INFO:teuthology.orchestra.run.smithi186.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-11-02T09:26:20.531 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-11-02T09:26:20.531 INFO:teuthology.orchestra.run.smithi186.stdout: python3-ply-3.11-14.el9.noarch 2023-11-02T09:26:20.531 INFO:teuthology.orchestra.run.smithi186.stdout: python3-portend-3.1.0-2.el9.noarch 2023-11-02T09:26:20.531 INFO:teuthology.orchestra.run.smithi186.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-11-02T09:26:20.532 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-11-02T09:26:20.532 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-11-02T09:26:20.532 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-11-02T09:26:20.532 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pycparser-2.20-6.el9.noarch 2023-11-02T09:26:20.532 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pytz-2021.1-5.el9.noarch 2023-11-02T09:26:20.532 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rados-2:18.0.0-6872.g84d22000.el9.x86_64 2023-11-02T09:26:20.533 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rbd-2:18.0.0-6872.g84d22000.el9.x86_64 2023-11-02T09:26:20.533 INFO:teuthology.orchestra.run.smithi186.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-11-02T09:26:20.533 INFO:teuthology.orchestra.run.smithi186.stdout: python3-requests-2.25.1-7.el9.noarch 2023-11-02T09:26:20.533 INFO:teuthology.orchestra.run.smithi186.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-11-02T09:26:20.533 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rgw-2:18.0.0-6872.g84d22000.el9.x86_64 2023-11-02T09:26:20.534 INFO:teuthology.orchestra.run.smithi186.stdout: python3-routes-2.5.1-5.el9.noarch 2023-11-02T09:26:20.534 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rsa-4.9-2.el9.noarch 2023-11-02T09:26:20.534 INFO:teuthology.orchestra.run.smithi186.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-11-02T09:26:20.534 INFO:teuthology.orchestra.run.smithi186.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-11-02T09:26:20.534 INFO:teuthology.orchestra.run.smithi186.stdout: python3-toml-0.10.2-6.el9.noarch 2023-11-02T09:26:20.535 INFO:teuthology.orchestra.run.smithi186.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-11-02T09:26:20.535 INFO:teuthology.orchestra.run.smithi186.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-11-02T09:26:20.535 INFO:teuthology.orchestra.run.smithi186.stdout: python3-webob-1.8.7-6.el9.noarch 2023-11-02T09:26:20.535 INFO:teuthology.orchestra.run.smithi186.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-11-02T09:26:20.535 INFO:teuthology.orchestra.run.smithi186.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-11-02T09:26:20.535 INFO:teuthology.orchestra.run.smithi186.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-11-02T09:26:20.536 INFO:teuthology.orchestra.run.smithi186.stdout: rbd-fuse-2:18.0.0-6872.g84d22000.el9.x86_64 2023-11-02T09:26:20.536 INFO:teuthology.orchestra.run.smithi186.stdout: rbd-mirror-2:18.0.0-6872.g84d22000.el9.x86_64 2023-11-02T09:26:20.536 INFO:teuthology.orchestra.run.smithi186.stdout: rbd-nbd-2:18.0.0-6872.g84d22000.el9.x86_64 2023-11-02T09:26:20.536 INFO:teuthology.orchestra.run.smithi186.stdout: re2-1:20211101-3.el9.x86_64 2023-11-02T09:26:20.536 INFO:teuthology.orchestra.run.smithi186.stdout: rtkit-0.11-28.el9.x86_64 2023-11-02T09:26:20.537 INFO:teuthology.orchestra.run.smithi186.stdout: socat-1.7.4.1-5.el9.x86_64 2023-11-02T09:26:20.537 INFO:teuthology.orchestra.run.smithi186.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2023-11-02T09:26:20.537 INFO:teuthology.orchestra.run.smithi186.stdout: thrift-0.15.0-2.el9.x86_64 2023-11-02T09:26:20.537 INFO:teuthology.orchestra.run.smithi186.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2023-11-02T09:26:20.537 INFO:teuthology.orchestra.run.smithi186.stdout: tracker-3.1.2-3.el9.x86_64 2023-11-02T09:26:20.538 INFO:teuthology.orchestra.run.smithi186.stdout: tracker-miners-3.1.2-3.el9.x86_64 2023-11-02T09:26:20.538 INFO:teuthology.orchestra.run.smithi186.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2023-11-02T09:26:20.538 INFO:teuthology.orchestra.run.smithi186.stdout: tzdata-java-2023c-1.el9.noarch 2023-11-02T09:26:20.538 INFO:teuthology.orchestra.run.smithi186.stdout: upower-0.99.11-11.el9.x86_64 2023-11-02T09:26:20.538 INFO:teuthology.orchestra.run.smithi186.stdout: vulkan-loader-1.3.250.1-1.el9.x86_64 2023-11-02T09:26:20.539 INFO:teuthology.orchestra.run.smithi186.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2023-11-02T09:26:20.539 INFO:teuthology.orchestra.run.smithi186.stdout: wireplumber-0.4.14-1.el9.x86_64 2023-11-02T09:26:20.539 INFO:teuthology.orchestra.run.smithi186.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2023-11-02T09:26:20.539 INFO:teuthology.orchestra.run.smithi186.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2023-11-02T09:26:20.539 INFO:teuthology.orchestra.run.smithi186.stdout: xdg-desktop-portal-1.12.4-1.el9.x86_64 2023-11-02T09:26:20.539 INFO:teuthology.orchestra.run.smithi186.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2023-11-02T09:26:20.540 INFO:teuthology.orchestra.run.smithi186.stdout: xkeyboard-config-2.33-2.el9.noarch 2023-11-02T09:26:20.540 INFO:teuthology.orchestra.run.smithi186.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-11-02T09:26:20.541 INFO:teuthology.orchestra.run.smithi186.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2023-11-02T09:26:20.541 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-11-02T09:26:20.541 INFO:teuthology.orchestra.run.smithi186.stdout:Complete! 2023-11-02T09:26:20.829 DEBUG:teuthology.parallel:result is None 2023-11-02T09:26:21.396 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-test-2:18.0.0-6872.g84d22000.el9.x86_64 237/246 2023-11-02T09:26:21.441 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : pipewire-alsa-0.3.67-2.el9.x86_64 238/246 2023-11-02T09:26:21.471 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : pipewire-jack-audio-connection-kit-0.3.67-2.el9. 239/246 2023-11-02T09:26:21.493 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : pipewire-pulseaudio-0.3.67-2.el9.x86_64 240/246 2023-11-02T09:26:21.509 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: pipewire-pulseaudio-0.3.67-2.el9.x86_64 240/246 2023-11-02T09:26:21.509 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2023-11-02T09:26:21.510 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:26:21.568 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : rbd-fuse-2:18.0.0-6872.g84d22000.el9.x86_64 241/246 2023-11-02T09:26:21.599 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : rbd-nbd-2:18.0.0-6872.g84d22000.el9.x86_64 242/246 2023-11-02T09:26:21.692 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libcephfs-devel-2:18.0.0-6872.g84d22000.el9.x86_ 243/246 2023-11-02T09:26:21.732 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-fuse-2:18.0.0-6872.g84d22000.el9.x86_64 244/246 2023-11-02T09:26:21.732 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 245/246 2023-11-02T09:26:21.824 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 245/246 2023-11-02T09:26:21.824 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 246/246 2023-11-02T09:26:21.907 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 246/246 2023-11-02T09:26:21.934 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 246/246 2023-11-02T09:26:21.940 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 246/246 2023-11-02T09:26:21.959 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x8 246/246 2023-11-02T09:26:21.969 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 246/246 2023-11-02T09:26:21.970 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2023-11-02T09:26:21.970 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2023-11-02T09:26:21.970 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:26:22.096 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: java-11-openjdk-1:11.0.18.0.10-3.el9.x86_64 246/246 2023-11-02T09:26:28.135 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 246/246 2023-11-02T09:26:28.136 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-2:18.0.0-6872.g84d22000.el9.x86_64 1/246 2023-11-02T09:26:28.136 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-base-2:18.0.0-6872.g84d22000.el9.x86_64 2/246 2023-11-02T09:26:28.136 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-common-2:18.0.0-6872.g84d22000.el9.x86_64 3/246 2023-11-02T09:26:28.137 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-fuse-2:18.0.0-6872.g84d22000.el9.x86_64 4/246 2023-11-02T09:26:28.137 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6872.g84d22 5/246 2023-11-02T09:26:28.137 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mds-2:18.0.0-6872.g84d22000.el9.x86_64 6/246 2023-11-02T09:26:28.137 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-2:18.0.0-6872.g84d22000.el9.x86_64 7/246 2023-11-02T09:26:28.137 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mon-2:18.0.0-6872.g84d22000.el9.x86_64 8/246 2023-11-02T09:26:28.137 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-osd-2:18.0.0-6872.g84d22000.el9.x86_64 9/246 2023-11-02T09:26:28.138 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-radosgw-2:18.0.0-6872.g84d22000.el9.x86_64 10/246 2023-11-02T09:26:28.138 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-selinux-2:18.0.0-6872.g84d22000.el9.x86_64 11/246 2023-11-02T09:26:28.138 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-test-2:18.0.0-6872.g84d22000.el9.x86_64 12/246 2023-11-02T09:26:28.138 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libcephfs-devel-2:18.0.0-6872.g84d22000.el9.x86_ 13/246 2023-11-02T09:26:28.138 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libcephfs2-2:18.0.0-6872.g84d22000.el9.x86_64 14/246 2023-11-02T09:26:28.139 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libcephsqlite-2:18.0.0-6872.g84d22000.el9.x86_64 15/246 2023-11-02T09:26:28.139 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librados-devel-2:18.0.0-6872.g84d22000.el9.x86_6 16/246 2023-11-02T09:26:28.139 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libradosstriper1-2:18.0.0-6872.g84d22000.el9.x86 17/246 2023-11-02T09:26:28.139 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librgw2-2:18.0.0-6872.g84d22000.el9.x86_64 18/246 2023-11-02T09:26:28.139 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6872.g84d22000.el 19/246 2023-11-02T09:26:28.140 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-ceph-common-2:18.0.0-6872.g84d22000.el9. 20/246 2023-11-02T09:26:28.140 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cephfs-2:18.0.0-6872.g84d22000.el9.x86_6 21/246 2023-11-02T09:26:28.140 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-rados-2:18.0.0-6872.g84d22000.el9.x86_64 22/246 2023-11-02T09:26:28.140 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-rbd-2:18.0.0-6872.g84d22000.el9.x86_64 23/246 2023-11-02T09:26:28.140 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-rgw-2:18.0.0-6872.g84d22000.el9.x86_64 24/246 2023-11-02T09:26:28.141 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : rbd-fuse-2:18.0.0-6872.g84d22000.el9.x86_64 25/246 2023-11-02T09:26:28.141 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : rbd-mirror-2:18.0.0-6872.g84d22000.el9.x86_64 26/246 2023-11-02T09:26:28.141 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : rbd-nbd-2:18.0.0-6872.g84d22000.el9.x86_64 27/246 2023-11-02T09:26:28.141 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6872.g84d22000. 28/246 2023-11-02T09:26:28.141 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6872.g84d22000.el9.noa 29/246 2023-11-02T09:26:28.159 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6872.g84d22000.el9.n 30/246 2023-11-02T09:26:28.160 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6872.g84d 31/246 2023-11-02T09:26:28.160 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6872.g84d22000.el 32/246 2023-11-02T09:26:28.160 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6872.g84d22000.el9.noarch 33/246 2023-11-02T09:26:28.160 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6872.g84d22000.e 34/246 2023-11-02T09:26:28.161 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-volume-2:18.0.0-6872.g84d22000.el9.noarch 35/246 2023-11-02T09:26:28.161 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : cephadm-2:18.0.0-6872.g84d22000.el9.noarch 36/246 2023-11-02T09:26:28.161 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 37/246 2023-11-02T09:26:28.161 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 38/246 2023-11-02T09:26:28.161 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 39/246 2023-11-02T09:26:28.162 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 40/246 2023-11-02T09:26:28.162 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : atk-2.36.0-5.el9.x86_64 41/246 2023-11-02T09:26:28.162 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/246 2023-11-02T09:26:28.162 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 43/246 2023-11-02T09:26:28.162 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 44/246 2023-11-02T09:26:28.163 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 45/246 2023-11-02T09:26:28.163 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 46/246 2023-11-02T09:26:28.163 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 47/246 2023-11-02T09:26:28.163 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 48/246 2023-11-02T09:26:28.163 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 49/246 2023-11-02T09:26:28.164 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 50/246 2023-11-02T09:26:28.164 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 51/246 2023-11-02T09:26:28.164 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 52/246 2023-11-02T09:26:28.164 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-3.el9.x86_64 53/246 2023-11-02T09:26:28.164 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 54/246 2023-11-02T09:26:28.165 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 55/246 2023-11-02T09:26:28.165 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 56/246 2023-11-02T09:26:28.165 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 57/246 2023-11-02T09:26:28.165 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : gtk-update-icon-cache-3.24.31-2.el9.x86_64 58/246 2023-11-02T09:26:28.165 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : gtk3-3.24.31-2.el9.x86_64 59/246 2023-11-02T09:26:28.165 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 60/246 2023-11-02T09:26:28.166 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 61/246 2023-11-02T09:26:28.166 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : java-11-openjdk-1:11.0.18.0.10-3.el9.x86_64 62/246 2023-11-02T09:26:28.166 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x8 63/246 2023-11-02T09:26:28.166 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : javapackages-filesystem-6.0.0-4.el9.noarch 64/246 2023-11-02T09:26:28.166 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 65/246 2023-11-02T09:26:28.167 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : lcms2-2.12-3.el9.x86_64 66/246 2023-11-02T09:26:28.167 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 67/246 2023-11-02T09:26:28.167 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 68/246 2023-11-02T09:26:28.167 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 69/246 2023-11-02T09:26:28.167 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 70/246 2023-11-02T09:26:28.168 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 71/246 2023-11-02T09:26:28.168 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 72/246 2023-11-02T09:26:28.168 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 73/246 2023-11-02T09:26:28.168 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 74/246 2023-11-02T09:26:28.168 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 75/246 2023-11-02T09:26:28.169 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 76/246 2023-11-02T09:26:28.169 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 77/246 2023-11-02T09:26:28.169 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libepoxy-1.5.5-4.el9.x86_64 78/246 2023-11-02T09:26:28.169 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 79/246 2023-11-02T09:26:28.169 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 80/246 2023-11-02T09:26:28.170 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 81/246 2023-11-02T09:26:28.170 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 82/246 2023-11-02T09:26:28.170 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 83/246 2023-11-02T09:26:28.170 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 84/246 2023-11-02T09:26:28.171 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 85/246 2023-11-02T09:26:28.171 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 86/246 2023-11-02T09:26:28.171 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libiptcdata-1.0.5-9.el9.x86_64 87/246 2023-11-02T09:26:28.171 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 88/246 2023-11-02T09:26:28.171 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 89/246 2023-11-02T09:26:28.171 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 90/246 2023-11-02T09:26:28.172 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 91/246 2023-11-02T09:26:28.172 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 92/246 2023-11-02T09:26:28.172 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 93/246 2023-11-02T09:26:28.172 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libsbc-1.4-9.el9.x86_64 94/246 2023-11-02T09:26:28.172 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libsndfile-1.0.31-7.el9.x86_64 95/246 2023-11-02T09:26:28.173 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 96/246 2023-11-02T09:26:28.173 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libtool-ltdl-2.4.6-45.el9.x86_64 97/246 2023-11-02T09:26:28.173 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 98/246 2023-11-02T09:26:28.173 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 99/246 2023-11-02T09:26:28.173 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 100/246 2023-11-02T09:26:28.174 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 101/246 2023-11-02T09:26:28.174 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 102/246 2023-11-02T09:26:28.174 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 103/246 2023-11-02T09:26:28.174 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 104/246 2023-11-02T09:26:28.174 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 105/246 2023-11-02T09:26:28.175 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 106/246 2023-11-02T09:26:28.175 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 107/246 2023-11-02T09:26:28.175 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 108/246 2023-11-02T09:26:28.175 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 109/246 2023-11-02T09:26:28.175 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 110/246 2023-11-02T09:26:28.176 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 111/246 2023-11-02T09:26:28.176 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 112/246 2023-11-02T09:26:28.176 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 113/246 2023-11-02T09:26:28.176 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 114/246 2023-11-02T09:26:28.176 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : opus-1.3.1-10.el9.x86_64 115/246 2023-11-02T09:26:28.177 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : orc-0.4.31-6.el9.x86_64 116/246 2023-11-02T09:26:28.177 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 117/246 2023-11-02T09:26:28.177 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ostree-libs-2023.6-1.el9.x86_64 118/246 2023-11-02T09:26:28.177 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : p11-kit-server-0.24.1-2.el9.x86_64 119/246 2023-11-02T09:26:28.177 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : pipewire-0.3.67-2.el9.x86_64 120/246 2023-11-02T09:26:28.177 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : pipewire-alsa-0.3.67-2.el9.x86_64 121/246 2023-11-02T09:26:28.178 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : pipewire-jack-audio-connection-kit-0.3.67-2.el9. 122/246 2023-11-02T09:26:28.178 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : pipewire-libs-0.3.67-2.el9.x86_64 123/246 2023-11-02T09:26:28.178 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : pipewire-pulseaudio-0.3.67-2.el9.x86_64 124/246 2023-11-02T09:26:28.178 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : poppler-21.01.0-19.el9.x86_64 125/246 2023-11-02T09:26:28.178 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 126/246 2023-11-02T09:26:28.179 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : poppler-glib-21.01.0-19.el9.x86_64 127/246 2023-11-02T09:26:28.179 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 128/246 2023-11-02T09:26:28.179 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : pulseaudio-utils-15.0-2.el9.x86_64 129/246 2023-11-02T09:26:28.179 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 130/246 2023-11-02T09:26:28.179 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 131/246 2023-11-02T09:26:28.180 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 132/246 2023-11-02T09:26:28.180 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 133/246 2023-11-02T09:26:28.180 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 134/246 2023-11-02T09:26:28.180 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 135/246 2023-11-02T09:26:28.180 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 136/246 2023-11-02T09:26:28.181 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 137/246 2023-11-02T09:26:28.181 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 138/246 2023-11-02T09:26:28.181 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 139/246 2023-11-02T09:26:28.181 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 140/246 2023-11-02T09:26:28.181 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 141/246 2023-11-02T09:26:28.181 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 142/246 2023-11-02T09:26:28.182 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 143/246 2023-11-02T09:26:28.182 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 144/246 2023-11-02T09:26:28.182 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 145/246 2023-11-02T09:26:28.182 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : rtkit-0.11-28.el9.x86_64 146/246 2023-11-02T09:26:28.182 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 147/246 2023-11-02T09:26:28.183 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 148/246 2023-11-02T09:26:28.183 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 149/246 2023-11-02T09:26:28.183 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 150/246 2023-11-02T09:26:28.183 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : tracker-miners-3.1.2-3.el9.x86_64 151/246 2023-11-02T09:26:28.183 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 152/246 2023-11-02T09:26:28.184 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : tzdata-java-2023c-1.el9.noarch 153/246 2023-11-02T09:26:28.184 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : upower-0.99.11-11.el9.x86_64 154/246 2023-11-02T09:26:28.184 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 155/246 2023-11-02T09:26:28.184 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 156/246 2023-11-02T09:26:28.184 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : xdg-desktop-portal-1.12.4-1.el9.x86_64 157/246 2023-11-02T09:26:28.185 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 158/246 2023-11-02T09:26:28.185 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 159/246 2023-11-02T09:26:28.185 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 160/246 2023-11-02T09:26:28.185 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 161/246 2023-11-02T09:26:28.185 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 162/246 2023-11-02T09:26:28.185 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : bluez-libs-5.64-1.el9.x86_64 163/246 2023-11-02T09:26:28.186 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : bubblewrap-0.4.1-6.el9.x86_64 164/246 2023-11-02T09:26:28.186 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : cups-libs-1:2.3.3op2-21.el9.x86_64 165/246 2023-11-02T09:26:28.186 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 166/246 2023-11-02T09:26:28.187 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 167/246 2023-11-02T09:26:28.187 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libpciaccess-0.16-6.el9.x86_64 168/246 2023-11-02T09:26:28.187 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 169/246 2023-11-02T09:26:28.187 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 170/246 2023-11-02T09:26:28.187 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 171/246 2023-11-02T09:26:28.187 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-ply-3.11-14.el9.noarch 172/246 2023-11-02T09:26:28.188 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 173/246 2023-11-02T09:26:28.188 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 174/246 2023-11-02T09:26:28.188 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 175/246 2023-11-02T09:26:28.188 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 176/246 2023-11-02T09:26:28.188 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : alsa-lib-1.2.9-1.el9.x86_64 177/246 2023-11-02T09:26:28.189 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : avahi-glib-0.8-12.el9.x86_64 178/246 2023-11-02T09:26:28.189 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 179/246 2023-11-02T09:26:28.189 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : flatpak-1.12.8-1.el9.x86_64 180/246 2023-11-02T09:26:28.189 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : flatpak-selinux-1.12.8-1.el9.noarch 181/246 2023-11-02T09:26:28.189 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : flatpak-session-helper-1.12.8-1.el9.x86_64 182/246 2023-11-02T09:26:28.190 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 183/246 2023-11-02T09:26:28.190 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : gstreamer1-plugins-base-1.22.1-1.el9.x86_64 184/246 2023-11-02T09:26:28.190 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : jq-1.6-15.el9.x86_64 185/246 2023-11-02T09:26:28.190 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libX11-xcb-1.7.0-8.el9.x86_64 186/246 2023-11-02T09:26:28.190 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 187/246 2023-11-02T09:26:28.191 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 188/246 2023-11-02T09:26:28.191 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libdrm-2.4.115-1.el9.x86_64 189/246 2023-11-02T09:26:28.191 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 190/246 2023-11-02T09:26:28.191 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libtiff-4.4.0-10.el9.x86_64 191/246 2023-11-02T09:26:28.191 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 192/246 2023-11-02T09:26:28.191 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : lua-5.4.4-4.el9.x86_64 193/246 2023-11-02T09:26:28.192 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : mesa-libEGL-23.1.4-1.el9.x86_64 194/246 2023-11-02T09:26:28.192 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : mesa-libGL-23.1.4-1.el9.x86_64 195/246 2023-11-02T09:26:28.192 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : mesa-libgbm-23.1.4-1.el9.x86_64 196/246 2023-11-02T09:26:28.192 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : mesa-libglapi-23.1.4-1.el9.x86_64 197/246 2023-11-02T09:26:28.192 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : mesa-vulkan-drivers-23.1.4-1.el9.x86_64 198/246 2023-11-02T09:26:28.193 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : osinfo-db-20230518-1.el9.noarch 199/246 2023-11-02T09:26:28.193 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 200/246 2023-11-02T09:26:28.193 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : vulkan-loader-1.3.250.1-1.el9.x86_64 201/246 2023-11-02T09:26:28.193 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 202/246 2023-11-02T09:26:28.193 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 203/246 2023-11-02T09:26:28.194 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 204/246 2023-11-02T09:26:28.194 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 205/246 2023-11-02T09:26:28.194 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 206/246 2023-11-02T09:26:28.194 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 207/246 2023-11-02T09:26:28.194 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 208/246 2023-11-02T09:26:28.195 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 209/246 2023-11-02T09:26:28.195 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 210/246 2023-11-02T09:26:28.195 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 211/246 2023-11-02T09:26:28.195 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 212/246 2023-11-02T09:26:28.195 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 213/246 2023-11-02T09:26:28.195 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 214/246 2023-11-02T09:26:28.196 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 215/246 2023-11-02T09:26:28.196 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 216/246 2023-11-02T09:26:28.196 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-google-auth-1:2.23.3-1.el9.noarch 217/246 2023-11-02T09:26:28.196 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 218/246 2023-11-02T09:26:28.196 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 219/246 2023-11-02T09:26:28.196 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 220/246 2023-11-02T09:26:28.197 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 221/246 2023-11-02T09:26:28.197 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 222/246 2023-11-02T09:26:28.197 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 223/246 2023-11-02T09:26:28.197 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 224/246 2023-11-02T09:26:28.197 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 225/246 2023-11-02T09:26:28.198 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 226/246 2023-11-02T09:26:28.198 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 227/246 2023-11-02T09:26:28.198 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 228/246 2023-11-02T09:26:28.198 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 229/246 2023-11-02T09:26:28.198 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 230/246 2023-11-02T09:26:28.199 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 231/246 2023-11-02T09:26:28.199 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 232/246 2023-11-02T09:26:28.199 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 233/246 2023-11-02T09:26:28.199 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 234/246 2023-11-02T09:26:28.199 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 235/246 2023-11-02T09:26:28.200 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 236/246 2023-11-02T09:26:28.200 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 237/246 2023-11-02T09:26:28.200 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 238/246 2023-11-02T09:26:28.200 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 239/246 2023-11-02T09:26:28.200 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 240/246 2023-11-02T09:26:28.201 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : re2-1:20211101-3.el9.x86_64 241/246 2023-11-02T09:26:28.201 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 242/246 2023-11-02T09:26:28.201 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librados2-2:18.0.0-6872.g84d22000.el9.x86_64 243/246 2023-11-02T09:26:28.201 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 244/246 2023-11-02T09:26:28.201 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librbd1-2:18.0.0-6872.g84d22000.el9.x86_64 245/246 2023-11-02T09:26:31.398 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 246/246 2023-11-02T09:26:31.398 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:26:31.398 INFO:teuthology.orchestra.run.smithi156.stdout:Upgraded: 2023-11-02T09:26:31.399 INFO:teuthology.orchestra.run.smithi156.stdout: librados2-2:18.0.0-6872.g84d22000.el9.x86_64 2023-11-02T09:26:31.399 INFO:teuthology.orchestra.run.smithi156.stdout: librbd1-2:18.0.0-6872.g84d22000.el9.x86_64 2023-11-02T09:26:31.399 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-11-02T09:26:31.399 INFO:teuthology.orchestra.run.smithi156.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2023-11-02T09:26:31.400 INFO:teuthology.orchestra.run.smithi156.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2023-11-02T09:26:31.400 INFO:teuthology.orchestra.run.smithi156.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2023-11-02T09:26:31.400 INFO:teuthology.orchestra.run.smithi156.stdout: alsa-lib-1.2.9-1.el9.x86_64 2023-11-02T09:26:31.400 INFO:teuthology.orchestra.run.smithi156.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2023-11-02T09:26:31.400 INFO:teuthology.orchestra.run.smithi156.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2023-11-02T09:26:31.401 INFO:teuthology.orchestra.run.smithi156.stdout: atk-2.36.0-5.el9.x86_64 2023-11-02T09:26:31.401 INFO:teuthology.orchestra.run.smithi156.stdout: avahi-glib-0.8-12.el9.x86_64 2023-11-02T09:26:31.401 INFO:teuthology.orchestra.run.smithi156.stdout: bluez-libs-5.64-1.el9.x86_64 2023-11-02T09:26:31.401 INFO:teuthology.orchestra.run.smithi156.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-11-02T09:26:31.401 INFO:teuthology.orchestra.run.smithi156.stdout: bubblewrap-0.4.1-6.el9.x86_64 2023-11-02T09:26:31.402 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-2:18.0.0-6872.g84d22000.el9.x86_64 2023-11-02T09:26:31.402 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-base-2:18.0.0-6872.g84d22000.el9.x86_64 2023-11-02T09:26:31.402 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-common-2:18.0.0-6872.g84d22000.el9.x86_64 2023-11-02T09:26:31.402 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-fuse-2:18.0.0-6872.g84d22000.el9.x86_64 2023-11-02T09:26:31.402 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-grafana-dashboards-2:18.0.0-6872.g84d22000.el9.noarch 2023-11-02T09:26:31.403 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-immutable-object-cache-2:18.0.0-6872.g84d22000.el9.x86_64 2023-11-02T09:26:31.403 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mds-2:18.0.0-6872.g84d22000.el9.x86_64 2023-11-02T09:26:31.403 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-2:18.0.0-6872.g84d22000.el9.x86_64 2023-11-02T09:26:31.403 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-cephadm-2:18.0.0-6872.g84d22000.el9.noarch 2023-11-02T09:26:31.404 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-dashboard-2:18.0.0-6872.g84d22000.el9.noarch 2023-11-02T09:26:31.404 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6872.g84d22000.el9.noarch 2023-11-02T09:26:31.404 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-modules-core-2:18.0.0-6872.g84d22000.el9.noarch 2023-11-02T09:26:31.405 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-rook-2:18.0.0-6872.g84d22000.el9.noarch 2023-11-02T09:26:31.405 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mon-2:18.0.0-6872.g84d22000.el9.x86_64 2023-11-02T09:26:31.405 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-osd-2:18.0.0-6872.g84d22000.el9.x86_64 2023-11-02T09:26:31.405 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-prometheus-alerts-2:18.0.0-6872.g84d22000.el9.noarch 2023-11-02T09:26:31.405 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-radosgw-2:18.0.0-6872.g84d22000.el9.x86_64 2023-11-02T09:26:31.405 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-selinux-2:18.0.0-6872.g84d22000.el9.x86_64 2023-11-02T09:26:31.406 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-test-2:18.0.0-6872.g84d22000.el9.x86_64 2023-11-02T09:26:31.406 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-volume-2:18.0.0-6872.g84d22000.el9.noarch 2023-11-02T09:26:31.406 INFO:teuthology.orchestra.run.smithi156.stdout: cephadm-2:18.0.0-6872.g84d22000.el9.noarch 2023-11-02T09:26:31.406 INFO:teuthology.orchestra.run.smithi156.stdout: colord-libs-1.4.5-4.el9.x86_64 2023-11-02T09:26:31.406 INFO:teuthology.orchestra.run.smithi156.stdout: copy-jdk-configs-4.0-3.el9.noarch 2023-11-02T09:26:31.407 INFO:teuthology.orchestra.run.smithi156.stdout: cups-libs-1:2.3.3op2-21.el9.x86_64 2023-11-02T09:26:31.407 INFO:teuthology.orchestra.run.smithi156.stdout: dconf-0.40.0-6.el9.x86_64 2023-11-02T09:26:31.407 INFO:teuthology.orchestra.run.smithi156.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2023-11-02T09:26:31.407 INFO:teuthology.orchestra.run.smithi156.stdout: exiv2-0.27.5-2.el9.x86_64 2023-11-02T09:26:31.407 INFO:teuthology.orchestra.run.smithi156.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2023-11-02T09:26:31.408 INFO:teuthology.orchestra.run.smithi156.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2023-11-02T09:26:31.408 INFO:teuthology.orchestra.run.smithi156.stdout: flac-libs-1.3.3-12.el9.x86_64 2023-11-02T09:26:31.408 INFO:teuthology.orchestra.run.smithi156.stdout: flatpak-1.12.8-1.el9.x86_64 2023-11-02T09:26:31.408 INFO:teuthology.orchestra.run.smithi156.stdout: flatpak-selinux-1.12.8-1.el9.noarch 2023-11-02T09:26:31.408 INFO:teuthology.orchestra.run.smithi156.stdout: flatpak-session-helper-1.12.8-1.el9.x86_64 2023-11-02T09:26:31.409 INFO:teuthology.orchestra.run.smithi156.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-11-02T09:26:31.409 INFO:teuthology.orchestra.run.smithi156.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-11-02T09:26:31.409 INFO:teuthology.orchestra.run.smithi156.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-11-02T09:26:31.409 INFO:teuthology.orchestra.run.smithi156.stdout: fmt-8.1.1-5.el9.x86_64 2023-11-02T09:26:31.410 INFO:teuthology.orchestra.run.smithi156.stdout: fuse-2.9.9-15.el9.x86_64 2023-11-02T09:26:31.410 INFO:teuthology.orchestra.run.smithi156.stdout: gdk-pixbuf2-modules-2.42.6-3.el9.x86_64 2023-11-02T09:26:31.412 INFO:teuthology.orchestra.run.smithi156.stdout: geoclue2-2.6.0-7.el9.x86_64 2023-11-02T09:26:31.412 INFO:teuthology.orchestra.run.smithi156.stdout: giflib-5.2.1-9.el9.x86_64 2023-11-02T09:26:31.412 INFO:teuthology.orchestra.run.smithi156.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-11-02T09:26:31.412 INFO:teuthology.orchestra.run.smithi156.stdout: graphene-1.10.6-2.el9.x86_64 2023-11-02T09:26:31.413 INFO:teuthology.orchestra.run.smithi156.stdout: gsm-1.0.19-6.el9.x86_64 2023-11-02T09:26:31.413 INFO:teuthology.orchestra.run.smithi156.stdout: gstreamer1-1.22.1-2.el9.x86_64 2023-11-02T09:26:31.413 INFO:teuthology.orchestra.run.smithi156.stdout: gstreamer1-plugins-base-1.22.1-1.el9.x86_64 2023-11-02T09:26:31.413 INFO:teuthology.orchestra.run.smithi156.stdout: gtk-update-icon-cache-3.24.31-2.el9.x86_64 2023-11-02T09:26:31.413 INFO:teuthology.orchestra.run.smithi156.stdout: gtk3-3.24.31-2.el9.x86_64 2023-11-02T09:26:31.414 INFO:teuthology.orchestra.run.smithi156.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2023-11-02T09:26:31.414 INFO:teuthology.orchestra.run.smithi156.stdout: iso-codes-4.6.0-3.el9.noarch 2023-11-02T09:26:31.414 INFO:teuthology.orchestra.run.smithi156.stdout: java-11-openjdk-1:11.0.18.0.10-3.el9.x86_64 2023-11-02T09:26:31.414 INFO:teuthology.orchestra.run.smithi156.stdout: java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x86_64 2023-11-02T09:26:31.414 INFO:teuthology.orchestra.run.smithi156.stdout: javapackages-filesystem-6.0.0-4.el9.noarch 2023-11-02T09:26:31.415 INFO:teuthology.orchestra.run.smithi156.stdout: jbigkit-libs-2.1-23.el9.x86_64 2023-11-02T09:26:31.415 INFO:teuthology.orchestra.run.smithi156.stdout: jq-1.6-15.el9.x86_64 2023-11-02T09:26:31.415 INFO:teuthology.orchestra.run.smithi156.stdout: lcms2-2.12-3.el9.x86_64 2023-11-02T09:26:31.415 INFO:teuthology.orchestra.run.smithi156.stdout: libX11-xcb-1.7.0-8.el9.x86_64 2023-11-02T09:26:31.415 INFO:teuthology.orchestra.run.smithi156.stdout: libXcomposite-0.4.5-7.el9.x86_64 2023-11-02T09:26:31.416 INFO:teuthology.orchestra.run.smithi156.stdout: libXcursor-1.2.0-7.el9.x86_64 2023-11-02T09:26:31.416 INFO:teuthology.orchestra.run.smithi156.stdout: libXdamage-1.1.5-7.el9.x86_64 2023-11-02T09:26:31.416 INFO:teuthology.orchestra.run.smithi156.stdout: libXfixes-5.0.3-16.el9.x86_64 2023-11-02T09:26:31.416 INFO:teuthology.orchestra.run.smithi156.stdout: libXi-1.7.10-8.el9.x86_64 2023-11-02T09:26:31.416 INFO:teuthology.orchestra.run.smithi156.stdout: libXinerama-1.1.4-10.el9.x86_64 2023-11-02T09:26:31.417 INFO:teuthology.orchestra.run.smithi156.stdout: libXrandr-1.5.2-8.el9.x86_64 2023-11-02T09:26:31.417 INFO:teuthology.orchestra.run.smithi156.stdout: libXtst-1.2.3-16.el9.x86_64 2023-11-02T09:26:31.417 INFO:teuthology.orchestra.run.smithi156.stdout: libXv-1.0.11-16.el9.x86_64 2023-11-02T09:26:31.417 INFO:teuthology.orchestra.run.smithi156.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2023-11-02T09:26:31.417 INFO:teuthology.orchestra.run.smithi156.stdout: libarrow-9.0.0-9.el9.x86_64 2023-11-02T09:26:31.418 INFO:teuthology.orchestra.run.smithi156.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-11-02T09:26:31.418 INFO:teuthology.orchestra.run.smithi156.stdout: libasyncns-0.8-22.el9.x86_64 2023-11-02T09:26:31.418 INFO:teuthology.orchestra.run.smithi156.stdout: libcanberra-0.30-27.el9.x86_64 2023-11-02T09:26:31.418 INFO:teuthology.orchestra.run.smithi156.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2023-11-02T09:26:31.418 INFO:teuthology.orchestra.run.smithi156.stdout: libcephfs-devel-2:18.0.0-6872.g84d22000.el9.x86_64 2023-11-02T09:26:31.419 INFO:teuthology.orchestra.run.smithi156.stdout: libcephfs2-2:18.0.0-6872.g84d22000.el9.x86_64 2023-11-02T09:26:31.419 INFO:teuthology.orchestra.run.smithi156.stdout: libcephsqlite-2:18.0.0-6872.g84d22000.el9.x86_64 2023-11-02T09:26:31.419 INFO:teuthology.orchestra.run.smithi156.stdout: libdrm-2.4.115-1.el9.x86_64 2023-11-02T09:26:31.419 INFO:teuthology.orchestra.run.smithi156.stdout: libepoxy-1.5.5-4.el9.x86_64 2023-11-02T09:26:31.419 INFO:teuthology.orchestra.run.smithi156.stdout: libexif-0.6.22-6.el9.x86_64 2023-11-02T09:26:31.420 INFO:teuthology.orchestra.run.smithi156.stdout: libfontenc-1.1.3-17.el9.x86_64 2023-11-02T09:26:31.420 INFO:teuthology.orchestra.run.smithi156.stdout: libgexiv2-0.12.3-1.el9.x86_64 2023-11-02T09:26:31.420 INFO:teuthology.orchestra.run.smithi156.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-11-02T09:26:31.421 INFO:teuthology.orchestra.run.smithi156.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2023-11-02T09:26:31.421 INFO:teuthology.orchestra.run.smithi156.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2023-11-02T09:26:31.421 INFO:teuthology.orchestra.run.smithi156.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2023-11-02T09:26:31.421 INFO:teuthology.orchestra.run.smithi156.stdout: libgsf-1.14.47-5.el9.x86_64 2023-11-02T09:26:31.422 INFO:teuthology.orchestra.run.smithi156.stdout: libgxps-0.3.2-3.el9.x86_64 2023-11-02T09:26:31.422 INFO:teuthology.orchestra.run.smithi156.stdout: libiptcdata-1.0.5-9.el9.x86_64 2023-11-02T09:26:31.422 INFO:teuthology.orchestra.run.smithi156.stdout: libldac-2.0.2.3-10.el9.x86_64 2023-11-02T09:26:31.422 INFO:teuthology.orchestra.run.smithi156.stdout: libnotify-0.7.9-8.el9.x86_64 2023-11-02T09:26:31.422 INFO:teuthology.orchestra.run.smithi156.stdout: liboath-2.6.7-2.el9.x86_64 2023-11-02T09:26:31.423 INFO:teuthology.orchestra.run.smithi156.stdout: libogg-2:1.3.4-6.el9.x86_64 2023-11-02T09:26:31.423 INFO:teuthology.orchestra.run.smithi156.stdout: libosinfo-1.10.0-1.el9.x86_64 2023-11-02T09:26:31.423 INFO:teuthology.orchestra.run.smithi156.stdout: libpciaccess-0.16-6.el9.x86_64 2023-11-02T09:26:31.423 INFO:teuthology.orchestra.run.smithi156.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-11-02T09:26:31.423 INFO:teuthology.orchestra.run.smithi156.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-11-02T09:26:31.424 INFO:teuthology.orchestra.run.smithi156.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-11-02T09:26:31.424 INFO:teuthology.orchestra.run.smithi156.stdout: librados-devel-2:18.0.0-6872.g84d22000.el9.x86_64 2023-11-02T09:26:31.424 INFO:teuthology.orchestra.run.smithi156.stdout: libradosstriper1-2:18.0.0-6872.g84d22000.el9.x86_64 2023-11-02T09:26:31.424 INFO:teuthology.orchestra.run.smithi156.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-11-02T09:26:31.424 INFO:teuthology.orchestra.run.smithi156.stdout: librgw2-2:18.0.0-6872.g84d22000.el9.x86_64 2023-11-02T09:26:31.424 INFO:teuthology.orchestra.run.smithi156.stdout: libsbc-1.4-9.el9.x86_64 2023-11-02T09:26:31.425 INFO:teuthology.orchestra.run.smithi156.stdout: libsndfile-1.0.31-7.el9.x86_64 2023-11-02T09:26:31.425 INFO:teuthology.orchestra.run.smithi156.stdout: libtheora-1:1.1.1-31.el9.x86_64 2023-11-02T09:26:31.425 INFO:teuthology.orchestra.run.smithi156.stdout: libtiff-4.4.0-10.el9.x86_64 2023-11-02T09:26:31.425 INFO:teuthology.orchestra.run.smithi156.stdout: libtool-ltdl-2.4.6-45.el9.x86_64 2023-11-02T09:26:31.425 INFO:teuthology.orchestra.run.smithi156.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2023-11-02T09:26:31.426 INFO:teuthology.orchestra.run.smithi156.stdout: libunwind-1.6.2-1.el9.x86_64 2023-11-02T09:26:31.426 INFO:teuthology.orchestra.run.smithi156.stdout: libvisual-1:0.4.0-34.el9.x86_64 2023-11-02T09:26:31.426 INFO:teuthology.orchestra.run.smithi156.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2023-11-02T09:26:31.426 INFO:teuthology.orchestra.run.smithi156.stdout: libwayland-client-1.21.0-1.el9.x86_64 2023-11-02T09:26:31.426 INFO:teuthology.orchestra.run.smithi156.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2023-11-02T09:26:31.427 INFO:teuthology.orchestra.run.smithi156.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2023-11-02T09:26:31.427 INFO:teuthology.orchestra.run.smithi156.stdout: libwayland-server-1.21.0-1.el9.x86_64 2023-11-02T09:26:31.427 INFO:teuthology.orchestra.run.smithi156.stdout: libwebp-1.2.0-8.el9.x86_64 2023-11-02T09:26:31.427 INFO:teuthology.orchestra.run.smithi156.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2023-11-02T09:26:31.427 INFO:teuthology.orchestra.run.smithi156.stdout: libxshmfence-1.3-10.el9.x86_64 2023-11-02T09:26:31.428 INFO:teuthology.orchestra.run.smithi156.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2023-11-02T09:26:31.428 INFO:teuthology.orchestra.run.smithi156.stdout: low-memory-monitor-2.1-4.el9.x86_64 2023-11-02T09:26:31.428 INFO:teuthology.orchestra.run.smithi156.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-11-02T09:26:31.428 INFO:teuthology.orchestra.run.smithi156.stdout: lua-5.4.4-4.el9.x86_64 2023-11-02T09:26:31.428 INFO:teuthology.orchestra.run.smithi156.stdout: lua-posix-35.0-8.el9.x86_64 2023-11-02T09:26:31.429 INFO:teuthology.orchestra.run.smithi156.stdout: mesa-libEGL-23.1.4-1.el9.x86_64 2023-11-02T09:26:31.429 INFO:teuthology.orchestra.run.smithi156.stdout: mesa-libGL-23.1.4-1.el9.x86_64 2023-11-02T09:26:31.429 INFO:teuthology.orchestra.run.smithi156.stdout: mesa-libgbm-23.1.4-1.el9.x86_64 2023-11-02T09:26:31.429 INFO:teuthology.orchestra.run.smithi156.stdout: mesa-libglapi-23.1.4-1.el9.x86_64 2023-11-02T09:26:31.429 INFO:teuthology.orchestra.run.smithi156.stdout: mesa-vulkan-drivers-23.1.4-1.el9.x86_64 2023-11-02T09:26:31.430 INFO:teuthology.orchestra.run.smithi156.stdout: mkfontscale-1.2.1-3.el9.x86_64 2023-11-02T09:26:31.430 INFO:teuthology.orchestra.run.smithi156.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-11-02T09:26:31.430 INFO:teuthology.orchestra.run.smithi156.stdout: openblas-0.3.21-2.el9.x86_64 2023-11-02T09:26:31.430 INFO:teuthology.orchestra.run.smithi156.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-11-02T09:26:31.430 INFO:teuthology.orchestra.run.smithi156.stdout: openjpeg2-2.4.0-7.el9.x86_64 2023-11-02T09:26:31.431 INFO:teuthology.orchestra.run.smithi156.stdout: opus-1.3.1-10.el9.x86_64 2023-11-02T09:26:31.431 INFO:teuthology.orchestra.run.smithi156.stdout: orc-0.4.31-6.el9.x86_64 2023-11-02T09:26:31.431 INFO:teuthology.orchestra.run.smithi156.stdout: osinfo-db-20230518-1.el9.noarch 2023-11-02T09:26:31.431 INFO:teuthology.orchestra.run.smithi156.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2023-11-02T09:26:31.431 INFO:teuthology.orchestra.run.smithi156.stdout: ostree-libs-2023.6-1.el9.x86_64 2023-11-02T09:26:31.432 INFO:teuthology.orchestra.run.smithi156.stdout: p11-kit-server-0.24.1-2.el9.x86_64 2023-11-02T09:26:31.432 INFO:teuthology.orchestra.run.smithi156.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-11-02T09:26:31.432 INFO:teuthology.orchestra.run.smithi156.stdout: pipewire-0.3.67-2.el9.x86_64 2023-11-02T09:26:31.432 INFO:teuthology.orchestra.run.smithi156.stdout: pipewire-alsa-0.3.67-2.el9.x86_64 2023-11-02T09:26:31.432 INFO:teuthology.orchestra.run.smithi156.stdout: pipewire-jack-audio-connection-kit-0.3.67-2.el9.x86_64 2023-11-02T09:26:31.433 INFO:teuthology.orchestra.run.smithi156.stdout: pipewire-libs-0.3.67-2.el9.x86_64 2023-11-02T09:26:31.433 INFO:teuthology.orchestra.run.smithi156.stdout: pipewire-pulseaudio-0.3.67-2.el9.x86_64 2023-11-02T09:26:31.433 INFO:teuthology.orchestra.run.smithi156.stdout: poppler-21.01.0-19.el9.x86_64 2023-11-02T09:26:31.433 INFO:teuthology.orchestra.run.smithi156.stdout: poppler-data-0.4.9-9.el9.noarch 2023-11-02T09:26:31.433 INFO:teuthology.orchestra.run.smithi156.stdout: poppler-glib-21.01.0-19.el9.x86_64 2023-11-02T09:26:31.434 INFO:teuthology.orchestra.run.smithi156.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2023-11-02T09:26:31.434 INFO:teuthology.orchestra.run.smithi156.stdout: pulseaudio-utils-15.0-2.el9.x86_64 2023-11-02T09:26:31.434 INFO:teuthology.orchestra.run.smithi156.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-11-02T09:26:31.434 INFO:teuthology.orchestra.run.smithi156.stdout: python3-babel-2.9.1-2.el9.noarch 2023-11-02T09:26:31.434 INFO:teuthology.orchestra.run.smithi156.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-11-02T09:26:31.435 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-11-02T09:26:31.435 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ceph-argparse-2:18.0.0-6872.g84d22000.el9.x86_64 2023-11-02T09:26:31.435 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ceph-common-2:18.0.0-6872.g84d22000.el9.x86_64 2023-11-02T09:26:31.435 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cephfs-2:18.0.0-6872.g84d22000.el9.x86_64 2023-11-02T09:26:31.435 INFO:teuthology.orchestra.run.smithi156.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-11-02T09:26:31.436 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-11-02T09:26:31.436 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-11-02T09:26:31.436 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-11-02T09:26:31.436 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-11-02T09:26:31.436 INFO:teuthology.orchestra.run.smithi156.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-11-02T09:26:31.437 INFO:teuthology.orchestra.run.smithi156.stdout: python3-google-auth-1:2.23.3-1.el9.noarch 2023-11-02T09:26:31.437 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-11-02T09:26:31.437 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-11-02T09:26:31.437 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-11-02T09:26:31.437 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-11-02T09:26:31.438 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-11-02T09:26:31.438 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-11-02T09:26:31.438 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-11-02T09:26:31.438 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-11-02T09:26:31.438 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-11-02T09:26:31.439 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-11-02T09:26:31.439 INFO:teuthology.orchestra.run.smithi156.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-11-02T09:26:31.439 INFO:teuthology.orchestra.run.smithi156.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-11-02T09:26:31.439 INFO:teuthology.orchestra.run.smithi156.stdout: python3-mako-1.1.4-6.el9.noarch 2023-11-02T09:26:31.439 INFO:teuthology.orchestra.run.smithi156.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-11-02T09:26:31.440 INFO:teuthology.orchestra.run.smithi156.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-11-02T09:26:31.440 INFO:teuthology.orchestra.run.smithi156.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-11-02T09:26:31.440 INFO:teuthology.orchestra.run.smithi156.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-11-02T09:26:31.440 INFO:teuthology.orchestra.run.smithi156.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-11-02T09:26:31.440 INFO:teuthology.orchestra.run.smithi156.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-11-02T09:26:31.441 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-11-02T09:26:31.441 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ply-3.11-14.el9.noarch 2023-11-02T09:26:31.441 INFO:teuthology.orchestra.run.smithi156.stdout: python3-portend-3.1.0-2.el9.noarch 2023-11-02T09:26:31.441 INFO:teuthology.orchestra.run.smithi156.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-11-02T09:26:31.441 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-11-02T09:26:31.441 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-11-02T09:26:31.442 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-11-02T09:26:31.442 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pycparser-2.20-6.el9.noarch 2023-11-02T09:26:31.442 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pytz-2021.1-5.el9.noarch 2023-11-02T09:26:31.442 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rados-2:18.0.0-6872.g84d22000.el9.x86_64 2023-11-02T09:26:31.442 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rbd-2:18.0.0-6872.g84d22000.el9.x86_64 2023-11-02T09:26:31.443 INFO:teuthology.orchestra.run.smithi156.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-11-02T09:26:31.443 INFO:teuthology.orchestra.run.smithi156.stdout: python3-requests-2.25.1-7.el9.noarch 2023-11-02T09:26:31.443 INFO:teuthology.orchestra.run.smithi156.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-11-02T09:26:31.443 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rgw-2:18.0.0-6872.g84d22000.el9.x86_64 2023-11-02T09:26:31.443 INFO:teuthology.orchestra.run.smithi156.stdout: python3-routes-2.5.1-5.el9.noarch 2023-11-02T09:26:31.444 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rsa-4.9-2.el9.noarch 2023-11-02T09:26:31.444 INFO:teuthology.orchestra.run.smithi156.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-11-02T09:26:31.444 INFO:teuthology.orchestra.run.smithi156.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-11-02T09:26:31.444 INFO:teuthology.orchestra.run.smithi156.stdout: python3-toml-0.10.2-6.el9.noarch 2023-11-02T09:26:31.445 INFO:teuthology.orchestra.run.smithi156.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-11-02T09:26:31.445 INFO:teuthology.orchestra.run.smithi156.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-11-02T09:26:31.445 INFO:teuthology.orchestra.run.smithi156.stdout: python3-webob-1.8.7-6.el9.noarch 2023-11-02T09:26:31.445 INFO:teuthology.orchestra.run.smithi156.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-11-02T09:26:31.445 INFO:teuthology.orchestra.run.smithi156.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-11-02T09:26:31.446 INFO:teuthology.orchestra.run.smithi156.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-11-02T09:26:31.446 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-fuse-2:18.0.0-6872.g84d22000.el9.x86_64 2023-11-02T09:26:31.446 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-mirror-2:18.0.0-6872.g84d22000.el9.x86_64 2023-11-02T09:26:31.446 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-nbd-2:18.0.0-6872.g84d22000.el9.x86_64 2023-11-02T09:26:31.446 INFO:teuthology.orchestra.run.smithi156.stdout: re2-1:20211101-3.el9.x86_64 2023-11-02T09:26:31.447 INFO:teuthology.orchestra.run.smithi156.stdout: rtkit-0.11-28.el9.x86_64 2023-11-02T09:26:31.447 INFO:teuthology.orchestra.run.smithi156.stdout: socat-1.7.4.1-5.el9.x86_64 2023-11-02T09:26:31.447 INFO:teuthology.orchestra.run.smithi156.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2023-11-02T09:26:31.447 INFO:teuthology.orchestra.run.smithi156.stdout: thrift-0.15.0-2.el9.x86_64 2023-11-02T09:26:31.447 INFO:teuthology.orchestra.run.smithi156.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2023-11-02T09:26:31.448 INFO:teuthology.orchestra.run.smithi156.stdout: tracker-3.1.2-3.el9.x86_64 2023-11-02T09:26:31.448 INFO:teuthology.orchestra.run.smithi156.stdout: tracker-miners-3.1.2-3.el9.x86_64 2023-11-02T09:26:31.448 INFO:teuthology.orchestra.run.smithi156.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2023-11-02T09:26:31.448 INFO:teuthology.orchestra.run.smithi156.stdout: tzdata-java-2023c-1.el9.noarch 2023-11-02T09:26:31.448 INFO:teuthology.orchestra.run.smithi156.stdout: upower-0.99.11-11.el9.x86_64 2023-11-02T09:26:31.449 INFO:teuthology.orchestra.run.smithi156.stdout: vulkan-loader-1.3.250.1-1.el9.x86_64 2023-11-02T09:26:31.449 INFO:teuthology.orchestra.run.smithi156.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2023-11-02T09:26:31.449 INFO:teuthology.orchestra.run.smithi156.stdout: wireplumber-0.4.14-1.el9.x86_64 2023-11-02T09:26:31.449 INFO:teuthology.orchestra.run.smithi156.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2023-11-02T09:26:31.449 INFO:teuthology.orchestra.run.smithi156.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2023-11-02T09:26:31.450 INFO:teuthology.orchestra.run.smithi156.stdout: xdg-desktop-portal-1.12.4-1.el9.x86_64 2023-11-02T09:26:31.450 INFO:teuthology.orchestra.run.smithi156.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2023-11-02T09:26:31.450 INFO:teuthology.orchestra.run.smithi156.stdout: xkeyboard-config-2.33-2.el9.noarch 2023-11-02T09:26:31.450 INFO:teuthology.orchestra.run.smithi156.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-11-02T09:26:31.451 INFO:teuthology.orchestra.run.smithi156.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2023-11-02T09:26:31.451 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:26:31.451 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-11-02T09:26:31.748 DEBUG:teuthology.parallel:result is None 2023-11-02T09:26:31.749 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=84d22000a111c0f6e32c6bf0246b078c52c8bdde 2023-11-02T09:26:32.016 DEBUG:teuthology.orchestra.run.smithi156:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-02T09:26:32.106 INFO:teuthology.orchestra.run.smithi156.stdout:18.0.0-6872.g84d22000.el9 2023-11-02T09:26:32.107 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6872.g84d22000.el9 2023-11-02T09:26:32.107 INFO:teuthology.task.install:The correct ceph version 18.0.0-6872.g84d22000 is installed. 2023-11-02T09:26:32.108 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=84d22000a111c0f6e32c6bf0246b078c52c8bdde 2023-11-02T09:26:32.341 DEBUG:teuthology.orchestra.run.smithi186:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-02T09:26:32.454 INFO:teuthology.orchestra.run.smithi186.stdout:18.0.0-6872.g84d22000.el9 2023-11-02T09:26:32.455 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6872.g84d22000.el9 2023-11-02T09:26:32.455 INFO:teuthology.task.install:The correct ceph version 18.0.0-6872.g84d22000 is installed. 2023-11-02T09:26:32.456 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-11-02T09:26:32.466 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-11-02T09:26:32.467 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-02T09:26:32.514 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-11-02T09:26:32.514 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-02T09:26:32.563 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-11-02T09:26:32.564 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-11-02T09:26:32.564 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/usr/bin/daemon-helper 2023-11-02T09:26:32.606 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-02T09:26:32.688 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-11-02T09:26:32.688 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/usr/bin/daemon-helper 2023-11-02T09:26:32.733 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-02T09:26:32.818 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-11-02T09:26:32.818 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-11-02T09:26:32.819 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-02T09:26:32.859 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-02T09:26:32.939 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-11-02T09:26:32.939 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-02T09:26:32.980 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-02T09:26:33.060 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-11-02T09:26:33.061 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-11-02T09:26:33.061 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/usr/bin/stdin-killer 2023-11-02T09:26:33.101 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-02T09:26:33.182 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-11-02T09:26:33.182 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/usr/bin/stdin-killer 2023-11-02T09:26:33.222 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-02T09:26:33.303 INFO:teuthology.run_tasks:Running task ceph... 2023-11-02T09:26:33.586 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-11-02T09:26:33.587 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod 777 /var/log/ceph 2023-11-02T09:26:33.590 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod 777 /var/log/ceph 2023-11-02T09:26:33.630 INFO:tasks.ceph:Disabling ceph logrotate... 2023-11-02T09:26:33.631 DEBUG:teuthology.orchestra.run.smithi156:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-02T09:26:33.671 DEBUG:teuthology.orchestra.run.smithi186:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-02T09:26:33.710 INFO:tasks.ceph:Creating extra log directories... 2023-11-02T09:26:33.711 DEBUG:teuthology.orchestra.run.smithi156:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-02T09:26:33.752 DEBUG:teuthology.orchestra.run.smithi186:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-02T09:26:33.801 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-11-02T09:26:33.801 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-11-02T09:26:33.802 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/alimasa-2023-11-02_07:21:35-rgw:notifications-wip-alimasa-2pc-remove-issue-distro-default-smithi/7444142', 'branch': 'wip-alimasa-2pc-remove-issue', 'description': 'rgw:notifications/{beast bluestore-bitmap centos_latest fixed-2 ignore-pg-availability overrides tasks/{0-install test_amqp test_kafka test_others}}', 'email': None, 'first_in_suite': False, 'job_id': '7444142', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'alimasa-2023-11-02_07:21:35-rgw:notifications-wip-alimasa-2pc-remove-issue-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-alimasa-2pc-remove-issue'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': '84d22000a111c0f6e32c6bf0246b078c52c8bdde'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'extra_system_packages': {'deb': ['default-jre'], 'rpm': ['java']}, 'flavor': 'default', 'sha1': '84d22000a111c0f6e32c6bf0246b078c52c8bdde'}}, 'rgw': {'frontend': 'beast', 'storage classes': 'LUKEWARM, FROZEN'}, 's3tests': {'storage classes': 'LUKEWARM, FROZEN'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-alimasa-2pc-remove-issue', 'sha1': '84d22000a111c0f6e32c6bf0246b078c52c8bdde'}}, 'owner': 'scheduled_alimasa@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'sha1': '84d22000a111c0f6e32c6bf0246b078c52c8bdde', 'sleep_before_teardown': 0, 'suite': 'rgw:notifications', 'suite_branch': 'wip-alimasa-2pc-remove-issue', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '84d22000a111c0f6e32c6bf0246b078c52c8bdde', 'targets': {'smithi156.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLny8vT41KenT/XBLKWfPw5JqXTJ6Dgk/RyoCDIyrrrN3uH7A/XLi7LA5lj3S/JRoWvG5D7+etWFk2POCDrQXys=', 'smithi186.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEUgB4WEEEueDe7qvQI1h000GrLx2Uh8nxJMxsHr7LwwnVmTIxtBSW/5uo51qz3GYsdvIQJwPOsCA+YdWOisM+o='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': None}}, {'rabbitmq': {'client.0': None}}, {'notification-tests': {'client.0': {'extra_attr': ['amqp_test'], 'rgw_server': 'client.0'}}}, {'kafka': {'client.0': {'kafka_version': '2.6.0'}}}, {'notification-tests': {'client.0': {'extra_attr': ['kafka_test'], 'rgw_server': 'client.0'}}}, {'notification-tests': {'client.0': {'rgw_server': 'client.0'}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '6899cd26fceddb2fec83dc1a1349394b28c8998e', 'timestamp': '2023-11-02_07:21:35', 'tube': 'smithi', 'user': 'alimasa', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.770726'} 2023-11-02T09:26:33.803 DEBUG:teuthology.orchestra.run.smithi156:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-02T09:26:33.833 DEBUG:teuthology.orchestra.run.smithi186:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-02T09:26:33.863 DEBUG:teuthology.orchestra.run.smithi156:> sudo install -d -m0777 -- /var/run/ceph 2023-11-02T09:26:33.901 DEBUG:teuthology.orchestra.run.smithi186:> sudo install -d -m0777 -- /var/run/ceph 2023-11-02T09:26:33.941 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-11-02T09:26:33.942 DEBUG:teuthology.orchestra.run.smithi156:> dd if=/scratch_devs of=/dev/stdout 2023-11-02T09:26:34.008 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-02T09:26:34.009 DEBUG:teuthology.orchestra.run.smithi156:> stat /dev/vg_nvme/lv_1 2023-11-02T09:26:34.076 INFO:teuthology.orchestra.run.smithi156.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-02T09:26:34.076 INFO:teuthology.orchestra.run.smithi156.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-02T09:26:34.077 INFO:teuthology.orchestra.run.smithi156.stdout:Device: 5h/5d Inode: 664 Links: 1 2023-11-02T09:26:34.077 INFO:teuthology.orchestra.run.smithi156.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-02T09:26:34.077 INFO:teuthology.orchestra.run.smithi156.stdout:Context: system_u:object_r:device_t:s0 2023-11-02T09:26:34.077 INFO:teuthology.orchestra.run.smithi156.stdout:Access: 2023-11-02 09:26:22.947639186 +0000 2023-11-02T09:26:34.077 INFO:teuthology.orchestra.run.smithi156.stdout:Modify: 2023-11-02 09:23:55.077999596 +0000 2023-11-02T09:26:34.078 INFO:teuthology.orchestra.run.smithi156.stdout:Change: 2023-11-02 09:23:55.077999596 +0000 2023-11-02T09:26:34.078 INFO:teuthology.orchestra.run.smithi156.stdout: Birth: 2023-11-02 09:23:55.077999596 +0000 2023-11-02T09:26:34.078 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-02T09:26:34.155 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records in 2023-11-02T09:26:34.156 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records out 2023-11-02T09:26:34.156 INFO:teuthology.orchestra.run.smithi156.stderr:512 bytes copied, 0.000104267 s, 4.9 MB/s 2023-11-02T09:26:34.157 DEBUG:teuthology.orchestra.run.smithi156:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-02T09:26:34.224 DEBUG:teuthology.orchestra.run.smithi156:> stat /dev/vg_nvme/lv_2 2023-11-02T09:26:34.293 INFO:teuthology.orchestra.run.smithi156.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-02T09:26:34.294 INFO:teuthology.orchestra.run.smithi156.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-02T09:26:34.294 INFO:teuthology.orchestra.run.smithi156.stdout:Device: 5h/5d Inode: 682 Links: 1 2023-11-02T09:26:34.294 INFO:teuthology.orchestra.run.smithi156.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-02T09:26:34.294 INFO:teuthology.orchestra.run.smithi156.stdout:Context: system_u:object_r:device_t:s0 2023-11-02T09:26:34.295 INFO:teuthology.orchestra.run.smithi156.stdout:Access: 2023-11-02 09:26:22.948639172 +0000 2023-11-02T09:26:34.295 INFO:teuthology.orchestra.run.smithi156.stdout:Modify: 2023-11-02 09:23:55.626991799 +0000 2023-11-02T09:26:34.295 INFO:teuthology.orchestra.run.smithi156.stdout:Change: 2023-11-02 09:23:55.626991799 +0000 2023-11-02T09:26:34.295 INFO:teuthology.orchestra.run.smithi156.stdout: Birth: 2023-11-02 09:23:55.626991799 +0000 2023-11-02T09:26:34.296 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-02T09:26:34.373 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records in 2023-11-02T09:26:34.373 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records out 2023-11-02T09:26:34.374 INFO:teuthology.orchestra.run.smithi156.stderr:512 bytes copied, 0.000104446 s, 4.9 MB/s 2023-11-02T09:26:34.375 DEBUG:teuthology.orchestra.run.smithi156:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-02T09:26:34.443 DEBUG:teuthology.orchestra.run.smithi156:> stat /dev/vg_nvme/lv_3 2023-11-02T09:26:34.511 INFO:teuthology.orchestra.run.smithi156.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-02T09:26:34.511 INFO:teuthology.orchestra.run.smithi156.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-02T09:26:34.511 INFO:teuthology.orchestra.run.smithi156.stdout:Device: 5h/5d Inode: 702 Links: 1 2023-11-02T09:26:34.512 INFO:teuthology.orchestra.run.smithi156.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-02T09:26:34.512 INFO:teuthology.orchestra.run.smithi156.stdout:Context: system_u:object_r:device_t:s0 2023-11-02T09:26:34.512 INFO:teuthology.orchestra.run.smithi156.stdout:Access: 2023-11-02 09:26:22.948639172 +0000 2023-11-02T09:26:34.512 INFO:teuthology.orchestra.run.smithi156.stdout:Modify: 2023-11-02 09:23:56.246982994 +0000 2023-11-02T09:26:34.512 INFO:teuthology.orchestra.run.smithi156.stdout:Change: 2023-11-02 09:23:56.246982994 +0000 2023-11-02T09:26:34.513 INFO:teuthology.orchestra.run.smithi156.stdout: Birth: 2023-11-02 09:23:56.246982994 +0000 2023-11-02T09:26:34.513 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-02T09:26:34.588 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records in 2023-11-02T09:26:34.588 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records out 2023-11-02T09:26:34.589 INFO:teuthology.orchestra.run.smithi156.stderr:512 bytes copied, 9.5271e-05 s, 5.4 MB/s 2023-11-02T09:26:34.590 DEBUG:teuthology.orchestra.run.smithi156:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-02T09:26:34.658 DEBUG:teuthology.orchestra.run.smithi156:> stat /dev/vg_nvme/lv_4 2023-11-02T09:26:34.726 INFO:teuthology.orchestra.run.smithi156.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-02T09:26:34.726 INFO:teuthology.orchestra.run.smithi156.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-02T09:26:34.726 INFO:teuthology.orchestra.run.smithi156.stdout:Device: 5h/5d Inode: 719 Links: 1 2023-11-02T09:26:34.726 INFO:teuthology.orchestra.run.smithi156.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-02T09:26:34.727 INFO:teuthology.orchestra.run.smithi156.stdout:Context: system_u:object_r:device_t:s0 2023-11-02T09:26:34.727 INFO:teuthology.orchestra.run.smithi156.stdout:Access: 2023-11-02 09:26:22.949639158 +0000 2023-11-02T09:26:34.727 INFO:teuthology.orchestra.run.smithi156.stdout:Modify: 2023-11-02 09:23:56.775975481 +0000 2023-11-02T09:26:34.727 INFO:teuthology.orchestra.run.smithi156.stdout:Change: 2023-11-02 09:23:56.775975481 +0000 2023-11-02T09:26:34.728 INFO:teuthology.orchestra.run.smithi156.stdout: Birth: 2023-11-02 09:23:56.775975481 +0000 2023-11-02T09:26:34.728 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-02T09:26:34.804 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records in 2023-11-02T09:26:34.804 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records out 2023-11-02T09:26:34.804 INFO:teuthology.orchestra.run.smithi156.stderr:512 bytes copied, 0.000102327 s, 5.0 MB/s 2023-11-02T09:26:34.805 DEBUG:teuthology.orchestra.run.smithi156:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-02T09:26:34.874 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-02T09:26:34.875 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-11-02T09:26:34.875 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/scratch_devs of=/dev/stdout 2023-11-02T09:26:34.908 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-02T09:26:34.908 DEBUG:teuthology.orchestra.run.smithi186:> stat /dev/vg_nvme/lv_1 2023-11-02T09:26:34.978 INFO:teuthology.orchestra.run.smithi186.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-02T09:26:34.979 INFO:teuthology.orchestra.run.smithi186.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-02T09:26:34.979 INFO:teuthology.orchestra.run.smithi186.stdout:Device: 5h/5d Inode: 663 Links: 1 2023-11-02T09:26:34.979 INFO:teuthology.orchestra.run.smithi186.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-02T09:26:34.979 INFO:teuthology.orchestra.run.smithi186.stdout:Context: system_u:object_r:device_t:s0 2023-11-02T09:26:34.979 INFO:teuthology.orchestra.run.smithi186.stdout:Access: 2023-11-02 09:26:12.128078055 +0000 2023-11-02T09:26:34.980 INFO:teuthology.orchestra.run.smithi186.stdout:Modify: 2023-11-02 09:23:55.085219568 +0000 2023-11-02T09:26:34.980 INFO:teuthology.orchestra.run.smithi186.stdout:Change: 2023-11-02 09:23:55.085219568 +0000 2023-11-02T09:26:34.980 INFO:teuthology.orchestra.run.smithi186.stdout: Birth: 2023-11-02 09:23:55.085219568 +0000 2023-11-02T09:26:34.980 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-02T09:26:35.060 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records in 2023-11-02T09:26:35.060 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records out 2023-11-02T09:26:35.061 INFO:teuthology.orchestra.run.smithi186.stderr:512 bytes copied, 0.000186887 s, 2.7 MB/s 2023-11-02T09:26:35.062 DEBUG:teuthology.orchestra.run.smithi186:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-02T09:26:35.132 DEBUG:teuthology.orchestra.run.smithi186:> stat /dev/vg_nvme/lv_2 2023-11-02T09:26:35.201 INFO:teuthology.orchestra.run.smithi186.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-02T09:26:35.202 INFO:teuthology.orchestra.run.smithi186.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-02T09:26:35.202 INFO:teuthology.orchestra.run.smithi186.stdout:Device: 5h/5d Inode: 684 Links: 1 2023-11-02T09:26:35.202 INFO:teuthology.orchestra.run.smithi186.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-02T09:26:35.202 INFO:teuthology.orchestra.run.smithi186.stdout:Context: system_u:object_r:device_t:s0 2023-11-02T09:26:35.202 INFO:teuthology.orchestra.run.smithi186.stdout:Access: 2023-11-02 09:26:12.128078055 +0000 2023-11-02T09:26:35.203 INFO:teuthology.orchestra.run.smithi186.stdout:Modify: 2023-11-02 09:23:55.669208854 +0000 2023-11-02T09:26:35.203 INFO:teuthology.orchestra.run.smithi186.stdout:Change: 2023-11-02 09:23:55.669208854 +0000 2023-11-02T09:26:35.203 INFO:teuthology.orchestra.run.smithi186.stdout: Birth: 2023-11-02 09:23:55.669208854 +0000 2023-11-02T09:26:35.203 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-02T09:26:35.280 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records in 2023-11-02T09:26:35.280 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records out 2023-11-02T09:26:35.281 INFO:teuthology.orchestra.run.smithi186.stderr:512 bytes copied, 0.000197136 s, 2.6 MB/s 2023-11-02T09:26:35.282 DEBUG:teuthology.orchestra.run.smithi186:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-02T09:26:35.350 DEBUG:teuthology.orchestra.run.smithi186:> stat /dev/vg_nvme/lv_3 2023-11-02T09:26:35.417 INFO:teuthology.orchestra.run.smithi186.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-02T09:26:35.418 INFO:teuthology.orchestra.run.smithi186.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-02T09:26:35.418 INFO:teuthology.orchestra.run.smithi186.stdout:Device: 5h/5d Inode: 700 Links: 1 2023-11-02T09:26:35.418 INFO:teuthology.orchestra.run.smithi186.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-02T09:26:35.418 INFO:teuthology.orchestra.run.smithi186.stdout:Context: system_u:object_r:device_t:s0 2023-11-02T09:26:35.418 INFO:teuthology.orchestra.run.smithi186.stdout:Access: 2023-11-02 09:26:12.129078037 +0000 2023-11-02T09:26:35.419 INFO:teuthology.orchestra.run.smithi186.stdout:Modify: 2023-11-02 09:23:56.285197553 +0000 2023-11-02T09:26:35.419 INFO:teuthology.orchestra.run.smithi186.stdout:Change: 2023-11-02 09:23:56.285197553 +0000 2023-11-02T09:26:35.419 INFO:teuthology.orchestra.run.smithi186.stdout: Birth: 2023-11-02 09:23:56.285197553 +0000 2023-11-02T09:26:35.419 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-02T09:26:35.496 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records in 2023-11-02T09:26:35.496 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records out 2023-11-02T09:26:35.497 INFO:teuthology.orchestra.run.smithi186.stderr:512 bytes copied, 0.000239647 s, 2.1 MB/s 2023-11-02T09:26:35.498 DEBUG:teuthology.orchestra.run.smithi186:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-02T09:26:35.565 DEBUG:teuthology.orchestra.run.smithi186:> stat /dev/vg_nvme/lv_4 2023-11-02T09:26:35.632 INFO:teuthology.orchestra.run.smithi186.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-02T09:26:35.633 INFO:teuthology.orchestra.run.smithi186.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-02T09:26:35.633 INFO:teuthology.orchestra.run.smithi186.stdout:Device: 5h/5d Inode: 721 Links: 1 2023-11-02T09:26:35.633 INFO:teuthology.orchestra.run.smithi186.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-02T09:26:35.633 INFO:teuthology.orchestra.run.smithi186.stdout:Context: system_u:object_r:device_t:s0 2023-11-02T09:26:35.633 INFO:teuthology.orchestra.run.smithi186.stdout:Access: 2023-11-02 09:26:12.129078037 +0000 2023-11-02T09:26:35.634 INFO:teuthology.orchestra.run.smithi186.stdout:Modify: 2023-11-02 09:23:56.816187811 +0000 2023-11-02T09:26:35.634 INFO:teuthology.orchestra.run.smithi186.stdout:Change: 2023-11-02 09:23:56.816187811 +0000 2023-11-02T09:26:35.634 INFO:teuthology.orchestra.run.smithi186.stdout: Birth: 2023-11-02 09:23:56.816187811 +0000 2023-11-02T09:26:35.635 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-02T09:26:35.709 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records in 2023-11-02T09:26:35.710 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records out 2023-11-02T09:26:35.710 INFO:teuthology.orchestra.run.smithi186.stderr:512 bytes copied, 0.000232905 s, 2.2 MB/s 2023-11-02T09:26:35.711 DEBUG:teuthology.orchestra.run.smithi186:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-02T09:26:35.779 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-02T09:26:35.779 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi156.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi186.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-02T09:26:35.780 INFO:tasks.ceph:Generating config... 2023-11-02T09:26:35.804 INFO:tasks.ceph:[client] debug rgw = 20 2023-11-02T09:26:35.804 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2023-11-02T09:26:35.805 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2023-11-02T09:26:35.806 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2023-11-02T09:26:35.806 INFO:tasks.ceph:[client] setgroup = ceph 2023-11-02T09:26:35.806 INFO:tasks.ceph:[client] setuser = ceph 2023-11-02T09:26:35.807 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2023-11-02T09:26:35.807 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2023-11-02T09:26:35.807 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-11-02T09:26:35.807 INFO:tasks.ceph:[mgr] debug ms = 1 2023-11-02T09:26:35.808 INFO:tasks.ceph:[mon] debug mon = 20 2023-11-02T09:26:35.808 INFO:tasks.ceph:[mon] debug ms = 1 2023-11-02T09:26:35.808 INFO:tasks.ceph:[mon] debug paxos = 20 2023-11-02T09:26:35.808 INFO:tasks.ceph:[osd] bdev async discard = True 2023-11-02T09:26:35.809 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-11-02T09:26:35.809 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-11-02T09:26:35.809 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-11-02T09:26:35.810 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-11-02T09:26:35.810 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-11-02T09:26:35.810 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-11-02T09:26:35.811 INFO:tasks.ceph:[osd] debug ms = 1 2023-11-02T09:26:35.811 INFO:tasks.ceph:[osd] debug osd = 20 2023-11-02T09:26:35.811 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-11-02T09:26:35.811 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-11-02T09:26:35.812 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-11-02T09:26:35.812 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-11-02T09:26:35.812 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-11-02T09:26:35.813 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-11-02T09:26:35.813 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2023-11-02T09:26:35.813 INFO:tasks.ceph:Setting up mon.a... 2023-11-02T09:26:35.814 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-11-02T09:26:35.883 INFO:teuthology.orchestra.run.smithi156.stdout:creating /etc/ceph/ceph.keyring 2023-11-02T09:26:35.885 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-11-02T09:26:35.945 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-02T09:26:35.984 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.156'), ('mon.c', '[v2:172.21.15.156:3301,v1:172.21.15.156:6790]'), ('mon.b', '172.21.15.186')] 2023-11-02T09:26:35.985 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.156,[v2:172.21.15.156:3301,v1:172.21.15.156:6790],172.21.15.186', 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2023-11-02T09:26:35.986 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-11-02T09:26:35.987 DEBUG:teuthology.orchestra.run.smithi156:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-11-02T09:26:36.052 DEBUG:teuthology.orchestra.run.smithi156:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.156 --addv c '[v2:172.21.15.156:3301,v1:172.21.15.156:6790]' --add b 172.21.15.186 --print /home/ubuntu/cephtest/ceph.monmap 2023-11-02T09:26:36.148 INFO:teuthology.orchestra.run.smithi156.stderr:ignoring --setuser ceph since I am not root 2023-11-02T09:26:36.149 INFO:teuthology.orchestra.run.smithi156.stderr:ignoring --setgroup ceph since I am not root 2023-11-02T09:26:36.150 INFO:teuthology.orchestra.run.smithi156.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-11-02T09:26:36.150 INFO:teuthology.orchestra.run.smithi156.stdout:monmaptool: generated fsid e3a6132b-4ab5-4c55-b185-291b38e09c41 2023-11-02T09:26:36.150 INFO:teuthology.orchestra.run.smithi156.stdout:setting min_mon_release = pacific 2023-11-02T09:26:36.151 INFO:teuthology.orchestra.run.smithi156.stdout:epoch 0 2023-11-02T09:26:36.151 INFO:teuthology.orchestra.run.smithi156.stdout:fsid e3a6132b-4ab5-4c55-b185-291b38e09c41 2023-11-02T09:26:36.151 INFO:teuthology.orchestra.run.smithi156.stdout:last_changed 2023-11-02T09:26:36.147269+0000 2023-11-02T09:26:36.151 INFO:teuthology.orchestra.run.smithi156.stdout:created 2023-11-02T09:26:36.147269+0000 2023-11-02T09:26:36.151 INFO:teuthology.orchestra.run.smithi156.stdout:min_mon_release 16 (pacific) 2023-11-02T09:26:36.152 INFO:teuthology.orchestra.run.smithi156.stdout:election_strategy: 1 2023-11-02T09:26:36.152 INFO:teuthology.orchestra.run.smithi156.stdout:0: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.a 2023-11-02T09:26:36.152 INFO:teuthology.orchestra.run.smithi156.stdout:1: [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] mon.b 2023-11-02T09:26:36.152 INFO:teuthology.orchestra.run.smithi156.stdout:2: [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] mon.c 2023-11-02T09:26:36.152 INFO:teuthology.orchestra.run.smithi156.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-11-02T09:26:36.153 DEBUG:teuthology.orchestra.run.smithi156:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-11-02T09:26:36.180 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID e3a6132b-4ab5-4c55-b185-291b38e09c41... 2023-11-02T09:26:36.181 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-02T09:26:36.223 DEBUG:teuthology.orchestra.run.smithi186:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-02T09:26:36.285 INFO:teuthology.orchestra.run.smithi156.stdout:[global] 2023-11-02T09:26:36.285 INFO:teuthology.orchestra.run.smithi156.stdout: chdir = "" 2023-11-02T09:26:36.285 INFO:teuthology.orchestra.run.smithi156.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-02T09:26:36.286 INFO:teuthology.orchestra.run.smithi156.stdout: auth supported = cephx 2023-11-02T09:26:36.286 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:26:36.286 INFO:teuthology.orchestra.run.smithi156.stdout: filestore xattr use omap = true 2023-11-02T09:26:36.286 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:26:36.286 INFO:teuthology.orchestra.run.smithi156.stdout: mon clock drift allowed = 1.000 2023-11-02T09:26:36.287 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:26:36.287 INFO:teuthology.orchestra.run.smithi156.stdout: osd crush chooseleaf type = 0 2023-11-02T09:26:36.287 INFO:teuthology.orchestra.run.smithi156.stdout: auth debug = true 2023-11-02T09:26:36.287 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:26:36.287 INFO:teuthology.orchestra.run.smithi156.stdout: ms die on old message = true 2023-11-02T09:26:36.288 INFO:teuthology.orchestra.run.smithi156.stdout: ms die on bug = true 2023-11-02T09:26:36.288 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:26:36.288 INFO:teuthology.orchestra.run.smithi156.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-02T09:26:36.288 INFO:teuthology.orchestra.run.smithi156.stdout: mon pg warn max object skew = 0 2023-11-02T09:26:36.288 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:26:36.289 INFO:teuthology.orchestra.run.smithi156.stdout: # disable pg_autoscaler by default for new pools 2023-11-02T09:26:36.289 INFO:teuthology.orchestra.run.smithi156.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-02T09:26:36.289 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:26:36.289 INFO:teuthology.orchestra.run.smithi156.stdout: osd pool default size = 2 2023-11-02T09:26:36.289 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:26:36.290 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd allow primary affinity = true 2023-11-02T09:26:36.290 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd allow pg remap = true 2023-11-02T09:26:36.290 INFO:teuthology.orchestra.run.smithi156.stdout: mon warn on legacy crush tunables = false 2023-11-02T09:26:36.290 INFO:teuthology.orchestra.run.smithi156.stdout: mon warn on crush straw calc version zero = false 2023-11-02T09:26:36.290 INFO:teuthology.orchestra.run.smithi156.stdout: mon warn on no sortbitwise = false 2023-11-02T09:26:36.290 INFO:teuthology.orchestra.run.smithi156.stdout: mon warn on osd down out interval zero = false 2023-11-02T09:26:36.291 INFO:teuthology.orchestra.run.smithi156.stdout: mon warn on too few osds = false 2023-11-02T09:26:36.291 INFO:teuthology.orchestra.run.smithi156.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-02T09:26:36.291 INFO:teuthology.orchestra.run.smithi156.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-02T09:26:36.291 INFO:teuthology.orchestra.run.smithi156.stdout: mon_allow_pool_size_one = true 2023-11-02T09:26:36.291 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:26:36.292 INFO:teuthology.orchestra.run.smithi156.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-02T09:26:36.292 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:26:36.292 INFO:teuthology.orchestra.run.smithi156.stdout: osd default data pool replay window = 5 2023-11-02T09:26:36.292 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:26:36.292 INFO:teuthology.orchestra.run.smithi156.stdout: mon allow pool delete = true 2023-11-02T09:26:36.293 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:26:36.293 INFO:teuthology.orchestra.run.smithi156.stdout: mon cluster log file level = debug 2023-11-02T09:26:36.293 INFO:teuthology.orchestra.run.smithi156.stdout: debug asserts on shutdown = true 2023-11-02T09:26:36.293 INFO:teuthology.orchestra.run.smithi156.stdout: mon health detail to clog = false 2023-11-02T09:26:36.293 INFO:teuthology.orchestra.run.smithi156.stdout: mon host = "172.21.15.156,[v2:172.21.15.156:3301,v1:172.21.15.156:6790],172.21.15.186" 2023-11-02T09:26:36.294 INFO:teuthology.orchestra.run.smithi156.stdout: osd_max_pg_log_entries = 10 2023-11-02T09:26:36.294 INFO:teuthology.orchestra.run.smithi156.stdout: osd_min_pg_log_entries = 10 2023-11-02T09:26:36.294 INFO:teuthology.orchestra.run.smithi156.stdout: fsid = e3a6132b-4ab5-4c55-b185-291b38e09c41 2023-11-02T09:26:36.294 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:26:36.294 INFO:teuthology.orchestra.run.smithi156.stdout:[osd] 2023-11-02T09:26:36.295 INFO:teuthology.orchestra.run.smithi156.stdout: osd journal size = 100 2023-11-02T09:26:36.295 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:26:36.295 INFO:teuthology.orchestra.run.smithi156.stdout: osd scrub load threshold = 5.0 2023-11-02T09:26:36.295 INFO:teuthology.orchestra.run.smithi156.stdout: osd scrub max interval = 600 2023-11-02T09:26:36.295 INFO:teuthology.orchestra.run.smithi156.stdout: osd mclock profile = high_recovery_ops 2023-11-02T09:26:36.296 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:26:36.296 INFO:teuthology.orchestra.run.smithi156.stdout: osd recover clone overlap = true 2023-11-02T09:26:36.296 INFO:teuthology.orchestra.run.smithi156.stdout: osd recovery max chunk = 1048576 2023-11-02T09:26:36.296 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:26:36.296 INFO:teuthology.orchestra.run.smithi156.stdout: osd debug shutdown = true 2023-11-02T09:26:36.297 INFO:teuthology.orchestra.run.smithi156.stdout: osd debug op order = true 2023-11-02T09:26:36.297 INFO:teuthology.orchestra.run.smithi156.stdout: osd debug verify stray on activate = true 2023-11-02T09:26:36.297 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:26:36.297 INFO:teuthology.orchestra.run.smithi156.stdout: osd open classes on start = true 2023-11-02T09:26:36.297 INFO:teuthology.orchestra.run.smithi156.stdout: osd debug pg log writeout = true 2023-11-02T09:26:36.298 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:26:36.298 INFO:teuthology.orchestra.run.smithi156.stdout: osd deep scrub update digest min age = 30 2023-11-02T09:26:36.298 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:26:36.298 INFO:teuthology.orchestra.run.smithi156.stdout: osd map max advance = 10 2023-11-02T09:26:36.298 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:26:36.298 INFO:teuthology.orchestra.run.smithi156.stdout: journal zero on create = true 2023-11-02T09:26:36.299 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:26:36.299 INFO:teuthology.orchestra.run.smithi156.stdout: filestore ondisk finisher threads = 3 2023-11-02T09:26:36.299 INFO:teuthology.orchestra.run.smithi156.stdout: filestore apply finisher threads = 3 2023-11-02T09:26:36.299 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:26:36.299 INFO:teuthology.orchestra.run.smithi156.stdout: bdev debug aio = true 2023-11-02T09:26:36.300 INFO:teuthology.orchestra.run.smithi156.stdout: osd debug misdirected ops = true 2023-11-02T09:26:36.300 INFO:teuthology.orchestra.run.smithi156.stdout: bdev async discard = True 2023-11-02T09:26:36.300 INFO:teuthology.orchestra.run.smithi156.stdout: bdev enable discard = True 2023-11-02T09:26:36.300 INFO:teuthology.orchestra.run.smithi156.stdout: bluestore allocator = bitmap 2023-11-02T09:26:36.300 INFO:teuthology.orchestra.run.smithi156.stdout: bluestore block size = 96636764160 2023-11-02T09:26:36.301 INFO:teuthology.orchestra.run.smithi156.stdout: bluestore fsck on mount = True 2023-11-02T09:26:36.301 INFO:teuthology.orchestra.run.smithi156.stdout: debug bluefs = 1/20 2023-11-02T09:26:36.301 INFO:teuthology.orchestra.run.smithi156.stdout: debug bluestore = 1/20 2023-11-02T09:26:36.301 INFO:teuthology.orchestra.run.smithi156.stdout: debug ms = 1 2023-11-02T09:26:36.301 INFO:teuthology.orchestra.run.smithi156.stdout: debug osd = 20 2023-11-02T09:26:36.302 INFO:teuthology.orchestra.run.smithi156.stdout: debug rocksdb = 4/10 2023-11-02T09:26:36.302 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd backfillfull_ratio = 0.85 2023-11-02T09:26:36.302 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd full ratio = 0.9 2023-11-02T09:26:36.302 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd nearfull ratio = 0.8 2023-11-02T09:26:36.302 INFO:teuthology.orchestra.run.smithi156.stdout: osd failsafe full ratio = 0.95 2023-11-02T09:26:36.303 INFO:teuthology.orchestra.run.smithi156.stdout: osd objectstore = bluestore 2023-11-02T09:26:36.303 INFO:teuthology.orchestra.run.smithi156.stdout: osd shutdown pgref assert = True 2023-11-02T09:26:36.303 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:26:36.303 INFO:teuthology.orchestra.run.smithi156.stdout:[mgr] 2023-11-02T09:26:36.303 INFO:teuthology.orchestra.run.smithi156.stdout: debug ms = 1 2023-11-02T09:26:36.304 INFO:teuthology.orchestra.run.smithi156.stdout: debug mgr = 20 2023-11-02T09:26:36.304 INFO:teuthology.orchestra.run.smithi156.stdout: debug mon = 20 2023-11-02T09:26:36.304 INFO:teuthology.orchestra.run.smithi156.stdout: debug auth = 20 2023-11-02T09:26:36.304 INFO:teuthology.orchestra.run.smithi156.stdout: mon reweight min pgs per osd = 4 2023-11-02T09:26:36.304 INFO:teuthology.orchestra.run.smithi156.stdout: mon reweight min bytes per osd = 10 2023-11-02T09:26:36.305 INFO:teuthology.orchestra.run.smithi156.stdout: mgr/telemetry/nag = false 2023-11-02T09:26:36.305 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:26:36.305 INFO:teuthology.orchestra.run.smithi156.stdout:[mon] 2023-11-02T09:26:36.305 INFO:teuthology.orchestra.run.smithi156.stdout: debug ms = 1 2023-11-02T09:26:36.305 INFO:teuthology.orchestra.run.smithi156.stdout: debug mon = 20 2023-11-02T09:26:36.305 INFO:teuthology.orchestra.run.smithi156.stdout: debug paxos = 20 2023-11-02T09:26:36.306 INFO:teuthology.orchestra.run.smithi156.stdout: debug auth = 20 2023-11-02T09:26:36.306 INFO:teuthology.orchestra.run.smithi156.stdout: mon data avail warn = 5 2023-11-02T09:26:36.306 INFO:teuthology.orchestra.run.smithi156.stdout: mon mgr mkfs grace = 240 2023-11-02T09:26:36.306 INFO:teuthology.orchestra.run.smithi156.stdout: mon reweight min pgs per osd = 4 2023-11-02T09:26:36.306 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd reporter subtree level = osd 2023-11-02T09:26:36.307 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd prime pg temp = true 2023-11-02T09:26:36.307 INFO:teuthology.orchestra.run.smithi156.stdout: mon reweight min bytes per osd = 10 2023-11-02T09:26:36.307 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:26:36.307 INFO:teuthology.orchestra.run.smithi156.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-02T09:26:36.307 INFO:teuthology.orchestra.run.smithi156.stdout: auth mon ticket ttl = 660 # 11m 2023-11-02T09:26:36.308 INFO:teuthology.orchestra.run.smithi156.stdout: auth service ticket ttl = 240 # 4m 2023-11-02T09:26:36.308 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:26:36.308 INFO:teuthology.orchestra.run.smithi156.stdout: # don't complain about insecure global_id in the test suite 2023-11-02T09:26:36.308 INFO:teuthology.orchestra.run.smithi156.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-02T09:26:36.308 INFO:teuthology.orchestra.run.smithi156.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-02T09:26:36.308 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:26:36.309 INFO:teuthology.orchestra.run.smithi156.stdout: # 1m isn't quite enough 2023-11-02T09:26:36.309 INFO:teuthology.orchestra.run.smithi156.stdout: mon_down_mkfs_grace = 2m 2023-11-02T09:26:36.309 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:26:36.309 INFO:teuthology.orchestra.run.smithi156.stdout: mon_warn_on_filestore_osds = false 2023-11-02T09:26:36.309 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:26:36.310 INFO:teuthology.orchestra.run.smithi156.stdout:[client] 2023-11-02T09:26:36.310 INFO:teuthology.orchestra.run.smithi156.stdout: rgw cache enabled = true 2023-11-02T09:26:36.310 INFO:teuthology.orchestra.run.smithi156.stdout: rgw enable ops log = true 2023-11-02T09:26:36.310 INFO:teuthology.orchestra.run.smithi156.stdout: rgw enable usage log = true 2023-11-02T09:26:36.310 INFO:teuthology.orchestra.run.smithi156.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-02T09:26:36.311 INFO:teuthology.orchestra.run.smithi156.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-02T09:26:36.311 INFO:teuthology.orchestra.run.smithi156.stdout: debug rgw = 20 2023-11-02T09:26:36.311 INFO:teuthology.orchestra.run.smithi156.stdout: rgw crypt require ssl = False 2023-11-02T09:26:36.311 INFO:teuthology.orchestra.run.smithi156.stdout: rgw crypt s3 kms backend = testing 2023-11-02T09:26:36.313 INFO:teuthology.orchestra.run.smithi156.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2023-11-02T09:26:36.313 INFO:teuthology.orchestra.run.smithi156.stdout: setgroup = ceph 2023-11-02T09:26:36.314 INFO:teuthology.orchestra.run.smithi156.stdout: setuser = ceph 2023-11-02T09:26:36.314 INFO:teuthology.orchestra.run.smithi156.stdout:[mon.a] 2023-11-02T09:26:36.314 INFO:teuthology.orchestra.run.smithi156.stdout:[mon.c] 2023-11-02T09:26:36.314 INFO:teuthology.orchestra.run.smithi156.stdout:[mon.b] 2023-11-02T09:26:36.316 INFO:teuthology.orchestra.run.smithi186.stdout:[global] 2023-11-02T09:26:36.316 INFO:teuthology.orchestra.run.smithi186.stdout: chdir = "" 2023-11-02T09:26:36.316 INFO:teuthology.orchestra.run.smithi186.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-02T09:26:36.317 INFO:teuthology.orchestra.run.smithi186.stdout: auth supported = cephx 2023-11-02T09:26:36.317 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-11-02T09:26:36.317 INFO:teuthology.orchestra.run.smithi186.stdout: filestore xattr use omap = true 2023-11-02T09:26:36.317 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-11-02T09:26:36.317 INFO:teuthology.orchestra.run.smithi186.stdout: mon clock drift allowed = 1.000 2023-11-02T09:26:36.318 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-11-02T09:26:36.318 INFO:teuthology.orchestra.run.smithi186.stdout: osd crush chooseleaf type = 0 2023-11-02T09:26:36.318 INFO:teuthology.orchestra.run.smithi186.stdout: auth debug = true 2023-11-02T09:26:36.318 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-11-02T09:26:36.318 INFO:teuthology.orchestra.run.smithi186.stdout: ms die on old message = true 2023-11-02T09:26:36.319 INFO:teuthology.orchestra.run.smithi186.stdout: ms die on bug = true 2023-11-02T09:26:36.319 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-11-02T09:26:36.319 INFO:teuthology.orchestra.run.smithi186.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-02T09:26:36.319 INFO:teuthology.orchestra.run.smithi186.stdout: mon pg warn max object skew = 0 2023-11-02T09:26:36.319 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-11-02T09:26:36.320 INFO:teuthology.orchestra.run.smithi186.stdout: # disable pg_autoscaler by default for new pools 2023-11-02T09:26:36.320 INFO:teuthology.orchestra.run.smithi186.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-02T09:26:36.320 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-11-02T09:26:36.320 INFO:teuthology.orchestra.run.smithi186.stdout: osd pool default size = 2 2023-11-02T09:26:36.321 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-11-02T09:26:36.321 INFO:teuthology.orchestra.run.smithi186.stdout: mon osd allow primary affinity = true 2023-11-02T09:26:36.321 INFO:teuthology.orchestra.run.smithi186.stdout: mon osd allow pg remap = true 2023-11-02T09:26:36.321 INFO:teuthology.orchestra.run.smithi186.stdout: mon warn on legacy crush tunables = false 2023-11-02T09:26:36.322 INFO:teuthology.orchestra.run.smithi186.stdout: mon warn on crush straw calc version zero = false 2023-11-02T09:26:36.322 INFO:teuthology.orchestra.run.smithi186.stdout: mon warn on no sortbitwise = false 2023-11-02T09:26:36.322 INFO:teuthology.orchestra.run.smithi186.stdout: mon warn on osd down out interval zero = false 2023-11-02T09:26:36.322 INFO:teuthology.orchestra.run.smithi186.stdout: mon warn on too few osds = false 2023-11-02T09:26:36.322 INFO:teuthology.orchestra.run.smithi186.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-02T09:26:36.323 INFO:teuthology.orchestra.run.smithi186.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-02T09:26:36.323 INFO:teuthology.orchestra.run.smithi186.stdout: mon_allow_pool_size_one = true 2023-11-02T09:26:36.323 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-11-02T09:26:36.323 INFO:teuthology.orchestra.run.smithi186.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-02T09:26:36.323 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-11-02T09:26:36.324 INFO:teuthology.orchestra.run.smithi186.stdout: osd default data pool replay window = 5 2023-11-02T09:26:36.324 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-11-02T09:26:36.324 INFO:teuthology.orchestra.run.smithi186.stdout: mon allow pool delete = true 2023-11-02T09:26:36.324 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-11-02T09:26:36.324 INFO:teuthology.orchestra.run.smithi186.stdout: mon cluster log file level = debug 2023-11-02T09:26:36.325 INFO:teuthology.orchestra.run.smithi186.stdout: debug asserts on shutdown = true 2023-11-02T09:26:36.325 INFO:teuthology.orchestra.run.smithi186.stdout: mon health detail to clog = false 2023-11-02T09:26:36.325 INFO:teuthology.orchestra.run.smithi186.stdout: mon host = "172.21.15.156,[v2:172.21.15.156:3301,v1:172.21.15.156:6790],172.21.15.186" 2023-11-02T09:26:36.325 INFO:teuthology.orchestra.run.smithi186.stdout: osd_max_pg_log_entries = 10 2023-11-02T09:26:36.325 INFO:teuthology.orchestra.run.smithi186.stdout: osd_min_pg_log_entries = 10 2023-11-02T09:26:36.325 INFO:teuthology.orchestra.run.smithi186.stdout: fsid = e3a6132b-4ab5-4c55-b185-291b38e09c41 2023-11-02T09:26:36.326 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-11-02T09:26:36.326 INFO:teuthology.orchestra.run.smithi186.stdout:[osd] 2023-11-02T09:26:36.326 INFO:teuthology.orchestra.run.smithi186.stdout: osd journal size = 100 2023-11-02T09:26:36.326 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-11-02T09:26:36.326 INFO:teuthology.orchestra.run.smithi186.stdout: osd scrub load threshold = 5.0 2023-11-02T09:26:36.327 INFO:teuthology.orchestra.run.smithi186.stdout: osd scrub max interval = 600 2023-11-02T09:26:36.327 INFO:teuthology.orchestra.run.smithi186.stdout: osd mclock profile = high_recovery_ops 2023-11-02T09:26:36.327 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-11-02T09:26:36.327 INFO:teuthology.orchestra.run.smithi186.stdout: osd recover clone overlap = true 2023-11-02T09:26:36.327 INFO:teuthology.orchestra.run.smithi186.stdout: osd recovery max chunk = 1048576 2023-11-02T09:26:36.328 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-11-02T09:26:36.328 INFO:teuthology.orchestra.run.smithi186.stdout: osd debug shutdown = true 2023-11-02T09:26:36.328 INFO:teuthology.orchestra.run.smithi186.stdout: osd debug op order = true 2023-11-02T09:26:36.328 INFO:teuthology.orchestra.run.smithi186.stdout: osd debug verify stray on activate = true 2023-11-02T09:26:36.328 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-11-02T09:26:36.329 INFO:teuthology.orchestra.run.smithi186.stdout: osd open classes on start = true 2023-11-02T09:26:36.329 INFO:teuthology.orchestra.run.smithi186.stdout: osd debug pg log writeout = true 2023-11-02T09:26:36.329 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-11-02T09:26:36.329 INFO:teuthology.orchestra.run.smithi186.stdout: osd deep scrub update digest min age = 30 2023-11-02T09:26:36.329 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-11-02T09:26:36.329 INFO:teuthology.orchestra.run.smithi186.stdout: osd map max advance = 10 2023-11-02T09:26:36.330 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-11-02T09:26:36.330 INFO:teuthology.orchestra.run.smithi186.stdout: journal zero on create = true 2023-11-02T09:26:36.330 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-11-02T09:26:36.330 INFO:teuthology.orchestra.run.smithi186.stdout: filestore ondisk finisher threads = 3 2023-11-02T09:26:36.330 INFO:teuthology.orchestra.run.smithi186.stdout: filestore apply finisher threads = 3 2023-11-02T09:26:36.331 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-11-02T09:26:36.331 INFO:teuthology.orchestra.run.smithi186.stdout: bdev debug aio = true 2023-11-02T09:26:36.331 INFO:teuthology.orchestra.run.smithi186.stdout: osd debug misdirected ops = true 2023-11-02T09:26:36.331 INFO:teuthology.orchestra.run.smithi186.stdout: bdev async discard = True 2023-11-02T09:26:36.331 INFO:teuthology.orchestra.run.smithi186.stdout: bdev enable discard = True 2023-11-02T09:26:36.332 INFO:teuthology.orchestra.run.smithi186.stdout: bluestore allocator = bitmap 2023-11-02T09:26:36.332 INFO:teuthology.orchestra.run.smithi186.stdout: bluestore block size = 96636764160 2023-11-02T09:26:36.332 INFO:teuthology.orchestra.run.smithi186.stdout: bluestore fsck on mount = True 2023-11-02T09:26:36.332 INFO:teuthology.orchestra.run.smithi186.stdout: debug bluefs = 1/20 2023-11-02T09:26:36.332 INFO:teuthology.orchestra.run.smithi186.stdout: debug bluestore = 1/20 2023-11-02T09:26:36.333 INFO:teuthology.orchestra.run.smithi186.stdout: debug ms = 1 2023-11-02T09:26:36.333 INFO:teuthology.orchestra.run.smithi186.stdout: debug osd = 20 2023-11-02T09:26:36.333 INFO:teuthology.orchestra.run.smithi186.stdout: debug rocksdb = 4/10 2023-11-02T09:26:36.333 INFO:teuthology.orchestra.run.smithi186.stdout: mon osd backfillfull_ratio = 0.85 2023-11-02T09:26:36.333 INFO:teuthology.orchestra.run.smithi186.stdout: mon osd full ratio = 0.9 2023-11-02T09:26:36.333 INFO:teuthology.orchestra.run.smithi186.stdout: mon osd nearfull ratio = 0.8 2023-11-02T09:26:36.334 INFO:teuthology.orchestra.run.smithi186.stdout: osd failsafe full ratio = 0.95 2023-11-02T09:26:36.334 INFO:teuthology.orchestra.run.smithi186.stdout: osd objectstore = bluestore 2023-11-02T09:26:36.334 INFO:teuthology.orchestra.run.smithi186.stdout: osd shutdown pgref assert = True 2023-11-02T09:26:36.334 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-11-02T09:26:36.334 INFO:teuthology.orchestra.run.smithi186.stdout:[mgr] 2023-11-02T09:26:36.335 INFO:teuthology.orchestra.run.smithi186.stdout: debug ms = 1 2023-11-02T09:26:36.335 INFO:teuthology.orchestra.run.smithi186.stdout: debug mgr = 20 2023-11-02T09:26:36.335 INFO:teuthology.orchestra.run.smithi186.stdout: debug mon = 20 2023-11-02T09:26:36.335 INFO:teuthology.orchestra.run.smithi186.stdout: debug auth = 20 2023-11-02T09:26:36.335 INFO:teuthology.orchestra.run.smithi186.stdout: mon reweight min pgs per osd = 4 2023-11-02T09:26:36.336 INFO:teuthology.orchestra.run.smithi186.stdout: mon reweight min bytes per osd = 10 2023-11-02T09:26:36.336 INFO:teuthology.orchestra.run.smithi186.stdout: mgr/telemetry/nag = false 2023-11-02T09:26:36.336 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-11-02T09:26:36.336 INFO:teuthology.orchestra.run.smithi186.stdout:[mon] 2023-11-02T09:26:36.336 INFO:teuthology.orchestra.run.smithi186.stdout: debug ms = 1 2023-11-02T09:26:36.337 INFO:teuthology.orchestra.run.smithi186.stdout: debug mon = 20 2023-11-02T09:26:36.337 INFO:teuthology.orchestra.run.smithi186.stdout: debug paxos = 20 2023-11-02T09:26:36.337 INFO:teuthology.orchestra.run.smithi186.stdout: debug auth = 20 2023-11-02T09:26:36.337 INFO:teuthology.orchestra.run.smithi186.stdout: mon data avail warn = 5 2023-11-02T09:26:36.337 INFO:teuthology.orchestra.run.smithi186.stdout: mon mgr mkfs grace = 240 2023-11-02T09:26:36.338 INFO:teuthology.orchestra.run.smithi186.stdout: mon reweight min pgs per osd = 4 2023-11-02T09:26:36.338 INFO:teuthology.orchestra.run.smithi186.stdout: mon osd reporter subtree level = osd 2023-11-02T09:26:36.338 INFO:teuthology.orchestra.run.smithi186.stdout: mon osd prime pg temp = true 2023-11-02T09:26:36.338 INFO:teuthology.orchestra.run.smithi186.stdout: mon reweight min bytes per osd = 10 2023-11-02T09:26:36.338 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-11-02T09:26:36.339 INFO:teuthology.orchestra.run.smithi186.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-02T09:26:36.339 INFO:teuthology.orchestra.run.smithi186.stdout: auth mon ticket ttl = 660 # 11m 2023-11-02T09:26:36.339 INFO:teuthology.orchestra.run.smithi186.stdout: auth service ticket ttl = 240 # 4m 2023-11-02T09:26:36.339 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-11-02T09:26:36.339 INFO:teuthology.orchestra.run.smithi186.stdout: # don't complain about insecure global_id in the test suite 2023-11-02T09:26:36.339 INFO:teuthology.orchestra.run.smithi186.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-02T09:26:36.340 INFO:teuthology.orchestra.run.smithi186.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-02T09:26:36.340 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-11-02T09:26:36.340 INFO:teuthology.orchestra.run.smithi186.stdout: # 1m isn't quite enough 2023-11-02T09:26:36.340 INFO:teuthology.orchestra.run.smithi186.stdout: mon_down_mkfs_grace = 2m 2023-11-02T09:26:36.340 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-11-02T09:26:36.341 INFO:teuthology.orchestra.run.smithi186.stdout: mon_warn_on_filestore_osds = false 2023-11-02T09:26:36.341 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-11-02T09:26:36.341 INFO:teuthology.orchestra.run.smithi186.stdout:[client] 2023-11-02T09:26:36.341 INFO:teuthology.orchestra.run.smithi186.stdout: rgw cache enabled = true 2023-11-02T09:26:36.341 INFO:teuthology.orchestra.run.smithi186.stdout: rgw enable ops log = true 2023-11-02T09:26:36.342 INFO:teuthology.orchestra.run.smithi186.stdout: rgw enable usage log = true 2023-11-02T09:26:36.342 INFO:teuthology.orchestra.run.smithi186.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-02T09:26:36.342 INFO:teuthology.orchestra.run.smithi186.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-02T09:26:36.342 INFO:teuthology.orchestra.run.smithi186.stdout: debug rgw = 20 2023-11-02T09:26:36.342 INFO:teuthology.orchestra.run.smithi186.stdout: rgw crypt require ssl = False 2023-11-02T09:26:36.343 INFO:teuthology.orchestra.run.smithi186.stdout: rgw crypt s3 kms backend = testing 2023-11-02T09:26:36.343 INFO:teuthology.orchestra.run.smithi186.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2023-11-02T09:26:36.343 INFO:teuthology.orchestra.run.smithi186.stdout: setgroup = ceph 2023-11-02T09:26:36.343 INFO:teuthology.orchestra.run.smithi186.stdout: setuser = ceph 2023-11-02T09:26:36.343 INFO:teuthology.orchestra.run.smithi186.stdout:[mon.a] 2023-11-02T09:26:36.343 INFO:teuthology.orchestra.run.smithi186.stdout:[mon.c] 2023-11-02T09:26:36.344 INFO:teuthology.orchestra.run.smithi186.stdout:[mon.b] 2023-11-02T09:26:36.344 INFO:tasks.ceph:Creating admin key on mon.a... 2023-11-02T09:26:36.344 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-11-02T09:26:36.425 INFO:tasks.ceph:Copying monmap to all nodes... 2023-11-02T09:26:36.426 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-11-02T09:26:36.426 DEBUG:teuthology.orchestra.run.smithi156:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-11-02T09:26:36.454 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-11-02T09:26:36.454 DEBUG:teuthology.orchestra.run.smithi156:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-11-02T09:26:36.521 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi156.front.sepia.ceph.com 2023-11-02T09:26:36.521 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-11-02T09:26:36.521 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-02T09:26:36.522 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-02T09:26:36.612 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-11-02T09:26:36.613 DEBUG:teuthology.orchestra.run.smithi156:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-02T09:26:36.680 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi186.front.sepia.ceph.com 2023-11-02T09:26:36.680 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-11-02T09:26:36.681 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-02T09:26:36.681 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-02T09:26:36.734 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-11-02T09:26:36.734 DEBUG:teuthology.orchestra.run.smithi186:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-02T09:26:36.803 INFO:tasks.ceph:Setting up mon nodes... 2023-11-02T09:26:36.803 INFO:tasks.ceph:Setting up mgr nodes... 2023-11-02T09:26:36.804 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-11-02T09:26:36.871 INFO:teuthology.orchestra.run.smithi156.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-11-02T09:26:36.873 DEBUG:teuthology.orchestra.run.smithi186:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-11-02T09:26:36.945 INFO:teuthology.orchestra.run.smithi186.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-11-02T09:26:36.948 INFO:tasks.ceph:Setting up mds nodes... 2023-11-02T09:26:36.948 INFO:tasks.ceph_client:Setting up client nodes... 2023-11-02T09:26:36.949 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-11-02T09:26:37.004 INFO:teuthology.orchestra.run.smithi156.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-11-02T09:26:37.020 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-11-02T09:26:37.075 INFO:teuthology.orchestra.run.smithi186.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-11-02T09:26:37.090 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-11-02T09:26:37.091 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi156.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi186.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-02T09:26:37.091 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-11-02T09:26:37.133 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-02T09:26:37.134 INFO:tasks.ceph:role: osd.0 2023-11-02T09:26:37.134 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi156.front.sepia.ceph.com 2023-11-02T09:26:37.134 DEBUG:teuthology.orchestra.run.smithi156:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-02T09:26:37.212 INFO:teuthology.orchestra.run.smithi156.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-02T09:26:37.212 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-02T09:26:37.212 INFO:teuthology.orchestra.run.smithi156.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-02T09:26:37.212 INFO:teuthology.orchestra.run.smithi156.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-02T09:26:37.213 INFO:teuthology.orchestra.run.smithi156.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-02T09:26:37.213 INFO:teuthology.orchestra.run.smithi156.stdout: = sunit=0 swidth=0 blks 2023-11-02T09:26:37.213 INFO:teuthology.orchestra.run.smithi156.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-02T09:26:37.213 INFO:teuthology.orchestra.run.smithi156.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-02T09:26:37.213 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-02T09:26:37.214 INFO:teuthology.orchestra.run.smithi156.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-02T09:26:37.244 INFO:teuthology.orchestra.run.smithi156.stdout:Discarding blocks...Done. 2023-11-02T09:26:37.245 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi156.front.sepia.ceph.com -o noatime 2023-11-02T09:26:37.246 DEBUG:teuthology.orchestra.run.smithi156:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-11-02T09:26:37.333 DEBUG:teuthology.orchestra.run.smithi156:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-11-02T09:26:37.377 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-11-02T09:26:37.416 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-02T09:26:37.417 INFO:tasks.ceph:role: osd.1 2023-11-02T09:26:37.417 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi156.front.sepia.ceph.com 2023-11-02T09:26:37.417 DEBUG:teuthology.orchestra.run.smithi156:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-02T09:26:37.496 INFO:teuthology.orchestra.run.smithi156.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-02T09:26:37.496 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-02T09:26:37.497 INFO:teuthology.orchestra.run.smithi156.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-02T09:26:37.497 INFO:teuthology.orchestra.run.smithi156.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-02T09:26:37.497 INFO:teuthology.orchestra.run.smithi156.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-02T09:26:37.497 INFO:teuthology.orchestra.run.smithi156.stdout: = sunit=0 swidth=0 blks 2023-11-02T09:26:37.497 INFO:teuthology.orchestra.run.smithi156.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-02T09:26:37.497 INFO:teuthology.orchestra.run.smithi156.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-02T09:26:37.498 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-02T09:26:37.498 INFO:teuthology.orchestra.run.smithi156.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-02T09:26:37.528 INFO:teuthology.orchestra.run.smithi156.stdout:Discarding blocks...Done. 2023-11-02T09:26:37.530 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi156.front.sepia.ceph.com -o noatime 2023-11-02T09:26:37.530 DEBUG:teuthology.orchestra.run.smithi156:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-11-02T09:26:37.615 DEBUG:teuthology.orchestra.run.smithi156:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-11-02T09:26:37.696 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-11-02T09:26:37.776 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-02T09:26:37.777 INFO:tasks.ceph:role: osd.2 2023-11-02T09:26:37.777 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi156.front.sepia.ceph.com 2023-11-02T09:26:37.778 DEBUG:teuthology.orchestra.run.smithi156:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-02T09:26:37.856 INFO:teuthology.orchestra.run.smithi156.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-02T09:26:37.857 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-02T09:26:37.857 INFO:teuthology.orchestra.run.smithi156.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-02T09:26:37.857 INFO:teuthology.orchestra.run.smithi156.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-02T09:26:37.857 INFO:teuthology.orchestra.run.smithi156.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-02T09:26:37.857 INFO:teuthology.orchestra.run.smithi156.stdout: = sunit=0 swidth=0 blks 2023-11-02T09:26:37.858 INFO:teuthology.orchestra.run.smithi156.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-02T09:26:37.858 INFO:teuthology.orchestra.run.smithi156.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-02T09:26:37.858 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-02T09:26:37.858 INFO:teuthology.orchestra.run.smithi156.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-02T09:26:37.889 INFO:teuthology.orchestra.run.smithi156.stdout:Discarding blocks...Done. 2023-11-02T09:26:37.891 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi156.front.sepia.ceph.com -o noatime 2023-11-02T09:26:37.891 DEBUG:teuthology.orchestra.run.smithi156:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-11-02T09:26:37.974 DEBUG:teuthology.orchestra.run.smithi156:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-11-02T09:26:38.058 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-11-02T09:26:38.138 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-02T09:26:38.138 INFO:tasks.ceph:role: osd.3 2023-11-02T09:26:38.138 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi156.front.sepia.ceph.com 2023-11-02T09:26:38.139 DEBUG:teuthology.orchestra.run.smithi156:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-02T09:26:38.217 INFO:teuthology.orchestra.run.smithi156.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-02T09:26:38.217 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-02T09:26:38.218 INFO:teuthology.orchestra.run.smithi156.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-02T09:26:38.218 INFO:teuthology.orchestra.run.smithi156.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-02T09:26:38.218 INFO:teuthology.orchestra.run.smithi156.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-02T09:26:38.218 INFO:teuthology.orchestra.run.smithi156.stdout: = sunit=0 swidth=0 blks 2023-11-02T09:26:38.218 INFO:teuthology.orchestra.run.smithi156.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-02T09:26:38.219 INFO:teuthology.orchestra.run.smithi156.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-02T09:26:38.219 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-02T09:26:38.219 INFO:teuthology.orchestra.run.smithi156.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-02T09:26:38.252 INFO:teuthology.orchestra.run.smithi156.stdout:Discarding blocks...Done. 2023-11-02T09:26:38.254 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi156.front.sepia.ceph.com -o noatime 2023-11-02T09:26:38.254 DEBUG:teuthology.orchestra.run.smithi156:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-11-02T09:26:38.339 DEBUG:teuthology.orchestra.run.smithi156:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-11-02T09:26:38.382 DEBUG:teuthology.orchestra.run.smithi156:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-02T09:26:38.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:26:38.490+0000 7f447f6da500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-11-02T09:26:38.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:26:38.490+0000 7f447f6da500 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-11-02T09:26:38.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:26:38.490+0000 7f447f6da500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-02T09:26:38.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:26:38.490+0000 7f447f6da500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-02T09:26:38.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:26:38.490+0000 7f447f6da500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-02T09:26:38.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:26:38.490+0000 7f447f6da500 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-11-02T09:26:41.349 DEBUG:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-11-02T09:26:41.395 DEBUG:teuthology.orchestra.run.smithi156:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-02T09:26:41.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:26:41.452+0000 7f32f0ca3500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-11-02T09:26:41.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:26:41.453+0000 7f32f0ca3500 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-11-02T09:26:41.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:26:41.453+0000 7f32f0ca3500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-02T09:26:41.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:26:41.453+0000 7f32f0ca3500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-02T09:26:41.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:26:41.453+0000 7f32f0ca3500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-02T09:26:41.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:26:41.453+0000 7f32f0ca3500 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-11-02T09:26:44.303 DEBUG:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-11-02T09:26:44.348 DEBUG:teuthology.orchestra.run.smithi156:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-02T09:26:44.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:26:44.407+0000 7f43eb49a500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-11-02T09:26:44.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:26:44.408+0000 7f43eb49a500 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-11-02T09:26:44.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:26:44.408+0000 7f43eb49a500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-02T09:26:44.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:26:44.408+0000 7f43eb49a500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-02T09:26:44.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:26:44.408+0000 7f43eb49a500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-02T09:26:44.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:26:44.408+0000 7f43eb49a500 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-11-02T09:26:47.265 DEBUG:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-11-02T09:26:47.311 DEBUG:teuthology.orchestra.run.smithi156:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-02T09:26:47.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:26:47.372+0000 7fd1f7a8c500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-11-02T09:26:47.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:26:47.372+0000 7fd1f7a8c500 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-11-02T09:26:47.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:26:47.372+0000 7fd1f7a8c500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-02T09:26:47.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:26:47.372+0000 7fd1f7a8c500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-02T09:26:47.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:26:47.372+0000 7fd1f7a8c500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-02T09:26:47.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:26:47.372+0000 7fd1f7a8c500 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-11-02T09:26:50.214 DEBUG:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-11-02T09:26:50.263 DEBUG:teuthology.orchestra.run.smithi186:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-11-02T09:26:50.311 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-02T09:26:50.311 INFO:tasks.ceph:role: osd.4 2023-11-02T09:26:50.312 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi186.front.sepia.ceph.com 2023-11-02T09:26:50.312 DEBUG:teuthology.orchestra.run.smithi186:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-02T09:26:50.362 INFO:teuthology.orchestra.run.smithi186.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-02T09:26:50.362 INFO:teuthology.orchestra.run.smithi186.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-02T09:26:50.363 INFO:teuthology.orchestra.run.smithi186.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-02T09:26:50.363 INFO:teuthology.orchestra.run.smithi186.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-02T09:26:50.363 INFO:teuthology.orchestra.run.smithi186.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-02T09:26:50.363 INFO:teuthology.orchestra.run.smithi186.stdout: = sunit=0 swidth=0 blks 2023-11-02T09:26:50.363 INFO:teuthology.orchestra.run.smithi186.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-02T09:26:50.364 INFO:teuthology.orchestra.run.smithi186.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-02T09:26:50.364 INFO:teuthology.orchestra.run.smithi186.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-02T09:26:50.364 INFO:teuthology.orchestra.run.smithi186.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-02T09:26:50.872 INFO:teuthology.orchestra.run.smithi186.stdout:Discarding blocks...Done. 2023-11-02T09:26:50.874 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi186.front.sepia.ceph.com -o noatime 2023-11-02T09:26:50.875 DEBUG:teuthology.orchestra.run.smithi186:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-11-02T09:26:50.983 DEBUG:teuthology.orchestra.run.smithi186:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-11-02T09:26:51.031 DEBUG:teuthology.orchestra.run.smithi186:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-11-02T09:26:51.072 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-02T09:26:51.072 INFO:tasks.ceph:role: osd.5 2023-11-02T09:26:51.073 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi186.front.sepia.ceph.com 2023-11-02T09:26:51.073 DEBUG:teuthology.orchestra.run.smithi186:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-02T09:26:51.160 INFO:teuthology.orchestra.run.smithi186.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-02T09:26:51.161 INFO:teuthology.orchestra.run.smithi186.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-02T09:26:51.161 INFO:teuthology.orchestra.run.smithi186.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-02T09:26:51.161 INFO:teuthology.orchestra.run.smithi186.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-02T09:26:51.161 INFO:teuthology.orchestra.run.smithi186.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-02T09:26:51.162 INFO:teuthology.orchestra.run.smithi186.stdout: = sunit=0 swidth=0 blks 2023-11-02T09:26:51.162 INFO:teuthology.orchestra.run.smithi186.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-02T09:26:51.162 INFO:teuthology.orchestra.run.smithi186.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-02T09:26:51.162 INFO:teuthology.orchestra.run.smithi186.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-02T09:26:51.162 INFO:teuthology.orchestra.run.smithi186.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-02T09:26:51.627 INFO:teuthology.orchestra.run.smithi186.stdout:Discarding blocks...Done. 2023-11-02T09:26:51.629 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi186.front.sepia.ceph.com -o noatime 2023-11-02T09:26:51.630 DEBUG:teuthology.orchestra.run.smithi186:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-11-02T09:26:51.702 DEBUG:teuthology.orchestra.run.smithi186:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-11-02T09:26:51.746 DEBUG:teuthology.orchestra.run.smithi186:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-11-02T09:26:51.825 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-02T09:26:51.826 INFO:tasks.ceph:role: osd.6 2023-11-02T09:26:51.826 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi186.front.sepia.ceph.com 2023-11-02T09:26:51.826 DEBUG:teuthology.orchestra.run.smithi186:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-02T09:26:51.912 INFO:teuthology.orchestra.run.smithi186.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-02T09:26:51.913 INFO:teuthology.orchestra.run.smithi186.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-02T09:26:51.913 INFO:teuthology.orchestra.run.smithi186.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-02T09:26:51.913 INFO:teuthology.orchestra.run.smithi186.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-02T09:26:51.913 INFO:teuthology.orchestra.run.smithi186.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-02T09:26:51.914 INFO:teuthology.orchestra.run.smithi186.stdout: = sunit=0 swidth=0 blks 2023-11-02T09:26:51.914 INFO:teuthology.orchestra.run.smithi186.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-02T09:26:51.914 INFO:teuthology.orchestra.run.smithi186.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-02T09:26:51.914 INFO:teuthology.orchestra.run.smithi186.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-02T09:26:51.914 INFO:teuthology.orchestra.run.smithi186.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-02T09:26:52.439 INFO:teuthology.orchestra.run.smithi186.stdout:Discarding blocks...Done. 2023-11-02T09:26:52.440 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi186.front.sepia.ceph.com -o noatime 2023-11-02T09:26:52.441 DEBUG:teuthology.orchestra.run.smithi186:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-11-02T09:26:52.561 DEBUG:teuthology.orchestra.run.smithi186:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-11-02T09:26:52.606 DEBUG:teuthology.orchestra.run.smithi186:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-11-02T09:26:52.687 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-02T09:26:52.688 INFO:tasks.ceph:role: osd.7 2023-11-02T09:26:52.688 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi186.front.sepia.ceph.com 2023-11-02T09:26:52.688 DEBUG:teuthology.orchestra.run.smithi186:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-02T09:26:52.775 INFO:teuthology.orchestra.run.smithi186.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-02T09:26:52.775 INFO:teuthology.orchestra.run.smithi186.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-02T09:26:52.776 INFO:teuthology.orchestra.run.smithi186.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-02T09:26:52.776 INFO:teuthology.orchestra.run.smithi186.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-02T09:26:52.776 INFO:teuthology.orchestra.run.smithi186.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-02T09:26:52.776 INFO:teuthology.orchestra.run.smithi186.stdout: = sunit=0 swidth=0 blks 2023-11-02T09:26:52.776 INFO:teuthology.orchestra.run.smithi186.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-02T09:26:52.777 INFO:teuthology.orchestra.run.smithi186.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-02T09:26:52.777 INFO:teuthology.orchestra.run.smithi186.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-02T09:26:52.777 INFO:teuthology.orchestra.run.smithi186.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-02T09:26:53.300 INFO:teuthology.orchestra.run.smithi186.stdout:Discarding blocks...Done. 2023-11-02T09:26:53.303 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi186.front.sepia.ceph.com -o noatime 2023-11-02T09:26:53.303 DEBUG:teuthology.orchestra.run.smithi186:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-11-02T09:26:53.372 DEBUG:teuthology.orchestra.run.smithi186:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-11-02T09:26:53.420 DEBUG:teuthology.orchestra.run.smithi186:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-02T09:26:53.489 INFO:teuthology.orchestra.run.smithi186.stderr:2023-11-02T09:26:53.486+0000 7efdd3d25500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-11-02T09:26:53.489 INFO:teuthology.orchestra.run.smithi186.stderr:2023-11-02T09:26:53.486+0000 7efdd3d25500 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-11-02T09:26:53.489 INFO:teuthology.orchestra.run.smithi186.stderr:2023-11-02T09:26:53.486+0000 7efdd3d25500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-02T09:26:53.490 INFO:teuthology.orchestra.run.smithi186.stderr:2023-11-02T09:26:53.486+0000 7efdd3d25500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-02T09:26:53.490 INFO:teuthology.orchestra.run.smithi186.stderr:2023-11-02T09:26:53.486+0000 7efdd3d25500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-02T09:26:53.490 INFO:teuthology.orchestra.run.smithi186.stderr:2023-11-02T09:26:53.487+0000 7efdd3d25500 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-11-02T09:26:56.340 DEBUG:teuthology.orchestra.run.smithi186:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-11-02T09:26:56.385 DEBUG:teuthology.orchestra.run.smithi186:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-02T09:26:56.488 INFO:teuthology.orchestra.run.smithi186.stderr:2023-11-02T09:26:56.484+0000 7fb723020500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-11-02T09:26:56.489 INFO:teuthology.orchestra.run.smithi186.stderr:2023-11-02T09:26:56.485+0000 7fb723020500 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-11-02T09:26:56.489 INFO:teuthology.orchestra.run.smithi186.stderr:2023-11-02T09:26:56.485+0000 7fb723020500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-02T09:26:56.489 INFO:teuthology.orchestra.run.smithi186.stderr:2023-11-02T09:26:56.485+0000 7fb723020500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-02T09:26:56.489 INFO:teuthology.orchestra.run.smithi186.stderr:2023-11-02T09:26:56.485+0000 7fb723020500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-02T09:26:56.489 INFO:teuthology.orchestra.run.smithi186.stderr:2023-11-02T09:26:56.485+0000 7fb723020500 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-11-02T09:26:59.336 DEBUG:teuthology.orchestra.run.smithi186:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-11-02T09:26:59.380 DEBUG:teuthology.orchestra.run.smithi186:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-02T09:26:59.482 INFO:teuthology.orchestra.run.smithi186.stderr:2023-11-02T09:26:59.479+0000 7f9b0b0b4500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-11-02T09:26:59.483 INFO:teuthology.orchestra.run.smithi186.stderr:2023-11-02T09:26:59.479+0000 7f9b0b0b4500 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-11-02T09:26:59.483 INFO:teuthology.orchestra.run.smithi186.stderr:2023-11-02T09:26:59.479+0000 7f9b0b0b4500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-02T09:26:59.483 INFO:teuthology.orchestra.run.smithi186.stderr:2023-11-02T09:26:59.479+0000 7f9b0b0b4500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-02T09:26:59.483 INFO:teuthology.orchestra.run.smithi186.stderr:2023-11-02T09:26:59.479+0000 7f9b0b0b4500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-02T09:26:59.484 INFO:teuthology.orchestra.run.smithi186.stderr:2023-11-02T09:26:59.480+0000 7f9b0b0b4500 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-11-02T09:27:02.354 DEBUG:teuthology.orchestra.run.smithi186:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-11-02T09:27:02.396 DEBUG:teuthology.orchestra.run.smithi186:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-02T09:27:02.494 INFO:teuthology.orchestra.run.smithi186.stderr:2023-11-02T09:27:02.491+0000 7f6953216500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-11-02T09:27:02.495 INFO:teuthology.orchestra.run.smithi186.stderr:2023-11-02T09:27:02.492+0000 7f6953216500 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-11-02T09:27:02.495 INFO:teuthology.orchestra.run.smithi186.stderr:2023-11-02T09:27:02.492+0000 7f6953216500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-02T09:27:02.495 INFO:teuthology.orchestra.run.smithi186.stderr:2023-11-02T09:27:02.492+0000 7f6953216500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-02T09:27:02.495 INFO:teuthology.orchestra.run.smithi186.stderr:2023-11-02T09:27:02.492+0000 7f6953216500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-02T09:27:02.496 INFO:teuthology.orchestra.run.smithi186.stderr:2023-11-02T09:27:02.492+0000 7f6953216500 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-11-02T09:27:05.340 DEBUG:teuthology.orchestra.run.smithi186:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-11-02T09:27:05.383 INFO:tasks.ceph:Reading keys from all nodes... 2023-11-02T09:27:05.384 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-11-02T09:27:05.384 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-11-02T09:27:05.431 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-11-02T09:27:05.431 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-11-02T09:27:05.514 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-11-02T09:27:05.514 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-11-02T09:27:05.596 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-11-02T09:27:05.597 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-11-02T09:27:05.678 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-11-02T09:27:05.678 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-11-02T09:27:05.758 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-11-02T09:27:05.758 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-11-02T09:27:05.802 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-11-02T09:27:05.802 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-11-02T09:27:05.883 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-11-02T09:27:05.884 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-11-02T09:27:05.964 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-11-02T09:27:05.964 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-11-02T09:27:06.043 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-11-02T09:27:06.043 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-11-02T09:27:06.123 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-11-02T09:27:06.123 DEBUG:teuthology.orchestra.run.smithi156:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-11-02T09:27:06.152 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-11-02T09:27:06.153 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-11-02T09:27:06.190 INFO:tasks.ceph:Adding keys to all mons... 2023-11-02T09:27:06.190 DEBUG:teuthology.orchestra.run.smithi156:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-02T09:27:06.195 DEBUG:teuthology.orchestra.run.smithi186:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-02T09:27:06.234 INFO:teuthology.orchestra.run.smithi156.stdout:[mgr.y] 2023-11-02T09:27:06.234 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQBMa0NlFkPTMxAA4FzCmdbZiyYcIvkkrfnGhQ== 2023-11-02T09:27:06.234 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.0] 2023-11-02T09:27:06.234 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQBOa0NlyedFHRAA8jERrToeCV2bpF0eDBLfAA== 2023-11-02T09:27:06.235 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.1] 2023-11-02T09:27:06.235 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQBRa0NlxesPGxAA1GM9q4LXSFcnv3iSPDsCBA== 2023-11-02T09:27:06.235 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.2] 2023-11-02T09:27:06.235 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQBUa0NlUbVgGBAAuSXyBGB9vgVFwlo2HU6ueQ== 2023-11-02T09:27:06.236 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.3] 2023-11-02T09:27:06.236 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQBXa0NlihI/FhAAwFupqfhe2V6IP12p5JFEWg== 2023-11-02T09:27:06.236 INFO:teuthology.orchestra.run.smithi156.stdout:[mgr.x] 2023-11-02T09:27:06.236 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQBMa0NlDXRCOBAAOTOQ+WV0rHWQFDBMcD7rpg== 2023-11-02T09:27:06.236 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.4] 2023-11-02T09:27:06.236 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQBda0NldB0IHRAAt6UTGpk4m51/tZqK54xh3Q== 2023-11-02T09:27:06.237 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.5] 2023-11-02T09:27:06.237 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQBga0NlwHb1HBAAH4awzVzlZic7hJdPl+ka9A== 2023-11-02T09:27:06.237 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.6] 2023-11-02T09:27:06.237 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQBja0NllIekHBAAmiA0Xt4C9ZfDTKFfveodCw== 2023-11-02T09:27:06.238 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.7] 2023-11-02T09:27:06.238 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQBma0NljG9eHRAA3bkO4T+mupYyUB6sBEN63g== 2023-11-02T09:27:06.238 INFO:teuthology.orchestra.run.smithi156.stdout:[client.0] 2023-11-02T09:27:06.238 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQBNa0NlXFosABAAfqNXT30ecrdz2TyD8HyofA== 2023-11-02T09:27:06.238 INFO:teuthology.orchestra.run.smithi156.stdout:[client.1] 2023-11-02T09:27:06.238 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQBNa0NlKF1kBBAAjzvc4XFhrN0/2sfXT+03EA== 2023-11-02T09:27:06.268 INFO:teuthology.orchestra.run.smithi186.stdout:[mgr.y] 2023-11-02T09:27:06.269 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQBMa0NlFkPTMxAA4FzCmdbZiyYcIvkkrfnGhQ== 2023-11-02T09:27:06.269 INFO:teuthology.orchestra.run.smithi186.stdout:[osd.0] 2023-11-02T09:27:06.269 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQBOa0NlyedFHRAA8jERrToeCV2bpF0eDBLfAA== 2023-11-02T09:27:06.269 INFO:teuthology.orchestra.run.smithi186.stdout:[osd.1] 2023-11-02T09:27:06.270 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQBRa0NlxesPGxAA1GM9q4LXSFcnv3iSPDsCBA== 2023-11-02T09:27:06.270 INFO:teuthology.orchestra.run.smithi186.stdout:[osd.2] 2023-11-02T09:27:06.270 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQBUa0NlUbVgGBAAuSXyBGB9vgVFwlo2HU6ueQ== 2023-11-02T09:27:06.270 INFO:teuthology.orchestra.run.smithi186.stdout:[osd.3] 2023-11-02T09:27:06.270 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQBXa0NlihI/FhAAwFupqfhe2V6IP12p5JFEWg== 2023-11-02T09:27:06.271 INFO:teuthology.orchestra.run.smithi186.stdout:[mgr.x] 2023-11-02T09:27:06.271 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQBMa0NlDXRCOBAAOTOQ+WV0rHWQFDBMcD7rpg== 2023-11-02T09:27:06.271 INFO:teuthology.orchestra.run.smithi186.stdout:[osd.4] 2023-11-02T09:27:06.271 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQBda0NldB0IHRAAt6UTGpk4m51/tZqK54xh3Q== 2023-11-02T09:27:06.271 INFO:teuthology.orchestra.run.smithi186.stdout:[osd.5] 2023-11-02T09:27:06.272 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQBga0NlwHb1HBAAH4awzVzlZic7hJdPl+ka9A== 2023-11-02T09:27:06.272 INFO:teuthology.orchestra.run.smithi186.stdout:[osd.6] 2023-11-02T09:27:06.272 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQBja0NllIekHBAAmiA0Xt4C9ZfDTKFfveodCw== 2023-11-02T09:27:06.272 INFO:teuthology.orchestra.run.smithi186.stdout:[osd.7] 2023-11-02T09:27:06.272 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQBma0NljG9eHRAA3bkO4T+mupYyUB6sBEN63g== 2023-11-02T09:27:06.273 INFO:teuthology.orchestra.run.smithi186.stdout:[client.0] 2023-11-02T09:27:06.273 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQBNa0NlXFosABAAfqNXT30ecrdz2TyD8HyofA== 2023-11-02T09:27:06.273 INFO:teuthology.orchestra.run.smithi186.stdout:[client.1] 2023-11-02T09:27:06.273 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQBNa0NlKF1kBBAAjzvc4XFhrN0/2sfXT+03EA== 2023-11-02T09:27:06.274 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-02T09:27:06.282 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-02T09:27:06.378 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-02T09:27:06.381 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-02T09:27:06.445 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-02T09:27:06.448 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-02T09:27:06.512 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-02T09:27:06.514 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-02T09:27:06.578 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-02T09:27:06.581 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-02T09:27:06.646 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-02T09:27:06.648 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-02T09:27:06.713 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-02T09:27:06.715 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-02T09:27:06.779 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-02T09:27:06.781 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-02T09:27:06.846 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-02T09:27:06.848 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-02T09:27:06.913 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-02T09:27:06.915 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-02T09:27:06.979 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-02T09:27:06.982 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-02T09:27:07.048 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-02T09:27:07.051 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-02T09:27:07.120 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-11-02T09:27:07.120 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-11-02T09:27:07.160 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-02T09:27:07.270 DEBUG:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-11-02T09:27:07.310 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-11-02T09:27:07.389 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-02T09:27:07.499 DEBUG:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-11-02T09:27:07.539 DEBUG:teuthology.orchestra.run.smithi186:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-11-02T09:27:07.580 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-02T09:27:07.689 DEBUG:teuthology.orchestra.run.smithi186:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-11-02T09:27:07.729 DEBUG:teuthology.orchestra.run.smithi156:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-02T09:27:07.731 DEBUG:teuthology.orchestra.run.smithi186:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-02T09:27:07.796 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-11-02T09:27:07.797 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-02T09:27:07.797 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-11-02T09:27:07.800 INFO:tasks.ceph.mon.a:Started 2023-11-02T09:27:07.800 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-02T09:27:07.801 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-11-02T09:27:07.803 INFO:tasks.ceph.mon.c:Started 2023-11-02T09:27:07.803 INFO:tasks.ceph.mon.b:Restarting daemon 2023-11-02T09:27:07.803 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-11-02T09:27:07.839 INFO:tasks.ceph.mon.b:Started 2023-11-02T09:27:07.840 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-11-02T09:27:07.840 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-11-02T09:27:07.840 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-11-02T09:27:07.843 INFO:tasks.ceph.mgr.y:Started 2023-11-02T09:27:07.843 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-11-02T09:27:07.843 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-11-02T09:27:07.845 INFO:tasks.ceph.mgr.x:Started 2023-11-02T09:27:07.846 INFO:tasks.ceph:Setting crush tunables to default 2023-11-02T09:27:07.846 DEBUG:teuthology.orchestra.run.smithi156:> sudo ceph --cluster ceph osd crush tunables default 2023-11-02T09:27:13.247 INFO:teuthology.orchestra.run.smithi156.stderr:adjusted tunables profile to default 2023-11-02T09:27:13.259 INFO:tasks.ceph:check_enable_crimson: False 2023-11-02T09:27:13.260 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-11-02T09:27:13.260 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-11-02T09:27:13.261 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-11-02T09:27:13.301 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-11-02T09:27:13.302 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-11-02T09:27:13.383 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-11-02T09:27:13.383 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-11-02T09:27:13.464 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-11-02T09:27:13.465 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-11-02T09:27:13.546 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-11-02T09:27:13.546 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-11-02T09:27:13.587 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-11-02T09:27:13.588 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-11-02T09:27:13.635 INFO:tasks.ceph.mgr.x.smithi186.stderr:2023-11-02T09:27:13.632+0000 7f2f18e2b040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-02T09:27:13.668 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-11-02T09:27:13.668 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-11-02T09:27:13.669 INFO:tasks.ceph.mgr.y.smithi156.stderr:2023-11-02T09:27:13.666+0000 7f4b53b7f040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-02T09:27:13.691 INFO:tasks.ceph.mgr.x.smithi186.stderr:2023-11-02T09:27:13.687+0000 7f2f18e2b040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-02T09:27:13.719 INFO:tasks.ceph.mgr.y.smithi156.stderr:2023-11-02T09:27:13.716+0000 7f4b53b7f040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-02T09:27:13.730 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-11-02T09:27:13.731 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-11-02T09:27:13.810 DEBUG:teuthology.orchestra.run.smithi186:> sudo ceph --cluster ceph osd new 147759cf-dd66-4c03-ad74-6a0334f27fc1 0 2023-11-02T09:27:14.047 INFO:teuthology.orchestra.run.smithi186.stdout:0 2023-11-02T09:27:14.058 DEBUG:teuthology.orchestra.run.smithi186:> sudo ceph --cluster ceph osd new 24f6689d-df06-4f42-ae80-27b5320f90ae 1 2023-11-02T09:27:14.258 INFO:teuthology.orchestra.run.smithi186.stdout:1 2023-11-02T09:27:14.270 DEBUG:teuthology.orchestra.run.smithi186:> sudo ceph --cluster ceph osd new cc62ac33-467a-409d-a4b5-68ae20b09b7d 2 2023-11-02T09:27:14.310 INFO:tasks.ceph.mgr.y.smithi156.stderr:2023-11-02T09:27:14.307+0000 7f4b53b7f040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-02T09:27:14.330 INFO:tasks.ceph.mgr.x.smithi186.stderr:2023-11-02T09:27:14.327+0000 7f2f18e2b040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-02T09:27:14.361 INFO:tasks.ceph.mgr.y.smithi156.stderr:2023-11-02T09:27:14.359+0000 7f4b53b7f040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-02T09:27:14.384 INFO:tasks.ceph.mgr.x.smithi186.stderr:2023-11-02T09:27:14.380+0000 7f2f18e2b040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-02T09:27:14.406 INFO:tasks.ceph.mgr.y.smithi156.stderr:2023-11-02T09:27:14.404+0000 7f4b53b7f040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-02T09:27:14.432 INFO:tasks.ceph.mgr.x.smithi186.stderr:2023-11-02T09:27:14.428+0000 7f2f18e2b040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-02T09:27:14.460 INFO:tasks.ceph.mgr.y.smithi156.stderr:2023-11-02T09:27:14.457+0000 7f4b53b7f040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-02T09:27:14.470 INFO:teuthology.orchestra.run.smithi186.stdout:2 2023-11-02T09:27:14.480 DEBUG:teuthology.orchestra.run.smithi186:> sudo ceph --cluster ceph osd new 3f8b7c67-b8a4-49a0-97e7-b560379e18f2 3 2023-11-02T09:27:14.488 INFO:tasks.ceph.mgr.x.smithi186.stderr:2023-11-02T09:27:14.485+0000 7f2f18e2b040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-02T09:27:14.502 INFO:tasks.ceph.mgr.y.smithi156.stderr:2023-11-02T09:27:14.499+0000 7f4b53b7f040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-02T09:27:14.534 INFO:tasks.ceph.mgr.x.smithi186.stderr:2023-11-02T09:27:14.530+0000 7f2f18e2b040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-02T09:27:14.602 INFO:tasks.ceph.mgr.y.smithi156.stderr:2023-11-02T09:27:14.599+0000 7f4b53b7f040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-11-02T09:27:14.639 INFO:tasks.ceph.mgr.x.smithi186.stderr:2023-11-02T09:27:14.635+0000 7f2f18e2b040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-11-02T09:27:14.671 INFO:tasks.ceph.mgr.y.smithi156.stderr:2023-11-02T09:27:14.668+0000 7f4b53b7f040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-02T09:27:14.679 INFO:teuthology.orchestra.run.smithi186.stdout:3 2023-11-02T09:27:14.691 DEBUG:teuthology.orchestra.run.smithi186:> sudo ceph --cluster ceph osd new ebbafda7-b361-457a-81ce-190a4c48704a 4 2023-11-02T09:27:14.712 INFO:tasks.ceph.mgr.x.smithi186.stderr:2023-11-02T09:27:14.709+0000 7f2f18e2b040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-02T09:27:14.716 INFO:tasks.ceph.mgr.y.smithi156.stderr:2023-11-02T09:27:14.714+0000 7f4b53b7f040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-02T09:27:14.761 INFO:tasks.ceph.mgr.x.smithi186.stderr:2023-11-02T09:27:14.758+0000 7f2f18e2b040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-02T09:27:14.768 INFO:tasks.ceph.mgr.y.smithi156.stderr:2023-11-02T09:27:14.765+0000 7f4b53b7f040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-02T09:27:14.814 INFO:tasks.ceph.mgr.y.smithi156.stderr:2023-11-02T09:27:14.811+0000 7f4b53b7f040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-02T09:27:14.815 INFO:tasks.ceph.mgr.x.smithi186.stderr:2023-11-02T09:27:14.812+0000 7f2f18e2b040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-02T09:27:14.865 INFO:tasks.ceph.mgr.x.smithi186.stderr:2023-11-02T09:27:14.861+0000 7f2f18e2b040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-02T09:27:14.909 INFO:teuthology.orchestra.run.smithi186.stdout:4 2023-11-02T09:27:14.920 DEBUG:teuthology.orchestra.run.smithi186:> sudo ceph --cluster ceph osd new 62efa38c-9940-4750-bd5e-b9d95389ff93 5 2023-11-02T09:27:15.113 INFO:teuthology.orchestra.run.smithi186.stdout:5 2023-11-02T09:27:15.125 DEBUG:teuthology.orchestra.run.smithi186:> sudo ceph --cluster ceph osd new a33f3dde-6b0c-447d-a353-8d27075ce756 6 2023-11-02T09:27:15.195 INFO:tasks.ceph.mgr.y.smithi156.stderr:2023-11-02T09:27:15.192+0000 7f4b53b7f040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-02T09:27:15.265 INFO:tasks.ceph.mgr.x.smithi186.stderr:2023-11-02T09:27:15.261+0000 7f2f18e2b040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-02T09:27:15.318 INFO:teuthology.orchestra.run.smithi186.stdout:6 2023-11-02T09:27:15.329 DEBUG:teuthology.orchestra.run.smithi186:> sudo ceph --cluster ceph osd new 73e867a0-947d-4217-9bf4-03a5899d5292 7 2023-11-02T09:27:15.330 INFO:tasks.ceph.mgr.y.smithi156.stderr:2023-11-02T09:27:15.327+0000 7f4b53b7f040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-02T09:27:15.406 INFO:tasks.ceph.mgr.x.smithi186.stderr:2023-11-02T09:27:15.403+0000 7f2f18e2b040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-02T09:27:15.453 INFO:tasks.ceph.mgr.y.smithi156.stderr:2023-11-02T09:27:15.450+0000 7f4b53b7f040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-02T09:27:15.498 INFO:tasks.ceph.mgr.y.smithi156.stderr:2023-11-02T09:27:15.495+0000 7f4b53b7f040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-02T09:27:15.523 INFO:teuthology.orchestra.run.smithi186.stdout:7 2023-11-02T09:27:15.534 INFO:tasks.ceph.osd.0:Restarting daemon 2023-11-02T09:27:15.535 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-11-02T09:27:15.537 INFO:tasks.ceph.osd.0:Started 2023-11-02T09:27:15.537 INFO:tasks.ceph.osd.1:Restarting daemon 2023-11-02T09:27:15.538 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-11-02T09:27:15.540 INFO:tasks.ceph.osd.1:Started 2023-11-02T09:27:15.540 INFO:tasks.ceph.osd.2:Restarting daemon 2023-11-02T09:27:15.540 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-11-02T09:27:15.541 INFO:tasks.ceph.mgr.x.smithi186.stderr:2023-11-02T09:27:15.538+0000 7f2f18e2b040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-02T09:27:15.542 INFO:tasks.ceph.osd.2:Started 2023-11-02T09:27:15.543 INFO:tasks.ceph.osd.3:Restarting daemon 2023-11-02T09:27:15.543 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-11-02T09:27:15.545 INFO:tasks.ceph.osd.3:Started 2023-11-02T09:27:15.546 INFO:tasks.ceph.osd.4:Restarting daemon 2023-11-02T09:27:15.546 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-11-02T09:27:15.548 INFO:tasks.ceph.osd.4:Started 2023-11-02T09:27:15.549 INFO:tasks.ceph.osd.5:Restarting daemon 2023-11-02T09:27:15.549 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-11-02T09:27:15.552 INFO:tasks.ceph.osd.5:Started 2023-11-02T09:27:15.552 INFO:tasks.ceph.osd.6:Restarting daemon 2023-11-02T09:27:15.553 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-11-02T09:27:15.555 INFO:tasks.ceph.osd.6:Started 2023-11-02T09:27:15.555 INFO:tasks.ceph.osd.7:Restarting daemon 2023-11-02T09:27:15.556 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-11-02T09:27:15.558 INFO:tasks.ceph.osd.7:Started 2023-11-02T09:27:15.558 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-02T09:27:15.599 INFO:tasks.ceph.mgr.x.smithi186.stderr:2023-11-02T09:27:15.596+0000 7f2f18e2b040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-02T09:27:15.619 INFO:tasks.ceph.mgr.y.smithi156.stderr:2023-11-02T09:27:15.616+0000 7f4b53b7f040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-02T09:27:15.722 INFO:tasks.ceph.mgr.x.smithi186.stderr:2023-11-02T09:27:15.719+0000 7f2f18e2b040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-02T09:27:15.733 INFO:tasks.ceph.mgr.y.smithi156.stderr:2023-11-02T09:27:15.731+0000 7f4b53b7f040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-02T09:27:15.773 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:27:15.774 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":10,"fsid":"e3a6132b-4ab5-4c55-b185-291b38e09c41","created":"2023-11-02T09:27:13.149641+0000","modified":"2023-11-02T09:27:15.520071+0000","last_up_change":"0.000000","last_in_change":"2023-11-02T09:27:15.520071+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"147759cf-dd66-4c03-ad74-6a0334f27fc1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"24f6689d-df06-4f42-ae80-27b5320f90ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"cc62ac33-467a-409d-a4b5-68ae20b09b7d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3f8b7c67-b8a4-49a0-97e7-b560379e18f2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ebbafda7-b361-457a-81ce-190a4c48704a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"62efa38c-9940-4750-bd5e-b9d95389ff93","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a33f3dde-6b0c-447d-a353-8d27075ce756","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"73e867a0-947d-4217-9bf4-03a5899d5292","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-02T09:27:15.784 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-11-02T09:27:15.785 INFO:tasks.ceph:Waiting for OSDs to come up 2023-11-02T09:27:15.816 INFO:tasks.ceph.mgr.x.smithi186.stderr:2023-11-02T09:27:15.812+0000 7f2f18e2b040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-02T09:27:15.876 INFO:tasks.ceph.mgr.y.smithi156.stderr:2023-11-02T09:27:15.873+0000 7f4b53b7f040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-02T09:27:15.918 INFO:tasks.ceph.mgr.y.smithi156.stderr:2023-11-02T09:27:15.915+0000 7f4b53b7f040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-02T09:27:15.956 INFO:tasks.ceph.mgr.x.smithi186.stderr:2023-11-02T09:27:15.952+0000 7f2f18e2b040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-02T09:27:15.997 INFO:tasks.ceph.mgr.x.smithi186.stderr:2023-11-02T09:27:15.993+0000 7f2f18e2b040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-02T09:27:16.057 INFO:tasks.ceph.mgr.y.smithi156.stderr:2023-11-02T09:27:16.054+0000 7f4b53b7f040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-02T09:27:16.134 INFO:tasks.ceph.mgr.x.smithi186.stderr:2023-11-02T09:27:16.131+0000 7f2f18e2b040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-02T09:27:16.162 INFO:tasks.ceph.osd.4.smithi186.stderr:2023-11-02T09:27:16.158+0000 7fc603212500 -1 Falling back to public interface 2023-11-02T09:27:16.162 INFO:tasks.ceph.osd.2.smithi156.stderr:2023-11-02T09:27:16.159+0000 7fd33a638500 -1 Falling back to public interface 2023-11-02T09:27:16.173 INFO:tasks.ceph.osd.5.smithi186.stderr:2023-11-02T09:27:16.169+0000 7fd0aa3ad500 -1 Falling back to public interface 2023-11-02T09:27:16.174 INFO:tasks.ceph.osd.7.smithi186.stderr:2023-11-02T09:27:16.170+0000 7fd345e24500 -1 Falling back to public interface 2023-11-02T09:27:16.176 INFO:tasks.ceph.osd.1.smithi156.stderr:2023-11-02T09:27:16.173+0000 7fa023ed8500 -1 Falling back to public interface 2023-11-02T09:27:16.180 INFO:tasks.ceph.osd.3.smithi156.stderr:2023-11-02T09:27:16.177+0000 7f7f0f825500 -1 Falling back to public interface 2023-11-02T09:27:16.180 INFO:tasks.ceph.osd.0.smithi156.stderr:2023-11-02T09:27:16.177+0000 7fc81080d500 -1 Falling back to public interface 2023-11-02T09:27:16.201 INFO:tasks.ceph.osd.6.smithi186.stderr:2023-11-02T09:27:16.198+0000 7f8a788af500 -1 Falling back to public interface 2023-11-02T09:27:16.590 DEBUG:teuthology.orchestra.run.smithi156:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-02T09:27:16.778 INFO:teuthology.misc.health.smithi156.stdout: 2023-11-02T09:27:16.778 INFO:teuthology.misc.health.smithi156.stdout:{"epoch":10,"fsid":"e3a6132b-4ab5-4c55-b185-291b38e09c41","created":"2023-11-02T09:27:13.149641+0000","modified":"2023-11-02T09:27:15.520071+0000","last_up_change":"0.000000","last_in_change":"2023-11-02T09:27:15.520071+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"147759cf-dd66-4c03-ad74-6a0334f27fc1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"24f6689d-df06-4f42-ae80-27b5320f90ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"cc62ac33-467a-409d-a4b5-68ae20b09b7d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3f8b7c67-b8a4-49a0-97e7-b560379e18f2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ebbafda7-b361-457a-81ce-190a4c48704a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"62efa38c-9940-4750-bd5e-b9d95389ff93","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a33f3dde-6b0c-447d-a353-8d27075ce756","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"73e867a0-947d-4217-9bf4-03a5899d5292","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-02T09:27:16.788 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-02T09:27:16.896 INFO:tasks.ceph.mgr.y.smithi156.stderr:2023-11-02T09:27:16.894+0000 7f4b53b7f040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-02T09:27:16.961 INFO:tasks.ceph.mgr.x.smithi186.stderr:2023-11-02T09:27:16.957+0000 7f2f18e2b040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-02T09:27:17.168 INFO:tasks.ceph.mgr.y.smithi156.stderr:2023-11-02T09:27:17.165+0000 7f4b53b7f040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-02T09:27:17.219 INFO:tasks.ceph.mgr.y.smithi156.stderr:2023-11-02T09:27:17.216+0000 7f4b53b7f040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-02T09:27:17.231 INFO:tasks.ceph.mgr.x.smithi186.stderr:2023-11-02T09:27:17.228+0000 7f2f18e2b040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-02T09:27:17.284 INFO:tasks.ceph.mgr.x.smithi186.stderr:2023-11-02T09:27:17.280+0000 7f2f18e2b040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-02T09:27:17.320 INFO:tasks.ceph.mgr.y.smithi156.stderr:2023-11-02T09:27:17.317+0000 7f4b53b7f040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-02T09:27:17.387 INFO:tasks.ceph.mgr.x.smithi186.stderr:2023-11-02T09:27:17.384+0000 7f2f18e2b040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-02T09:27:18.346 INFO:tasks.ceph.mgr.y.smithi156.stderr:2023-11-02T09:27:18.343+0000 7f4af3cf7640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-11-02T09:27:18.347 INFO:tasks.ceph.mgr.y.smithi156.stderr:2023-11-02T09:27:18.344+0000 7f4af3cf7640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-11-02T09:27:19.614 INFO:tasks.ceph.osd.2.smithi156.stderr:2023-11-02T09:27:19.611+0000 7fd33a638500 -1 osd.2 0 log_to_monitors true 2023-11-02T09:27:19.631 INFO:tasks.ceph.osd.4.smithi186.stderr:2023-11-02T09:27:19.628+0000 7fc603212500 -1 osd.4 0 log_to_monitors true 2023-11-02T09:27:19.672 INFO:tasks.ceph.osd.7.smithi186.stderr:2023-11-02T09:27:19.669+0000 7fd345e24500 -1 osd.7 0 log_to_monitors true 2023-11-02T09:27:19.683 INFO:tasks.ceph.osd.1.smithi156.stderr:2023-11-02T09:27:19.681+0000 7fa023ed8500 -1 osd.1 0 log_to_monitors true 2023-11-02T09:27:19.689 INFO:tasks.ceph.osd.3.smithi156.stderr:2023-11-02T09:27:19.687+0000 7f7f0f825500 -1 osd.3 0 log_to_monitors true 2023-11-02T09:27:19.702 INFO:tasks.ceph.osd.5.smithi186.stderr:2023-11-02T09:27:19.700+0000 7fd0aa3ad500 -1 osd.5 0 log_to_monitors true 2023-11-02T09:27:19.710 INFO:tasks.ceph.osd.0.smithi156.stderr:2023-11-02T09:27:19.707+0000 7fc81080d500 -1 osd.0 0 log_to_monitors true 2023-11-02T09:27:19.711 INFO:tasks.ceph.osd.6.smithi186.stderr:2023-11-02T09:27:19.708+0000 7f8a788af500 -1 osd.6 0 log_to_monitors true 2023-11-02T09:27:22.704 INFO:tasks.ceph.osd.0.smithi156.stderr:2023-11-02T09:27:22.701+0000 7fc80b90f640 -1 osd.0 0 waiting for initial osdmap 2023-11-02T09:27:22.715 INFO:tasks.ceph.osd.0.smithi156.stderr:2023-11-02T09:27:22.713+0000 7fc803f41640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-02T09:27:22.738 INFO:tasks.ceph.osd.1.smithi156.stderr:2023-11-02T09:27:22.736+0000 7fa020e81640 -1 osd.1 0 waiting for initial osdmap 2023-11-02T09:27:22.752 INFO:tasks.ceph.osd.1.smithi156.stderr:2023-11-02T09:27:22.749+0000 7fa017c79640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-02T09:27:22.779 INFO:tasks.ceph.osd.3.smithi156.stderr:2023-11-02T09:27:22.776+0000 7f7f0a8d6640 -1 osd.3 0 waiting for initial osdmap 2023-11-02T09:27:22.793 INFO:tasks.ceph.osd.3.smithi156.stderr:2023-11-02T09:27:22.791+0000 7f7f02f08640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-02T09:27:22.812 INFO:tasks.ceph.osd.2.smithi156.stderr:2023-11-02T09:27:22.809+0000 7fd335da9640 -1 osd.2 0 waiting for initial osdmap 2023-11-02T09:27:22.822 INFO:tasks.ceph.osd.2.smithi156.stderr:2023-11-02T09:27:22.819+0000 7fd32e3db640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-02T09:27:23.415 INFO:tasks.ceph.osd.6.smithi186.stderr:2023-11-02T09:27:23.412+0000 7f8a7401e640 -1 osd.6 0 waiting for initial osdmap 2023-11-02T09:27:23.422 INFO:tasks.ceph.osd.4.smithi186.stderr:2023-11-02T09:27:23.419+0000 7fc5fe3ae640 -1 osd.4 0 waiting for initial osdmap 2023-11-02T09:27:23.431 INFO:tasks.ceph.osd.4.smithi186.stderr:2023-11-02T09:27:23.429+0000 7fc5f69e0640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-02T09:27:23.434 INFO:tasks.ceph.osd.6.smithi186.stderr:2023-11-02T09:27:23.432+0000 7f8a6c650640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-02T09:27:23.494 INFO:tasks.ceph.osd.5.smithi186.stderr:2023-11-02T09:27:23.491+0000 7fd0a7356640 -1 osd.5 0 waiting for initial osdmap 2023-11-02T09:27:23.503 INFO:tasks.ceph.osd.7.smithi186.stderr:2023-11-02T09:27:23.501+0000 7fd340f4a640 -1 osd.7 0 waiting for initial osdmap 2023-11-02T09:27:23.516 INFO:tasks.ceph.osd.5.smithi186.stderr:2023-11-02T09:27:23.513+0000 7fd09e14e640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-02T09:27:23.521 INFO:tasks.ceph.osd.7.smithi186.stderr:2023-11-02T09:27:23.518+0000 7fd33957c640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-02T09:27:23.594 DEBUG:teuthology.orchestra.run.smithi156:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-02T09:27:23.885 INFO:teuthology.misc.health.smithi156.stdout: 2023-11-02T09:27:23.885 INFO:teuthology.misc.health.smithi156.stdout:{"epoch":13,"fsid":"e3a6132b-4ab5-4c55-b185-291b38e09c41","created":"2023-11-02T09:27:13.149641+0000","modified":"2023-11-02T09:27:23.726949+0000","last_up_change":"2023-11-02T09:27:23.726949+0000","last_in_change":"2023-11-02T09:27:15.520071+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"147759cf-dd66-4c03-ad74-6a0334f27fc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6817","nonce":1501862808},{"type":"v1","addr":"172.21.15.156:6819","nonce":1501862808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6821","nonce":1501862808},{"type":"v1","addr":"172.21.15.156:6823","nonce":1501862808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":1501862808},{"type":"v1","addr":"172.21.15.156:6831","nonce":1501862808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":1501862808},{"type":"v1","addr":"172.21.15.156:6828","nonce":1501862808}]},"public_addr":"172.21.15.156:6819/1501862808","cluster_addr":"172.21.15.156:6823/1501862808","heartbeat_back_addr":"172.21.15.156:6831/1501862808","heartbeat_front_addr":"172.21.15.156:6828/1501862808","state":["exists","up"]},{"osd":1,"uuid":"24f6689d-df06-4f42-ae80-27b5320f90ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":401255255},{"type":"v1","addr":"172.21.15.156:6809","nonce":401255255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":401255255},{"type":"v1","addr":"172.21.15.156:6811","nonce":401255255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":401255255},{"type":"v1","addr":"172.21.15.156:6815","nonce":401255255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":401255255},{"type":"v1","addr":"172.21.15.156:6813","nonce":401255255}]},"public_addr":"172.21.15.156:6809/401255255","cluster_addr":"172.21.15.156:6811/401255255","heartbeat_back_addr":"172.21.15.156:6815/401255255","heartbeat_front_addr":"172.21.15.156:6813/401255255","state":["exists","up"]},{"osd":2,"uuid":"cc62ac33-467a-409d-a4b5-68ae20b09b7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":2411302291},{"type":"v1","addr":"172.21.15.156:6801","nonce":2411302291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":2411302291},{"type":"v1","addr":"172.21.15.156:6803","nonce":2411302291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":2411302291},{"type":"v1","addr":"172.21.15.156:6807","nonce":2411302291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":2411302291},{"type":"v1","addr":"172.21.15.156:6805","nonce":2411302291}]},"public_addr":"172.21.15.156:6801/2411302291","cluster_addr":"172.21.15.156:6803/2411302291","heartbeat_back_addr":"172.21.15.156:6807/2411302291","heartbeat_front_addr":"172.21.15.156:6805/2411302291","state":["exists","up"]},{"osd":3,"uuid":"3f8b7c67-b8a4-49a0-97e7-b560379e18f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":874376308},{"type":"v1","addr":"172.21.15.156:6818","nonce":874376308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":874376308},{"type":"v1","addr":"172.21.15.156:6822","nonce":874376308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6827","nonce":874376308},{"type":"v1","addr":"172.21.15.156:6829","nonce":874376308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":874376308},{"type":"v1","addr":"172.21.15.156:6825","nonce":874376308}]},"public_addr":"172.21.15.156:6818/874376308","cluster_addr":"172.21.15.156:6822/874376308","heartbeat_back_addr":"172.21.15.156:6829/874376308","heartbeat_front_addr":"172.21.15.156:6825/874376308","state":["exists","up"]},{"osd":4,"uuid":"ebbafda7-b361-457a-81ce-190a4c48704a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":1552589339},{"type":"v1","addr":"172.21.15.186:6801","nonce":1552589339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":1552589339},{"type":"v1","addr":"172.21.15.186:6803","nonce":1552589339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":1552589339},{"type":"v1","addr":"172.21.15.186:6807","nonce":1552589339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":1552589339},{"type":"v1","addr":"172.21.15.186:6805","nonce":1552589339}]},"public_addr":"172.21.15.186:6801/1552589339","cluster_addr":"172.21.15.186:6803/1552589339","heartbeat_back_addr":"172.21.15.186:6807/1552589339","heartbeat_front_addr":"172.21.15.186:6805/1552589339","state":["exists","up"]},{"osd":5,"uuid":"62efa38c-9940-4750-bd5e-b9d95389ff93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":64489016},{"type":"v1","addr":"172.21.15.186:6809","nonce":64489016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":64489016},{"type":"v1","addr":"172.21.15.186:6811","nonce":64489016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6815","nonce":64489016},{"type":"v1","addr":"172.21.15.186:6817","nonce":64489016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":64489016},{"type":"v1","addr":"172.21.15.186:6813","nonce":64489016}]},"public_addr":"172.21.15.186:6809/64489016","cluster_addr":"172.21.15.186:6811/64489016","heartbeat_back_addr":"172.21.15.186:6817/64489016","heartbeat_front_addr":"172.21.15.186:6813/64489016","state":["exists","up"]},{"osd":6,"uuid":"a33f3dde-6b0c-447d-a353-8d27075ce756","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":3687416482},{"type":"v1","addr":"172.21.15.186:6825","nonce":3687416482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":3687416482},{"type":"v1","addr":"172.21.15.186:6827","nonce":3687416482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":3687416482},{"type":"v1","addr":"172.21.15.186:6831","nonce":3687416482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":3687416482},{"type":"v1","addr":"172.21.15.186:6829","nonce":3687416482}]},"public_addr":"172.21.15.186:6825/3687416482","cluster_addr":"172.21.15.186:6827/3687416482","heartbeat_back_addr":"172.21.15.186:6831/3687416482","heartbeat_front_addr":"172.21.15.186:6829/3687416482","state":["exists","up"]},{"osd":7,"uuid":"73e867a0-947d-4217-9bf4-03a5899d5292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":3647940145},{"type":"v1","addr":"172.21.15.186:6816","nonce":3647940145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":3647940145},{"type":"v1","addr":"172.21.15.186:6819","nonce":3647940145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":3647940145},{"type":"v1","addr":"172.21.15.186:6823","nonce":3647940145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":3647940145},{"type":"v1","addr":"172.21.15.186:6821","nonce":3647940145}]},"public_addr":"172.21.15.186:6816/3647940145","cluster_addr":"172.21.15.186:6819/3647940145","heartbeat_back_addr":"172.21.15.186:6823/3647940145","heartbeat_front_addr":"172.21.15.186:6821/3647940145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-02T09:27:23.896 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-11-02T09:27:23.896 INFO:tasks.ceph:Creating RBD pool 2023-11-02T09:27:23.897 DEBUG:teuthology.orchestra.run.smithi156:> sudo ceph --cluster ceph osd pool create rbd 8 2023-11-02T09:27:24.733 INFO:teuthology.orchestra.run.smithi156.stderr:pool 'rbd' created 2023-11-02T09:27:24.747 DEBUG:teuthology.orchestra.run.smithi156:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-11-02T09:27:25.736 INFO:teuthology.orchestra.run.smithi156.stderr:enabled application 'rbd' on pool 'rbd' 2023-11-02T09:27:25.752 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-11-02T09:27:25.753 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-11-02T09:27:25.753 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-11-02T09:27:25.754 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-11-02T09:27:25.754 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-11-02T09:27:26.099 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:27:26.110 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":4,"active_gid":4110,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":2761652146},{"type":"v1","addr":"172.21.15.156:6833","nonce":2761652146}]},"active_addr":"172.21.15.156:6833/2761652146","active_change":"2023-11-02T09:27:17.331890+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4105,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.156:0","nonce":2474989968}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.156:0","nonce":66039569}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.156:0","nonce":960415586}]}]} 2023-11-02T09:27:26.116 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-11-02T09:27:26.116 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-11-02T09:27:26.116 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-02T09:27:26.407 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:27:26.408 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":15,"fsid":"e3a6132b-4ab5-4c55-b185-291b38e09c41","created":"2023-11-02T09:27:13.149641+0000","modified":"2023-11-02T09:27:25.730053+0000","last_up_change":"2023-11-02T09:27:23.726949+0000","last_in_change":"2023-11-02T09:27:15.520071+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-02T09:27:24.203409+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-02T09:27:25.381094+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"147759cf-dd66-4c03-ad74-6a0334f27fc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6817","nonce":1501862808},{"type":"v1","addr":"172.21.15.156:6819","nonce":1501862808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6821","nonce":1501862808},{"type":"v1","addr":"172.21.15.156:6823","nonce":1501862808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":1501862808},{"type":"v1","addr":"172.21.15.156:6831","nonce":1501862808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":1501862808},{"type":"v1","addr":"172.21.15.156:6828","nonce":1501862808}]},"public_addr":"172.21.15.156:6819/1501862808","cluster_addr":"172.21.15.156:6823/1501862808","heartbeat_back_addr":"172.21.15.156:6831/1501862808","heartbeat_front_addr":"172.21.15.156:6828/1501862808","state":["exists","up"]},{"osd":1,"uuid":"24f6689d-df06-4f42-ae80-27b5320f90ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":401255255},{"type":"v1","addr":"172.21.15.156:6809","nonce":401255255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":401255255},{"type":"v1","addr":"172.21.15.156:6811","nonce":401255255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":401255255},{"type":"v1","addr":"172.21.15.156:6815","nonce":401255255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":401255255},{"type":"v1","addr":"172.21.15.156:6813","nonce":401255255}]},"public_addr":"172.21.15.156:6809/401255255","cluster_addr":"172.21.15.156:6811/401255255","heartbeat_back_addr":"172.21.15.156:6815/401255255","heartbeat_front_addr":"172.21.15.156:6813/401255255","state":["exists","up"]},{"osd":2,"uuid":"cc62ac33-467a-409d-a4b5-68ae20b09b7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":2411302291},{"type":"v1","addr":"172.21.15.156:6801","nonce":2411302291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":2411302291},{"type":"v1","addr":"172.21.15.156:6803","nonce":2411302291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":2411302291},{"type":"v1","addr":"172.21.15.156:6807","nonce":2411302291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":2411302291},{"type":"v1","addr":"172.21.15.156:6805","nonce":2411302291}]},"public_addr":"172.21.15.156:6801/2411302291","cluster_addr":"172.21.15.156:6803/2411302291","heartbeat_back_addr":"172.21.15.156:6807/2411302291","heartbeat_front_addr":"172.21.15.156:6805/2411302291","state":["exists","up"]},{"osd":3,"uuid":"3f8b7c67-b8a4-49a0-97e7-b560379e18f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":874376308},{"type":"v1","addr":"172.21.15.156:6818","nonce":874376308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":874376308},{"type":"v1","addr":"172.21.15.156:6822","nonce":874376308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6827","nonce":874376308},{"type":"v1","addr":"172.21.15.156:6829","nonce":874376308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":874376308},{"type":"v1","addr":"172.21.15.156:6825","nonce":874376308}]},"public_addr":"172.21.15.156:6818/874376308","cluster_addr":"172.21.15.156:6822/874376308","heartbeat_back_addr":"172.21.15.156:6829/874376308","heartbeat_front_addr":"172.21.15.156:6825/874376308","state":["exists","up"]},{"osd":4,"uuid":"ebbafda7-b361-457a-81ce-190a4c48704a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":1552589339},{"type":"v1","addr":"172.21.15.186:6801","nonce":1552589339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":1552589339},{"type":"v1","addr":"172.21.15.186:6803","nonce":1552589339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":1552589339},{"type":"v1","addr":"172.21.15.186:6807","nonce":1552589339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":1552589339},{"type":"v1","addr":"172.21.15.186:6805","nonce":1552589339}]},"public_addr":"172.21.15.186:6801/1552589339","cluster_addr":"172.21.15.186:6803/1552589339","heartbeat_back_addr":"172.21.15.186:6807/1552589339","heartbeat_front_addr":"172.21.15.186:6805/1552589339","state":["exists","up"]},{"osd":5,"uuid":"62efa38c-9940-4750-bd5e-b9d95389ff93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":64489016},{"type":"v1","addr":"172.21.15.186:6809","nonce":64489016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":64489016},{"type":"v1","addr":"172.21.15.186:6811","nonce":64489016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6815","nonce":64489016},{"type":"v1","addr":"172.21.15.186:6817","nonce":64489016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":64489016},{"type":"v1","addr":"172.21.15.186:6813","nonce":64489016}]},"public_addr":"172.21.15.186:6809/64489016","cluster_addr":"172.21.15.186:6811/64489016","heartbeat_back_addr":"172.21.15.186:6817/64489016","heartbeat_front_addr":"172.21.15.186:6813/64489016","state":["exists","up"]},{"osd":6,"uuid":"a33f3dde-6b0c-447d-a353-8d27075ce756","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":3687416482},{"type":"v1","addr":"172.21.15.186:6825","nonce":3687416482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":3687416482},{"type":"v1","addr":"172.21.15.186:6827","nonce":3687416482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":3687416482},{"type":"v1","addr":"172.21.15.186:6831","nonce":3687416482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":3687416482},{"type":"v1","addr":"172.21.15.186:6829","nonce":3687416482}]},"public_addr":"172.21.15.186:6825/3687416482","cluster_addr":"172.21.15.186:6827/3687416482","heartbeat_back_addr":"172.21.15.186:6831/3687416482","heartbeat_front_addr":"172.21.15.186:6829/3687416482","state":["exists","up"]},{"osd":7,"uuid":"73e867a0-947d-4217-9bf4-03a5899d5292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":3647940145},{"type":"v1","addr":"172.21.15.186:6816","nonce":3647940145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":3647940145},{"type":"v1","addr":"172.21.15.186:6819","nonce":3647940145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":3647940145},{"type":"v1","addr":"172.21.15.186:6823","nonce":3647940145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":3647940145},{"type":"v1","addr":"172.21.15.186:6821","nonce":3647940145}]},"public_addr":"172.21.15.186:6816/3647940145","cluster_addr":"172.21.15.186:6819/3647940145","heartbeat_back_addr":"172.21.15.186:6823/3647940145","heartbeat_front_addr":"172.21.15.186:6821/3647940145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-02T09:27:20.736513+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-02T09:27:20.660586+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-02T09:27:20.564745+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-02T09:27:20.699657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-02T09:27:20.662760+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-02T09:27:20.724151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-02T09:27:20.695045+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-02T09:27:20.624797+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-02T09:27:26.420 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-11-02T09:27:26.420 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-02T09:27:26.712 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:27:26.713 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":15,"fsid":"e3a6132b-4ab5-4c55-b185-291b38e09c41","created":"2023-11-02T09:27:13.149641+0000","modified":"2023-11-02T09:27:25.730053+0000","last_up_change":"2023-11-02T09:27:23.726949+0000","last_in_change":"2023-11-02T09:27:15.520071+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-02T09:27:24.203409+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-02T09:27:25.381094+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"147759cf-dd66-4c03-ad74-6a0334f27fc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6817","nonce":1501862808},{"type":"v1","addr":"172.21.15.156:6819","nonce":1501862808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6821","nonce":1501862808},{"type":"v1","addr":"172.21.15.156:6823","nonce":1501862808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":1501862808},{"type":"v1","addr":"172.21.15.156:6831","nonce":1501862808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":1501862808},{"type":"v1","addr":"172.21.15.156:6828","nonce":1501862808}]},"public_addr":"172.21.15.156:6819/1501862808","cluster_addr":"172.21.15.156:6823/1501862808","heartbeat_back_addr":"172.21.15.156:6831/1501862808","heartbeat_front_addr":"172.21.15.156:6828/1501862808","state":["exists","up"]},{"osd":1,"uuid":"24f6689d-df06-4f42-ae80-27b5320f90ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":401255255},{"type":"v1","addr":"172.21.15.156:6809","nonce":401255255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":401255255},{"type":"v1","addr":"172.21.15.156:6811","nonce":401255255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":401255255},{"type":"v1","addr":"172.21.15.156:6815","nonce":401255255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":401255255},{"type":"v1","addr":"172.21.15.156:6813","nonce":401255255}]},"public_addr":"172.21.15.156:6809/401255255","cluster_addr":"172.21.15.156:6811/401255255","heartbeat_back_addr":"172.21.15.156:6815/401255255","heartbeat_front_addr":"172.21.15.156:6813/401255255","state":["exists","up"]},{"osd":2,"uuid":"cc62ac33-467a-409d-a4b5-68ae20b09b7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":2411302291},{"type":"v1","addr":"172.21.15.156:6801","nonce":2411302291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":2411302291},{"type":"v1","addr":"172.21.15.156:6803","nonce":2411302291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":2411302291},{"type":"v1","addr":"172.21.15.156:6807","nonce":2411302291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":2411302291},{"type":"v1","addr":"172.21.15.156:6805","nonce":2411302291}]},"public_addr":"172.21.15.156:6801/2411302291","cluster_addr":"172.21.15.156:6803/2411302291","heartbeat_back_addr":"172.21.15.156:6807/2411302291","heartbeat_front_addr":"172.21.15.156:6805/2411302291","state":["exists","up"]},{"osd":3,"uuid":"3f8b7c67-b8a4-49a0-97e7-b560379e18f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":874376308},{"type":"v1","addr":"172.21.15.156:6818","nonce":874376308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":874376308},{"type":"v1","addr":"172.21.15.156:6822","nonce":874376308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6827","nonce":874376308},{"type":"v1","addr":"172.21.15.156:6829","nonce":874376308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":874376308},{"type":"v1","addr":"172.21.15.156:6825","nonce":874376308}]},"public_addr":"172.21.15.156:6818/874376308","cluster_addr":"172.21.15.156:6822/874376308","heartbeat_back_addr":"172.21.15.156:6829/874376308","heartbeat_front_addr":"172.21.15.156:6825/874376308","state":["exists","up"]},{"osd":4,"uuid":"ebbafda7-b361-457a-81ce-190a4c48704a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":1552589339},{"type":"v1","addr":"172.21.15.186:6801","nonce":1552589339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":1552589339},{"type":"v1","addr":"172.21.15.186:6803","nonce":1552589339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":1552589339},{"type":"v1","addr":"172.21.15.186:6807","nonce":1552589339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":1552589339},{"type":"v1","addr":"172.21.15.186:6805","nonce":1552589339}]},"public_addr":"172.21.15.186:6801/1552589339","cluster_addr":"172.21.15.186:6803/1552589339","heartbeat_back_addr":"172.21.15.186:6807/1552589339","heartbeat_front_addr":"172.21.15.186:6805/1552589339","state":["exists","up"]},{"osd":5,"uuid":"62efa38c-9940-4750-bd5e-b9d95389ff93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":64489016},{"type":"v1","addr":"172.21.15.186:6809","nonce":64489016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":64489016},{"type":"v1","addr":"172.21.15.186:6811","nonce":64489016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6815","nonce":64489016},{"type":"v1","addr":"172.21.15.186:6817","nonce":64489016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":64489016},{"type":"v1","addr":"172.21.15.186:6813","nonce":64489016}]},"public_addr":"172.21.15.186:6809/64489016","cluster_addr":"172.21.15.186:6811/64489016","heartbeat_back_addr":"172.21.15.186:6817/64489016","heartbeat_front_addr":"172.21.15.186:6813/64489016","state":["exists","up"]},{"osd":6,"uuid":"a33f3dde-6b0c-447d-a353-8d27075ce756","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":3687416482},{"type":"v1","addr":"172.21.15.186:6825","nonce":3687416482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":3687416482},{"type":"v1","addr":"172.21.15.186:6827","nonce":3687416482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":3687416482},{"type":"v1","addr":"172.21.15.186:6831","nonce":3687416482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":3687416482},{"type":"v1","addr":"172.21.15.186:6829","nonce":3687416482}]},"public_addr":"172.21.15.186:6825/3687416482","cluster_addr":"172.21.15.186:6827/3687416482","heartbeat_back_addr":"172.21.15.186:6831/3687416482","heartbeat_front_addr":"172.21.15.186:6829/3687416482","state":["exists","up"]},{"osd":7,"uuid":"73e867a0-947d-4217-9bf4-03a5899d5292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":3647940145},{"type":"v1","addr":"172.21.15.186:6816","nonce":3647940145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":3647940145},{"type":"v1","addr":"172.21.15.186:6819","nonce":3647940145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":3647940145},{"type":"v1","addr":"172.21.15.186:6823","nonce":3647940145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":3647940145},{"type":"v1","addr":"172.21.15.186:6821","nonce":3647940145}]},"public_addr":"172.21.15.186:6816/3647940145","cluster_addr":"172.21.15.186:6819/3647940145","heartbeat_back_addr":"172.21.15.186:6823/3647940145","heartbeat_front_addr":"172.21.15.186:6821/3647940145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-02T09:27:20.736513+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-02T09:27:20.660586+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-02T09:27:20.564745+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-02T09:27:20.699657+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-02T09:27:20.662760+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-02T09:27:20.724151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-02T09:27:20.695045+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-02T09:27:20.624797+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-02T09:27:26.725 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-11-02T09:27:26.726 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-11-02T09:27:26.726 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-11-02T09:27:26.727 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-11-02T09:27:26.727 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-11-02T09:27:26.728 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-11-02T09:27:26.729 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-11-02T09:27:26.729 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-11-02T09:27:26.993 INFO:teuthology.orchestra.run.smithi156.stdout:55834574851 2023-11-02T09:27:26.994 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-02T09:27:26.995 INFO:teuthology.orchestra.run.smithi156.stdout:55834574851 2023-11-02T09:27:26.996 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-02T09:27:26.998 INFO:teuthology.orchestra.run.smithi156.stdout:55834574852 2023-11-02T09:27:26.998 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-02T09:27:27.007 INFO:teuthology.orchestra.run.smithi156.stdout:55834574851 2023-11-02T09:27:27.007 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-02T09:27:27.009 INFO:teuthology.orchestra.run.smithi156.stdout:55834574850 2023-11-02T09:27:27.009 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-02T09:27:27.027 INFO:teuthology.orchestra.run.smithi156.stdout:55834574851 2023-11-02T09:27:27.027 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-02T09:27:27.029 INFO:teuthology.orchestra.run.smithi156.stdout:55834574852 2023-11-02T09:27:27.030 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-02T09:27:27.196 INFO:teuthology.orchestra.run.smithi156.stdout:55834574851 2023-11-02T09:27:27.197 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-02T09:27:27.556 INFO:teuthology.orchestra.run.smithi156.stdout:55834574850 2023-11-02T09:27:27.580 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.1 2023-11-02T09:27:27.589 INFO:teuthology.orchestra.run.smithi156.stdout:55834574850 2023-11-02T09:27:27.609 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.2 2023-11-02T09:27:27.627 INFO:teuthology.orchestra.run.smithi156.stdout:55834574851 2023-11-02T09:27:27.642 INFO:teuthology.orchestra.run.smithi156.stdout:55834574850 2023-11-02T09:27:27.646 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.4 2023-11-02T09:27:27.661 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.6 2023-11-02T09:27:27.661 INFO:teuthology.orchestra.run.smithi156.stdout:55834574850 2023-11-02T09:27:27.663 INFO:teuthology.orchestra.run.smithi156.stdout:55834574849 2023-11-02T09:27:27.675 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.5 2023-11-02T09:27:27.676 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574850 got 55834574849 for osd.7 2023-11-02T09:27:27.700 INFO:teuthology.orchestra.run.smithi156.stdout:55834574851 2023-11-02T09:27:27.713 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.3 2023-11-02T09:27:27.754 INFO:teuthology.orchestra.run.smithi156.stdout:55834574850 2023-11-02T09:27:27.767 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.0 2023-11-02T09:27:28.581 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-02T09:27:28.611 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-02T09:27:28.646 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-02T09:27:28.662 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-02T09:27:28.676 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-02T09:27:28.677 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-02T09:27:28.714 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-02T09:27:28.768 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-02T09:27:29.066 INFO:teuthology.orchestra.run.smithi156.stdout:55834574851 2023-11-02T09:27:29.091 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574851 for osd.1 2023-11-02T09:27:29.091 DEBUG:teuthology.parallel:result is None 2023-11-02T09:27:29.126 INFO:teuthology.orchestra.run.smithi156.stdout:55834574851 2023-11-02T09:27:29.139 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574851 for osd.2 2023-11-02T09:27:29.139 DEBUG:teuthology.parallel:result is None 2023-11-02T09:27:29.221 INFO:teuthology.orchestra.run.smithi156.stdout:55834574851 2023-11-02T09:27:29.225 INFO:teuthology.orchestra.run.smithi156.stdout:55834574852 2023-11-02T09:27:29.238 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574851 for osd.6 2023-11-02T09:27:29.238 DEBUG:teuthology.parallel:result is None 2023-11-02T09:27:29.242 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.4 2023-11-02T09:27:29.242 DEBUG:teuthology.parallel:result is None 2023-11-02T09:27:29.285 INFO:teuthology.orchestra.run.smithi156.stdout:55834574851 2023-11-02T09:27:29.295 INFO:teuthology.orchestra.run.smithi156.stdout:55834574850 2023-11-02T09:27:29.302 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574851 for osd.5 2023-11-02T09:27:29.302 DEBUG:teuthology.parallel:result is None 2023-11-02T09:27:29.308 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574850 got 55834574850 for osd.7 2023-11-02T09:27:29.308 DEBUG:teuthology.parallel:result is None 2023-11-02T09:27:29.312 INFO:teuthology.orchestra.run.smithi156.stdout:55834574852 2023-11-02T09:27:29.325 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.3 2023-11-02T09:27:29.325 DEBUG:teuthology.parallel:result is None 2023-11-02T09:27:29.338 INFO:teuthology.orchestra.run.smithi156.stdout:55834574851 2023-11-02T09:27:29.351 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574851 for osd.0 2023-11-02T09:27:29.351 DEBUG:teuthology.parallel:result is None 2023-11-02T09:27:29.352 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-02T09:27:29.352 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-02T09:27:29.682 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:27:29.683 INFO:teuthology.orchestra.run.smithi156.stderr:dumped all 2023-11-02T09:27:29.694 INFO:teuthology.orchestra.run.smithi156.stdout:{"pg_ready":true,"pg_map":{"version":13,"stamp":"2023-11-02T09:27:29.338871+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":99,"num_write_kb":1110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":64,"ondisk_log_size":64,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":233936,"kb_used_data":1120,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754740784,"statfs":{"total":773094113280,"available":772854562816,"internally_reserved":0,"allocated":1146880,"data_stored":327864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238276152},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000391"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-11-02T09:27:25.750162+0000","last_change":"2023-11-02T09:27:25.746697+0000","last_active":"2023-11-02T09:27:25.750162+0000","last_peered":"2023-11-02T09:27:25.750162+0000","last_clean":"2023-11-02T09:27:25.750162+0000","last_became_active":"2023-11-02T09:27:25.746437+0000","last_became_peered":"2023-11-02T09:27:25.746437+0000","last_unstale":"2023-11-02T09:27:25.750162+0000","last_undegraded":"2023-11-02T09:27:25.750162+0000","last_fullsized":"2023-11-02T09:27:25.750162+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-02T09:27:24.728265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-02T09:27:24.728265+0000","last_clean_scrub_stamp":"2023-11-02T09:27:24.728265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-03T16:09:54.939429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-11-02T09:27:26.007206+0000","last_change":"2023-11-02T09:27:26.006594+0000","last_active":"2023-11-02T09:27:26.007206+0000","last_peered":"2023-11-02T09:27:26.007206+0000","last_clean":"2023-11-02T09:27:26.007206+0000","last_became_active":"2023-11-02T09:27:26.006302+0000","last_became_peered":"2023-11-02T09:27:26.006302+0000","last_unstale":"2023-11-02T09:27:26.007206+0000","last_undegraded":"2023-11-02T09:27:26.007206+0000","last_fullsized":"2023-11-02T09:27:26.007206+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-02T09:27:24.728265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-02T09:27:24.728265+0000","last_clean_scrub_stamp":"2023-11-02T09:27:24.728265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-03T15:03:09.786076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-11-02T09:27:26.743256+0000","last_change":"2023-11-02T09:27:26.006517+0000","last_active":"2023-11-02T09:27:26.743256+0000","last_peered":"2023-11-02T09:27:26.743256+0000","last_clean":"2023-11-02T09:27:26.743256+0000","last_became_active":"2023-11-02T09:27:26.006207+0000","last_became_peered":"2023-11-02T09:27:26.006207+0000","last_unstale":"2023-11-02T09:27:26.743256+0000","last_undegraded":"2023-11-02T09:27:26.743256+0000","last_fullsized":"2023-11-02T09:27:26.743256+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-02T09:27:24.728265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-02T09:27:24.728265+0000","last_clean_scrub_stamp":"2023-11-02T09:27:24.728265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-03T15:03:09.786076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-11-02T09:27:25.748301+0000","last_change":"2023-11-02T09:27:25.747793+0000","last_active":"2023-11-02T09:27:25.748301+0000","last_peered":"2023-11-02T09:27:25.748301+0000","last_clean":"2023-11-02T09:27:25.748301+0000","last_became_active":"2023-11-02T09:27:25.747506+0000","last_became_peered":"2023-11-02T09:27:25.747506+0000","last_unstale":"2023-11-02T09:27:25.748301+0000","last_undegraded":"2023-11-02T09:27:25.748301+0000","last_fullsized":"2023-11-02T09:27:25.748301+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-02T09:27:24.728265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-02T09:27:24.728265+0000","last_clean_scrub_stamp":"2023-11-02T09:27:24.728265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-03T12:43:38.587945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"16'64","reported_seq":97,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-11-02T09:27:26.946977+0000","last_change":"2023-11-02T09:27:26.751832+0000","last_active":"2023-11-02T09:27:26.946977+0000","last_peered":"2023-11-02T09:27:26.946977+0000","last_clean":"2023-11-02T09:27:26.946977+0000","last_became_active":"2023-11-02T09:27:26.751551+0000","last_became_peered":"2023-11-02T09:27:26.751551+0000","last_unstale":"2023-11-02T09:27:26.946977+0000","last_undegraded":"2023-11-02T09:27:26.946977+0000","last_fullsized":"2023-11-02T09:27:26.946977+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-02T09:27:25.730053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-02T09:27:25.730053+0000","last_clean_scrub_stamp":"2023-11-02T09:27:25.730053+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-03T16:34:26.700852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":99,"num_write_kb":1110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-11-02T09:27:26.743440+0000","last_change":"2023-11-02T09:27:25.750516+0000","last_active":"2023-11-02T09:27:26.743440+0000","last_peered":"2023-11-02T09:27:26.743440+0000","last_clean":"2023-11-02T09:27:26.743440+0000","last_became_active":"2023-11-02T09:27:25.750287+0000","last_became_peered":"2023-11-02T09:27:25.750287+0000","last_unstale":"2023-11-02T09:27:26.743440+0000","last_undegraded":"2023-11-02T09:27:26.743440+0000","last_fullsized":"2023-11-02T09:27:26.743440+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-02T09:27:24.728265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-02T09:27:24.728265+0000","last_clean_scrub_stamp":"2023-11-02T09:27:24.728265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-03T15:03:09.786076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-11-02T09:27:26.748650+0000","last_change":"2023-11-02T09:27:26.006899+0000","last_active":"2023-11-02T09:27:26.748650+0000","last_peered":"2023-11-02T09:27:26.748650+0000","last_clean":"2023-11-02T09:27:26.748650+0000","last_became_active":"2023-11-02T09:27:26.006318+0000","last_became_peered":"2023-11-02T09:27:26.006318+0000","last_unstale":"2023-11-02T09:27:26.748650+0000","last_undegraded":"2023-11-02T09:27:26.748650+0000","last_fullsized":"2023-11-02T09:27:26.748650+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-02T09:27:24.728265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-02T09:27:24.728265+0000","last_clean_scrub_stamp":"2023-11-02T09:27:24.728265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-03T12:51:25.235827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-11-02T09:27:26.007283+0000","last_change":"2023-11-02T09:27:26.006563+0000","last_active":"2023-11-02T09:27:26.007283+0000","last_peered":"2023-11-02T09:27:26.007283+0000","last_clean":"2023-11-02T09:27:26.007283+0000","last_became_active":"2023-11-02T09:27:26.006272+0000","last_became_peered":"2023-11-02T09:27:26.006272+0000","last_unstale":"2023-11-02T09:27:26.007283+0000","last_undegraded":"2023-11-02T09:27:26.007283+0000","last_fullsized":"2023-11-02T09:27:26.007283+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-02T09:27:24.728265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-02T09:27:24.728265+0000","last_clean_scrub_stamp":"2023-11-02T09:27:24.728265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-03T12:43:38.587945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-11-02T09:27:26.748676+0000","last_change":"2023-11-02T09:27:26.006659+0000","last_active":"2023-11-02T09:27:26.748676+0000","last_peered":"2023-11-02T09:27:26.748676+0000","last_clean":"2023-11-02T09:27:26.748676+0000","last_became_active":"2023-11-02T09:27:26.006344+0000","last_became_peered":"2023-11-02T09:27:26.006344+0000","last_unstale":"2023-11-02T09:27:26.748676+0000","last_undegraded":"2023-11-02T09:27:26.748676+0000","last_fullsized":"2023-11-02T09:27:26.748676+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-02T09:27:24.728265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-02T09:27:24.728265+0000","last_clean_scrub_stamp":"2023-11-02T09:27:24.728265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-03T10:35:51.033373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":99,"num_write_kb":1110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":925696,"data_stored":918560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":64,"ondisk_log_size":64,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574850,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":143360,"data_stored":40983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":143360,"data_stored":40983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":143360,"data_stored":40983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":143360,"data_stored":40983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31324,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340516,"statfs":{"total":96636764160,"available":96604688384,"internally_reserved":0,"allocated":143360,"data_stored":40983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31324,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340516,"statfs":{"total":96636764160,"available":96604688384,"internally_reserved":0,"allocated":143360,"data_stored":40983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.19800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.255}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31324,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340516,"statfs":{"total":96636764160,"available":96604688384,"internally_reserved":0,"allocated":143360,"data_stored":40983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31324,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340516,"statfs":{"total":96636764160,"available":96604688384,"internally_reserved":0,"allocated":143360,"data_stored":40983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-02T09:27:29.696 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-02T09:27:29.985 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:27:29.985 INFO:teuthology.orchestra.run.smithi156.stderr:dumped all 2023-11-02T09:27:29.996 INFO:teuthology.orchestra.run.smithi156.stdout:{"pg_ready":true,"pg_map":{"version":13,"stamp":"2023-11-02T09:27:29.338871+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":99,"num_write_kb":1110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":64,"ondisk_log_size":64,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":233936,"kb_used_data":1120,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754740784,"statfs":{"total":773094113280,"available":772854562816,"internally_reserved":0,"allocated":1146880,"data_stored":327864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238276152},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000391"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-11-02T09:27:25.750162+0000","last_change":"2023-11-02T09:27:25.746697+0000","last_active":"2023-11-02T09:27:25.750162+0000","last_peered":"2023-11-02T09:27:25.750162+0000","last_clean":"2023-11-02T09:27:25.750162+0000","last_became_active":"2023-11-02T09:27:25.746437+0000","last_became_peered":"2023-11-02T09:27:25.746437+0000","last_unstale":"2023-11-02T09:27:25.750162+0000","last_undegraded":"2023-11-02T09:27:25.750162+0000","last_fullsized":"2023-11-02T09:27:25.750162+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-02T09:27:24.728265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-02T09:27:24.728265+0000","last_clean_scrub_stamp":"2023-11-02T09:27:24.728265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-03T16:09:54.939429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-11-02T09:27:26.007206+0000","last_change":"2023-11-02T09:27:26.006594+0000","last_active":"2023-11-02T09:27:26.007206+0000","last_peered":"2023-11-02T09:27:26.007206+0000","last_clean":"2023-11-02T09:27:26.007206+0000","last_became_active":"2023-11-02T09:27:26.006302+0000","last_became_peered":"2023-11-02T09:27:26.006302+0000","last_unstale":"2023-11-02T09:27:26.007206+0000","last_undegraded":"2023-11-02T09:27:26.007206+0000","last_fullsized":"2023-11-02T09:27:26.007206+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-02T09:27:24.728265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-02T09:27:24.728265+0000","last_clean_scrub_stamp":"2023-11-02T09:27:24.728265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-03T15:03:09.786076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-11-02T09:27:26.743256+0000","last_change":"2023-11-02T09:27:26.006517+0000","last_active":"2023-11-02T09:27:26.743256+0000","last_peered":"2023-11-02T09:27:26.743256+0000","last_clean":"2023-11-02T09:27:26.743256+0000","last_became_active":"2023-11-02T09:27:26.006207+0000","last_became_peered":"2023-11-02T09:27:26.006207+0000","last_unstale":"2023-11-02T09:27:26.743256+0000","last_undegraded":"2023-11-02T09:27:26.743256+0000","last_fullsized":"2023-11-02T09:27:26.743256+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-02T09:27:24.728265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-02T09:27:24.728265+0000","last_clean_scrub_stamp":"2023-11-02T09:27:24.728265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-03T15:03:09.786076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-11-02T09:27:25.748301+0000","last_change":"2023-11-02T09:27:25.747793+0000","last_active":"2023-11-02T09:27:25.748301+0000","last_peered":"2023-11-02T09:27:25.748301+0000","last_clean":"2023-11-02T09:27:25.748301+0000","last_became_active":"2023-11-02T09:27:25.747506+0000","last_became_peered":"2023-11-02T09:27:25.747506+0000","last_unstale":"2023-11-02T09:27:25.748301+0000","last_undegraded":"2023-11-02T09:27:25.748301+0000","last_fullsized":"2023-11-02T09:27:25.748301+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-02T09:27:24.728265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-02T09:27:24.728265+0000","last_clean_scrub_stamp":"2023-11-02T09:27:24.728265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-03T12:43:38.587945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"16'64","reported_seq":97,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-11-02T09:27:26.946977+0000","last_change":"2023-11-02T09:27:26.751832+0000","last_active":"2023-11-02T09:27:26.946977+0000","last_peered":"2023-11-02T09:27:26.946977+0000","last_clean":"2023-11-02T09:27:26.946977+0000","last_became_active":"2023-11-02T09:27:26.751551+0000","last_became_peered":"2023-11-02T09:27:26.751551+0000","last_unstale":"2023-11-02T09:27:26.946977+0000","last_undegraded":"2023-11-02T09:27:26.946977+0000","last_fullsized":"2023-11-02T09:27:26.946977+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-02T09:27:25.730053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-02T09:27:25.730053+0000","last_clean_scrub_stamp":"2023-11-02T09:27:25.730053+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-03T16:34:26.700852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":99,"num_write_kb":1110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-11-02T09:27:26.743440+0000","last_change":"2023-11-02T09:27:25.750516+0000","last_active":"2023-11-02T09:27:26.743440+0000","last_peered":"2023-11-02T09:27:26.743440+0000","last_clean":"2023-11-02T09:27:26.743440+0000","last_became_active":"2023-11-02T09:27:25.750287+0000","last_became_peered":"2023-11-02T09:27:25.750287+0000","last_unstale":"2023-11-02T09:27:26.743440+0000","last_undegraded":"2023-11-02T09:27:26.743440+0000","last_fullsized":"2023-11-02T09:27:26.743440+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-02T09:27:24.728265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-02T09:27:24.728265+0000","last_clean_scrub_stamp":"2023-11-02T09:27:24.728265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-03T15:03:09.786076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-11-02T09:27:26.748650+0000","last_change":"2023-11-02T09:27:26.006899+0000","last_active":"2023-11-02T09:27:26.748650+0000","last_peered":"2023-11-02T09:27:26.748650+0000","last_clean":"2023-11-02T09:27:26.748650+0000","last_became_active":"2023-11-02T09:27:26.006318+0000","last_became_peered":"2023-11-02T09:27:26.006318+0000","last_unstale":"2023-11-02T09:27:26.748650+0000","last_undegraded":"2023-11-02T09:27:26.748650+0000","last_fullsized":"2023-11-02T09:27:26.748650+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-02T09:27:24.728265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-02T09:27:24.728265+0000","last_clean_scrub_stamp":"2023-11-02T09:27:24.728265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-03T12:51:25.235827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-11-02T09:27:26.007283+0000","last_change":"2023-11-02T09:27:26.006563+0000","last_active":"2023-11-02T09:27:26.007283+0000","last_peered":"2023-11-02T09:27:26.007283+0000","last_clean":"2023-11-02T09:27:26.007283+0000","last_became_active":"2023-11-02T09:27:26.006272+0000","last_became_peered":"2023-11-02T09:27:26.006272+0000","last_unstale":"2023-11-02T09:27:26.007283+0000","last_undegraded":"2023-11-02T09:27:26.007283+0000","last_fullsized":"2023-11-02T09:27:26.007283+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-02T09:27:24.728265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-02T09:27:24.728265+0000","last_clean_scrub_stamp":"2023-11-02T09:27:24.728265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-03T12:43:38.587945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-11-02T09:27:26.748676+0000","last_change":"2023-11-02T09:27:26.006659+0000","last_active":"2023-11-02T09:27:26.748676+0000","last_peered":"2023-11-02T09:27:26.748676+0000","last_clean":"2023-11-02T09:27:26.748676+0000","last_became_active":"2023-11-02T09:27:26.006344+0000","last_became_peered":"2023-11-02T09:27:26.006344+0000","last_unstale":"2023-11-02T09:27:26.748676+0000","last_undegraded":"2023-11-02T09:27:26.748676+0000","last_fullsized":"2023-11-02T09:27:26.748676+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-02T09:27:24.728265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-02T09:27:24.728265+0000","last_clean_scrub_stamp":"2023-11-02T09:27:24.728265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-03T10:35:51.033373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":99,"num_write_kb":1110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":925696,"data_stored":918560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":64,"ondisk_log_size":64,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574850,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":143360,"data_stored":40983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":143360,"data_stored":40983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":143360,"data_stored":40983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":143360,"data_stored":40983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31324,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340516,"statfs":{"total":96636764160,"available":96604688384,"internally_reserved":0,"allocated":143360,"data_stored":40983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31324,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340516,"statfs":{"total":96636764160,"available":96604688384,"internally_reserved":0,"allocated":143360,"data_stored":40983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.19800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.255}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31324,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340516,"statfs":{"total":96636764160,"available":96604688384,"internally_reserved":0,"allocated":143360,"data_stored":40983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31324,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340516,"statfs":{"total":96636764160,"available":96604688384,"internally_reserved":0,"allocated":143360,"data_stored":40983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-02T09:27:29.998 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-02T09:27:29.998 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-11-02T09:27:29.998 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-11-02T09:27:29.999 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-02T09:27:30.320 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:27:30.321 INFO:teuthology.orchestra.run.smithi156.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-11-02T09:27:30.333 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-11-02T09:27:30.334 INFO:teuthology.run_tasks:Running task openssl_keys... 2023-11-02T09:27:30.358 INFO:teuthology.run_tasks:Running task rgw... 2023-11-02T09:27:30.430 DEBUG:tasks.rgw:config is {'client.0': None} 2023-11-02T09:27:30.431 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2023-11-02T09:27:30.431 INFO:tasks.rgw:Creating data pools 2023-11-02T09:27:30.431 DEBUG:tasks.rgw:Obtaining remote for client client.0 2023-11-02T09:27:30.432 DEBUG:teuthology.orchestra.run.smithi156:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster ceph 2023-11-02T09:27:30.762 INFO:teuthology.orchestra.run.smithi156.stderr:pool 'default.rgw.buckets.data' created 2023-11-02T09:27:30.781 DEBUG:teuthology.orchestra.run.smithi156:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2023-11-02T09:27:31.763 INFO:teuthology.orchestra.run.smithi156.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2023-11-02T09:27:31.796 DEBUG:teuthology.orchestra.run.smithi156:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2023-11-02T09:27:32.765 INFO:teuthology.orchestra.run.smithi156.stderr:pool 'default.rgw.buckets.index' created 2023-11-02T09:27:32.787 DEBUG:teuthology.orchestra.run.smithi156:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2023-11-02T09:27:33.771 INFO:teuthology.orchestra.run.smithi156.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2023-11-02T09:27:33.801 DEBUG:tasks.rgw:Pools created 2023-11-02T09:27:33.802 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2023-11-02T09:27:33.802 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2023-11-02T09:27:33.803 DEBUG:teuthology.orchestra.run.smithi156:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2023-11-02T09:27:33.977 INFO:teuthology.orchestra.run.smithi156.stderr:ignoring --setuser ceph since I am not root 2023-11-02T09:27:33.978 INFO:teuthology.orchestra.run.smithi156.stderr:ignoring --setgroup ceph since I am not root 2023-11-02T09:27:33.988 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:33.985+0000 7f872f2c0880 20 rados->read ofs=0 len=0 2023-11-02T09:27:35.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:35.782+0000 7f872f2c0880 20 rados_obj.operate() r=-2 bl.length=0 2023-11-02T09:27:35.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:35.782+0000 7f872f2c0880 20 realm 2023-11-02T09:27:35.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:35.782+0000 7f872f2c0880 20 rados->read ofs=0 len=0 2023-11-02T09:27:35.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:35.784+0000 7f872f2c0880 20 rados_obj.operate() r=-2 bl.length=0 2023-11-02T09:27:35.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:35.784+0000 7f872f2c0880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-11-02T09:27:35.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:35.784+0000 7f872f2c0880 20 rados->read ofs=0 len=0 2023-11-02T09:27:35.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:35.784+0000 7f872f2c0880 20 rados_obj.operate() r=-2 bl.length=0 2023-11-02T09:27:35.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:35.784+0000 7f872f2c0880 20 rados->read ofs=0 len=0 2023-11-02T09:27:35.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:35.787+0000 7f872f2c0880 20 rados_obj.operate() r=-2 bl.length=0 2023-11-02T09:27:35.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:35.787+0000 7f872f2c0880 20 rados->read ofs=0 len=0 2023-11-02T09:27:35.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:35.787+0000 7f872f2c0880 20 rados_obj.operate() r=-2 bl.length=0 2023-11-02T09:27:35.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:35.787+0000 7f872f2c0880 20 rados->read ofs=0 len=0 2023-11-02T09:27:35.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:35.787+0000 7f872f2c0880 20 rados_obj.operate() r=-2 bl.length=0 2023-11-02T09:27:35.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:35.787+0000 7f872f2c0880 10 Creating default zonegroup 2023-11-02T09:27:35.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:35.788+0000 7f872f2c0880 10 couldn't find old data placement pools config, setting up new ones for the zone 2023-11-02T09:27:35.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:35.800+0000 7f872f2c0880 10 WARNING: driver->list_zones() returned r=-2 2023-11-02T09:27:35.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:35.800+0000 7f872f2c0880 20 rados->read ofs=0 len=0 2023-11-02T09:27:35.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:35.801+0000 7f872f2c0880 20 rados_obj.operate() r=-2 bl.length=0 2023-11-02T09:27:35.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:35.804+0000 7f872f2c0880 20 rados->read ofs=0 len=0 2023-11-02T09:27:35.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:35.804+0000 7f872f2c0880 20 rados_obj.operate() r=-2 bl.length=0 2023-11-02T09:27:35.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:35.804+0000 7f872f2c0880 10 could not read realm id: (2) No such file or directory 2023-11-02T09:27:35.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:35.804+0000 7f872f2c0880 10 WARNING: failed to set zone as default, r=-22 2023-11-02T09:27:35.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:35.804+0000 7f872f2c0880 20 rados->read ofs=0 len=0 2023-11-02T09:27:35.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:35.805+0000 7f872f2c0880 20 rados_obj.operate() r=-2 bl.length=0 2023-11-02T09:27:35.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:35.808+0000 7f872f2c0880 20 rados->read ofs=0 len=0 2023-11-02T09:27:35.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:35.809+0000 7f872f2c0880 20 rados_obj.operate() r=0 bl.length=874 2023-11-02T09:27:35.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:35.809+0000 7f872f2c0880 20 rados->read ofs=0 len=0 2023-11-02T09:27:35.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:35.810+0000 7f872f2c0880 20 rados_obj.operate() r=0 bl.length=420 2023-11-02T09:27:35.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:35.810+0000 7f872f2c0880 10 Using default name default 2023-11-02T09:27:35.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:35.810+0000 7f872f2c0880 20 rados->read ofs=0 len=0 2023-11-02T09:27:35.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:35.810+0000 7f872f2c0880 20 rados_obj.operate() r=0 bl.length=46 2023-11-02T09:27:35.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:35.810+0000 7f872f2c0880 20 rados->read ofs=0 len=0 2023-11-02T09:27:35.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:35.811+0000 7f872f2c0880 20 rados_obj.operate() r=0 bl.length=874 2023-11-02T09:27:35.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:35.811+0000 7f872f2c0880 20 zone default found 2023-11-02T09:27:35.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:35.811+0000 7f872f2c0880 4 Realm: () 2023-11-02T09:27:35.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:35.811+0000 7f872f2c0880 4 ZoneGroup: default (fc2743cf-89e8-403c-8ea6-8171440e8b91) 2023-11-02T09:27:35.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:35.811+0000 7f872f2c0880 4 Zone: default (8100026f-34ce-4e78-9bac-c57f344b7c64) 2023-11-02T09:27:35.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:35.811+0000 7f872f2c0880 10 cannot find current period zonegroup using local zonegroup configuration 2023-11-02T09:27:35.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:35.811+0000 7f872f2c0880 20 zonegroup default 2023-11-02T09:27:35.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:35.811+0000 7f872f2c0880 20 rados->read ofs=0 len=0 2023-11-02T09:27:35.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:35.811+0000 7f872f2c0880 20 rados_obj.operate() r=-2 bl.length=0 2023-11-02T09:27:35.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:35.811+0000 7f872f2c0880 20 rados->read ofs=0 len=0 2023-11-02T09:27:37.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:37.782+0000 7f872f2c0880 20 rados_obj.operate() r=-2 bl.length=0 2023-11-02T09:27:37.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:37.782+0000 7f872f2c0880 20 rados->read ofs=0 len=0 2023-11-02T09:27:37.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:37.783+0000 7f872f2c0880 20 rados_obj.operate() r=-2 bl.length=0 2023-11-02T09:27:37.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:37.783+0000 7f872f2c0880 20 started sync module instance, tier type = 2023-11-02T09:27:37.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:37.783+0000 7f872f2c0880 20 started zone id=8100026f-34ce-4e78-9bac-c57f344b7c64 (name=default) with tier type = 2023-11-02T09:27:39.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.815+0000 7f872f2c0880 20 add_watcher() i=0 2023-11-02T09:27:39.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.815+0000 7f872f2c0880 20 add_watcher() i=1 2023-11-02T09:27:39.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.815+0000 7f872f2c0880 20 add_watcher() i=2 2023-11-02T09:27:39.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.815+0000 7f872f2c0880 20 add_watcher() i=3 2023-11-02T09:27:39.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.815+0000 7f872f2c0880 20 add_watcher() i=4 2023-11-02T09:27:39.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.815+0000 7f872f2c0880 20 add_watcher() i=5 2023-11-02T09:27:39.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.815+0000 7f872f2c0880 20 add_watcher() i=6 2023-11-02T09:27:39.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.816+0000 7f872f2c0880 20 add_watcher() i=7 2023-11-02T09:27:39.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.816+0000 7f872f2c0880 2 all 8 watchers are set, enabling cache 2023-11-02T09:27:39.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.816+0000 7f872f2c0880 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):410: oid=data_loggenerations_metadata not found 2023-11-02T09:27:39.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.816+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.0 2023-11-02T09:27:39.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.816+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.816+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.0 does not exist 2023-11-02T09:27:39.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.816+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.1 2023-11-02T09:27:39.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.816+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.817+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.1 does not exist 2023-11-02T09:27:39.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.817+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.2 2023-11-02T09:27:39.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.817+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.817+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.2 does not exist 2023-11-02T09:27:39.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.817+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.3 2023-11-02T09:27:39.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.817+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.817+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.3 does not exist 2023-11-02T09:27:39.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.817+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.4 2023-11-02T09:27:39.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.817+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.817+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.4 does not exist 2023-11-02T09:27:39.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.817+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.5 2023-11-02T09:27:39.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.817+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.818+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.5 does not exist 2023-11-02T09:27:39.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.818+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.6 2023-11-02T09:27:39.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.818+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.818+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.6 does not exist 2023-11-02T09:27:39.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.818+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.7 2023-11-02T09:27:39.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.818+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.818+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.7 does not exist 2023-11-02T09:27:39.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.818+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.8 2023-11-02T09:27:39.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.818+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.818+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.8 does not exist 2023-11-02T09:27:39.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.818+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.9 2023-11-02T09:27:39.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.818+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.819+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.9 does not exist 2023-11-02T09:27:39.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.819+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.10 2023-11-02T09:27:39.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.819+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.819+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.10 does not exist 2023-11-02T09:27:39.830 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.819+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.11 2023-11-02T09:27:39.830 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.819+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.830 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.819+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.11 does not exist 2023-11-02T09:27:39.830 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.819+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.12 2023-11-02T09:27:39.830 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.819+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.819+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.12 does not exist 2023-11-02T09:27:39.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.819+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.13 2023-11-02T09:27:39.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.819+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.820+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.13 does not exist 2023-11-02T09:27:39.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.820+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.14 2023-11-02T09:27:39.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.820+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.820+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.14 does not exist 2023-11-02T09:27:39.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.820+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.15 2023-11-02T09:27:39.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.820+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.821+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.15 does not exist 2023-11-02T09:27:39.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.821+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.16 2023-11-02T09:27:39.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.821+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.821+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.16 does not exist 2023-11-02T09:27:39.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.821+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.17 2023-11-02T09:27:39.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.821+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.821+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.17 does not exist 2023-11-02T09:27:39.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.821+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.18 2023-11-02T09:27:39.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.821+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.822+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.18 does not exist 2023-11-02T09:27:39.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.822+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.19 2023-11-02T09:27:39.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.822+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.822+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.19 does not exist 2023-11-02T09:27:39.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.822+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.20 2023-11-02T09:27:39.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.822+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.822+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.20 does not exist 2023-11-02T09:27:39.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.822+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.21 2023-11-02T09:27:39.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.822+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.822+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.21 does not exist 2023-11-02T09:27:39.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.822+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.22 2023-11-02T09:27:39.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.822+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.823+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.22 does not exist 2023-11-02T09:27:39.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.823+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.23 2023-11-02T09:27:39.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.823+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.823+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.23 does not exist 2023-11-02T09:27:39.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.823+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.24 2023-11-02T09:27:39.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.823+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.823+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.24 does not exist 2023-11-02T09:27:39.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.823+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.25 2023-11-02T09:27:39.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.823+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.823+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.25 does not exist 2023-11-02T09:27:39.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.823+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.26 2023-11-02T09:27:39.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.823+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.823+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.26 does not exist 2023-11-02T09:27:39.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.823+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.27 2023-11-02T09:27:39.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.823+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.824+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.27 does not exist 2023-11-02T09:27:39.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.824+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.28 2023-11-02T09:27:39.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.824+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.824+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.28 does not exist 2023-11-02T09:27:39.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.824+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.29 2023-11-02T09:27:39.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.824+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.824+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.29 does not exist 2023-11-02T09:27:39.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.824+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.30 2023-11-02T09:27:39.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.824+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.850 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.825+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.30 does not exist 2023-11-02T09:27:39.850 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.825+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.31 2023-11-02T09:27:39.850 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.825+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.850 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.825+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.31 does not exist 2023-11-02T09:27:39.850 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.825+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.32 2023-11-02T09:27:39.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.825+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.825+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.32 does not exist 2023-11-02T09:27:39.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.825+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.33 2023-11-02T09:27:39.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.825+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.825+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.33 does not exist 2023-11-02T09:27:39.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.825+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.34 2023-11-02T09:27:39.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.825+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.826+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.34 does not exist 2023-11-02T09:27:39.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.826+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.35 2023-11-02T09:27:39.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.826+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.826+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.35 does not exist 2023-11-02T09:27:39.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.826+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.36 2023-11-02T09:27:39.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.826+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.826+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.36 does not exist 2023-11-02T09:27:39.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.826+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.37 2023-11-02T09:27:39.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.826+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.827+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.37 does not exist 2023-11-02T09:27:39.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.827+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.38 2023-11-02T09:27:39.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.827+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.827+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.38 does not exist 2023-11-02T09:27:39.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.827+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.39 2023-11-02T09:27:39.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.827+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.827+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.39 does not exist 2023-11-02T09:27:39.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.827+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.40 2023-11-02T09:27:39.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.827+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.828+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.40 does not exist 2023-11-02T09:27:39.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.828+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.41 2023-11-02T09:27:39.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.828+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.828+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.41 does not exist 2023-11-02T09:27:39.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.828+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.42 2023-11-02T09:27:39.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.828+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.828+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.42 does not exist 2023-11-02T09:27:39.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.828+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.43 2023-11-02T09:27:39.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.828+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.828+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.43 does not exist 2023-11-02T09:27:39.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.828+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.44 2023-11-02T09:27:39.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.828+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.829+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.44 does not exist 2023-11-02T09:27:39.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.829+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.45 2023-11-02T09:27:39.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.829+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.829+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.45 does not exist 2023-11-02T09:27:39.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.829+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.46 2023-11-02T09:27:39.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.829+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.829+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.46 does not exist 2023-11-02T09:27:39.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.829+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.47 2023-11-02T09:27:39.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.829+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.829+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.47 does not exist 2023-11-02T09:27:39.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.829+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.48 2023-11-02T09:27:39.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.829+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.830+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.48 does not exist 2023-11-02T09:27:39.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.830+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.49 2023-11-02T09:27:39.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.830+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.830+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.49 does not exist 2023-11-02T09:27:39.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.830+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.50 2023-11-02T09:27:39.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.830+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.830+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.50 does not exist 2023-11-02T09:27:39.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.830+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.51 2023-11-02T09:27:39.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.830+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.830+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.51 does not exist 2023-11-02T09:27:39.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.830+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.52 2023-11-02T09:27:39.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.830+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.831+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.52 does not exist 2023-11-02T09:27:39.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.831+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.53 2023-11-02T09:27:39.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.831+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.831+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.53 does not exist 2023-11-02T09:27:39.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.831+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.54 2023-11-02T09:27:39.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.831+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.831+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.54 does not exist 2023-11-02T09:27:39.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.831+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.55 2023-11-02T09:27:39.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.831+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.831+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.55 does not exist 2023-11-02T09:27:39.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.831+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.56 2023-11-02T09:27:39.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.831+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.832+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.56 does not exist 2023-11-02T09:27:39.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.832+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.57 2023-11-02T09:27:39.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.832+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.832+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.57 does not exist 2023-11-02T09:27:39.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.832+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.58 2023-11-02T09:27:39.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.832+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.832+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.58 does not exist 2023-11-02T09:27:39.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.832+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.59 2023-11-02T09:27:39.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.832+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.832+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.59 does not exist 2023-11-02T09:27:39.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.832+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.60 2023-11-02T09:27:39.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.832+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.833+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.60 does not exist 2023-11-02T09:27:39.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.833+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.61 2023-11-02T09:27:39.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.833+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.833+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.61 does not exist 2023-11-02T09:27:39.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.833+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.62 2023-11-02T09:27:39.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.833+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.833+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.62 does not exist 2023-11-02T09:27:39.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.833+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.63 2023-11-02T09:27:39.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.833+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.833+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.63 does not exist 2023-11-02T09:27:39.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.833+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.64 2023-11-02T09:27:39.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.833+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.834+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.64 does not exist 2023-11-02T09:27:39.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.834+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.65 2023-11-02T09:27:39.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.834+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.834+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.65 does not exist 2023-11-02T09:27:39.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.834+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.66 2023-11-02T09:27:39.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.834+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.834+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.66 does not exist 2023-11-02T09:27:39.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.834+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.67 2023-11-02T09:27:39.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.834+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.834+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.67 does not exist 2023-11-02T09:27:39.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.834+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.68 2023-11-02T09:27:39.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.834+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.834+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.68 does not exist 2023-11-02T09:27:39.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.834+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.69 2023-11-02T09:27:39.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.834+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.835+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.69 does not exist 2023-11-02T09:27:39.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.835+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.70 2023-11-02T09:27:39.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.835+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.835+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.70 does not exist 2023-11-02T09:27:39.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.835+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.71 2023-11-02T09:27:39.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.835+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.835+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.71 does not exist 2023-11-02T09:27:39.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.835+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.72 2023-11-02T09:27:39.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.835+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.835+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.72 does not exist 2023-11-02T09:27:39.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.835+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.73 2023-11-02T09:27:39.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.835+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.836+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.73 does not exist 2023-11-02T09:27:39.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.836+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.74 2023-11-02T09:27:39.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.836+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.836+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.74 does not exist 2023-11-02T09:27:39.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.836+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.75 2023-11-02T09:27:39.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.836+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.836+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.75 does not exist 2023-11-02T09:27:39.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.836+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.76 2023-11-02T09:27:39.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.836+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.836+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.76 does not exist 2023-11-02T09:27:39.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.836+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.77 2023-11-02T09:27:39.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.836+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.837+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.77 does not exist 2023-11-02T09:27:39.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.837+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.78 2023-11-02T09:27:39.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.837+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.837+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.78 does not exist 2023-11-02T09:27:39.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.837+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.79 2023-11-02T09:27:39.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.837+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.837+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.79 does not exist 2023-11-02T09:27:39.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.837+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.80 2023-11-02T09:27:39.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.837+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.837+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.80 does not exist 2023-11-02T09:27:39.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.837+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.81 2023-11-02T09:27:39.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.837+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.838+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.81 does not exist 2023-11-02T09:27:39.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.838+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.82 2023-11-02T09:27:39.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.838+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.838+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.82 does not exist 2023-11-02T09:27:39.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.838+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.83 2023-11-02T09:27:39.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.838+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.838+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.83 does not exist 2023-11-02T09:27:39.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.838+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.84 2023-11-02T09:27:39.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.838+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.838+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.84 does not exist 2023-11-02T09:27:39.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.838+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.85 2023-11-02T09:27:39.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.838+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.839+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.85 does not exist 2023-11-02T09:27:39.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.839+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.86 2023-11-02T09:27:39.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.839+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.839+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.86 does not exist 2023-11-02T09:27:39.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.839+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.87 2023-11-02T09:27:39.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.839+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.839+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.87 does not exist 2023-11-02T09:27:39.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.839+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.88 2023-11-02T09:27:39.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.839+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.839+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.88 does not exist 2023-11-02T09:27:39.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.839+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.89 2023-11-02T09:27:39.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.839+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.839+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.89 does not exist 2023-11-02T09:27:39.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.839+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.90 2023-11-02T09:27:39.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.839+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.840+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.90 does not exist 2023-11-02T09:27:39.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.840+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.91 2023-11-02T09:27:39.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.840+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.840+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.91 does not exist 2023-11-02T09:27:39.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.840+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.92 2023-11-02T09:27:39.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.840+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.840+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.92 does not exist 2023-11-02T09:27:39.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.840+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.93 2023-11-02T09:27:39.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.840+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.841+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.93 does not exist 2023-11-02T09:27:39.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.841+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.94 2023-11-02T09:27:39.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.841+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.841+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.94 does not exist 2023-11-02T09:27:39.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.841+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.95 2023-11-02T09:27:39.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.841+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.841+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.95 does not exist 2023-11-02T09:27:39.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.841+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.96 2023-11-02T09:27:39.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.841+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.842+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.96 does not exist 2023-11-02T09:27:39.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.842+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.97 2023-11-02T09:27:39.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.842+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.842+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.97 does not exist 2023-11-02T09:27:39.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.842+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.98 2023-11-02T09:27:39.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.842+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.842+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.98 does not exist 2023-11-02T09:27:39.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.842+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.99 2023-11-02T09:27:39.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.842+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.843+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.99 does not exist 2023-11-02T09:27:39.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.843+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.100 2023-11-02T09:27:39.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.843+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.843+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.100 does not exist 2023-11-02T09:27:39.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.843+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.101 2023-11-02T09:27:39.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.843+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.843+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.101 does not exist 2023-11-02T09:27:39.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.843+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.102 2023-11-02T09:27:39.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.843+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.843+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.102 does not exist 2023-11-02T09:27:39.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.843+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.103 2023-11-02T09:27:39.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.843+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.844+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.103 does not exist 2023-11-02T09:27:39.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.844+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.104 2023-11-02T09:27:39.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.844+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.844+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.104 does not exist 2023-11-02T09:27:39.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.844+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.105 2023-11-02T09:27:39.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.844+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.844+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.105 does not exist 2023-11-02T09:27:39.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.844+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.106 2023-11-02T09:27:39.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.844+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.845+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.106 does not exist 2023-11-02T09:27:39.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.845+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.107 2023-11-02T09:27:39.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.845+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.845+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.107 does not exist 2023-11-02T09:27:39.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.845+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.108 2023-11-02T09:27:39.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.845+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.845+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.108 does not exist 2023-11-02T09:27:39.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.845+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.109 2023-11-02T09:27:39.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.845+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.845+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.109 does not exist 2023-11-02T09:27:39.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.845+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.110 2023-11-02T09:27:39.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.845+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.846+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.110 does not exist 2023-11-02T09:27:39.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.846+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.111 2023-11-02T09:27:39.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.846+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.846+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.111 does not exist 2023-11-02T09:27:39.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.846+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.112 2023-11-02T09:27:39.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.846+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.846+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.112 does not exist 2023-11-02T09:27:39.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.846+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.113 2023-11-02T09:27:39.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.846+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.846+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.113 does not exist 2023-11-02T09:27:39.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.846+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.114 2023-11-02T09:27:39.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.846+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.847+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.114 does not exist 2023-11-02T09:27:39.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.847+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.115 2023-11-02T09:27:39.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.847+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.847+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.115 does not exist 2023-11-02T09:27:39.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.847+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.116 2023-11-02T09:27:39.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.847+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.847+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.116 does not exist 2023-11-02T09:27:39.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.847+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.117 2023-11-02T09:27:39.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.847+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.847+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.117 does not exist 2023-11-02T09:27:39.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.847+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.118 2023-11-02T09:27:39.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.847+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.847+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.118 does not exist 2023-11-02T09:27:39.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.847+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.119 2023-11-02T09:27:39.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.847+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.848+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.119 does not exist 2023-11-02T09:27:39.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.848+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.120 2023-11-02T09:27:39.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.848+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.848+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.120 does not exist 2023-11-02T09:27:39.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.848+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.121 2023-11-02T09:27:39.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.848+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.848+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.121 does not exist 2023-11-02T09:27:39.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.848+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.122 2023-11-02T09:27:39.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.848+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.848+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.122 does not exist 2023-11-02T09:27:39.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.848+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.123 2023-11-02T09:27:39.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.848+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.849+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.123 does not exist 2023-11-02T09:27:39.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.849+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.124 2023-11-02T09:27:39.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.849+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.849+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.124 does not exist 2023-11-02T09:27:39.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.849+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.125 2023-11-02T09:27:39.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.849+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.849+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.125 does not exist 2023-11-02T09:27:39.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.849+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.126 2023-11-02T09:27:39.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.849+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.849+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.126 does not exist 2023-11-02T09:27:39.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.849+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.127 2023-11-02T09:27:39.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.849+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.850+0000 7f872f2c0880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.127 does not exist 2023-11-02T09:27:39.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.850+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1210 entering 2023-11-02T09:27:39.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.854+0000 7f872f2c0880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-11-02T09:27:39.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.857+0000 7f8714a39640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-11-02T09:27:39.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.857+0000 7f872f2c0880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-11-02T09:27:39.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:39.857+0000 7f872f2c0880 20 check_secure_mon_conn(): mode 1 is insecure 2023-11-02T09:27:42.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:42.784+0000 7f872f2c0880 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2023-11-02T09:27:42.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:42.784+0000 7f872f2c0880 5 note: GC not initialized 2023-11-02T09:27:42.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:42.784+0000 7f8710230640 20 reqs_thread_entry: start 2023-11-02T09:27:42.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:42.784+0000 7f872f2c0880 20 init_complete bucket index max shards: 11 2023-11-02T09:27:42.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:42.784+0000 7f872f2c0880 20 Filter name: none 2023-11-02T09:27:42.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:42.784+0000 7f870e22c640 20 reqs_thread_entry: start 2023-11-02T09:27:42.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:42.811+0000 7f8714a39640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-11-02T09:27:42.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:42.814+0000 7f872f2c0880 20 remove_watcher() i=0 2023-11-02T09:27:42.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:42.814+0000 7f872f2c0880 2 removed watcher, disabling cache 2023-11-02T09:27:42.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:42.815+0000 7f872f2c0880 20 remove_watcher() i=1 2023-11-02T09:27:42.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:42.817+0000 7f872f2c0880 20 remove_watcher() i=2 2023-11-02T09:27:42.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:42.820+0000 7f872f2c0880 20 remove_watcher() i=3 2023-11-02T09:27:42.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:42.821+0000 7f872f2c0880 20 remove_watcher() i=4 2023-11-02T09:27:42.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:42.823+0000 7f872f2c0880 20 remove_watcher() i=5 2023-11-02T09:27:42.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:42.824+0000 7f872f2c0880 20 remove_watcher() i=6 2023-11-02T09:27:42.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:42.825+0000 7f872f2c0880 20 remove_watcher() i=7 2023-11-02T09:27:42.850 INFO:teuthology.orchestra.run.smithi156.stdout:[] 2023-11-02T09:27:42.851 DEBUG:tasks.util.rgw: json result: [] 2023-11-02T09:27:42.852 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2023-11-02T09:27:42.852 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2023-11-02T09:27:42.852 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2023-11-02T09:27:42.853 DEBUG:teuthology.orchestra.run.smithi156:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2023-11-02T09:27:42.917 INFO:teuthology.orchestra.run.smithi156.stderr:ignoring --setuser ceph since I am not root 2023-11-02T09:27:42.917 INFO:teuthology.orchestra.run.smithi156.stderr:ignoring --setgroup ceph since I am not root 2023-11-02T09:27:42.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:42.925+0000 7fe241936880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-11-02T09:27:42.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:42.925+0000 7fe241936880 20 check_secure_mon_conn(): mode 1 is insecure 2023-11-02T09:27:42.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:42.928+0000 7fe221a51640 20 reqs_thread_entry: start 2023-11-02T09:27:42.941 INFO:teuthology.orchestra.run.smithi156.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2023-11-02T09:27:42.941 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['LUKEWARM', 'STANDARD']}}] 2023-11-02T09:27:42.942 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2023-11-02T09:27:42.942 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2023-11-02T09:27:42.942 DEBUG:teuthology.orchestra.run.smithi156:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2023-11-02T09:27:43.003 INFO:teuthology.orchestra.run.smithi156.stderr:ignoring --setuser ceph since I am not root 2023-11-02T09:27:43.003 INFO:teuthology.orchestra.run.smithi156.stderr:ignoring --setgroup ceph since I am not root 2023-11-02T09:27:43.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:43.010+0000 7f39e7044880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-11-02T09:27:43.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:43.010+0000 7f39e7044880 20 check_secure_mon_conn(): mode 1 is insecure 2023-11-02T09:27:43.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:43.013+0000 7f39c8fbe640 20 reqs_thread_entry: start 2023-11-02T09:27:43.025 INFO:teuthology.orchestra.run.smithi156.stdout:{"id":"8100026f-34ce-4e78-9bac-c57f344b7c64","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2023-11-02T09:27:43.026 DEBUG:tasks.util.rgw: json result: {'id': '8100026f-34ce-4e78-9bac-c57f344b7c64', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2023-11-02T09:27:43.026 INFO:tasks.rgw:Configuring storage class type = FROZEN 2023-11-02T09:27:43.027 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2023-11-02T09:27:43.027 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2023-11-02T09:27:43.028 DEBUG:teuthology.orchestra.run.smithi156:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2023-11-02T09:27:43.087 INFO:teuthology.orchestra.run.smithi156.stderr:ignoring --setuser ceph since I am not root 2023-11-02T09:27:43.088 INFO:teuthology.orchestra.run.smithi156.stderr:ignoring --setgroup ceph since I am not root 2023-11-02T09:27:43.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:43.095+0000 7fcef5329880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-11-02T09:27:43.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:43.095+0000 7fcef5329880 20 check_secure_mon_conn(): mode 1 is insecure 2023-11-02T09:27:43.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:43.098+0000 7fced53c7640 20 reqs_thread_entry: start 2023-11-02T09:27:43.109 INFO:teuthology.orchestra.run.smithi156.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2023-11-02T09:27:43.110 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['FROZEN', 'LUKEWARM', 'STANDARD']}}] 2023-11-02T09:27:43.110 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2023-11-02T09:27:43.110 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2023-11-02T09:27:43.111 DEBUG:teuthology.orchestra.run.smithi156:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2023-11-02T09:27:43.174 INFO:teuthology.orchestra.run.smithi156.stderr:ignoring --setuser ceph since I am not root 2023-11-02T09:27:43.174 INFO:teuthology.orchestra.run.smithi156.stderr:ignoring --setgroup ceph since I am not root 2023-11-02T09:27:43.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:43.181+0000 7f39ff20f880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-11-02T09:27:43.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:43.181+0000 7f39ff20f880 20 check_secure_mon_conn(): mode 1 is insecure 2023-11-02T09:27:43.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:27:43.184+0000 7f39dedbf640 20 reqs_thread_entry: start 2023-11-02T09:27:43.196 INFO:teuthology.orchestra.run.smithi156.stdout:{"id":"8100026f-34ce-4e78-9bac-c57f344b7c64","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2023-11-02T09:27:43.197 DEBUG:tasks.util.rgw: json result: {'id': '8100026f-34ce-4e78-9bac-c57f344b7c64', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'FROZEN': {'data_pool': 'default.rgw.buckets.data.frozen'}, 'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2023-11-02T09:27:43.197 INFO:tasks.rgw:Starting rgw... 2023-11-02T09:27:43.197 INFO:tasks.rgw:rgw client.0 config is {} 2023-11-02T09:27:43.198 INFO:tasks.rgw:Using beast as radosgw frontend 2023-11-02T09:27:43.198 INFO:tasks.rgw.client.0:Restarting daemon 2023-11-02T09:27:43.198 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2023-11-02T09:27:43.201 INFO:tasks.rgw.client.0:Started 2023-11-02T09:27:43.201 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi156.front.sepia.ceph.com:80/ 2023-11-02T09:27:43.202 DEBUG:teuthology.orchestra.run.smithi156:> curl http://smithi156.front.sepia.ceph.com:80/ 2023-11-02T09:27:43.242 DEBUG:teuthology.orchestra.run:got remote process result: 7 2023-11-02T09:27:43.243 INFO:teuthology.orchestra.run.smithi156.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2023-11-02T09:27:43.243 INFO:teuthology.orchestra.run.smithi156.stderr: Dload Upload Total Spent Left Speed 2023-11-02T09:27:43.244 INFO:teuthology.orchestra.run.smithi156.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2023-11-02T09:27:43.244 INFO:teuthology.orchestra.run.smithi156.stderr:curl: (7) Failed to connect to smithi156.front.sepia.ceph.com port 80: Connection refused 2023-11-02T09:27:44.245 DEBUG:teuthology.orchestra.run.smithi156:> curl http://smithi156.front.sepia.ceph.com:80/ 2023-11-02T09:27:44.277 INFO:teuthology.orchestra.run.smithi156.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2023-11-02T09:27:44.278 INFO:teuthology.orchestra.run.smithi156.stderr: Dload Upload Total Spent Left Speed 2023-11-02T09:27:44.279 INFO:teuthology.orchestra.run.smithi156.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 208k 0 --:--:-- --:--:-- --:--:-- 208k 2023-11-02T09:27:44.280 INFO:teuthology.orchestra.run.smithi156.stdout:anonymous 2023-11-02T09:27:44.280 INFO:teuthology.run_tasks:Running task rabbitmq... 2023-11-02T09:27:44.300 DEBUG:tasks.rabbitmq:RabbitMQ config is {'client.0': None} 2023-11-02T09:27:44.301 INFO:tasks.rabbitmq:Installing RabbitMQ... 2023-11-02T09:27:44.301 DEBUG:teuthology.orchestra.run.smithi156:> sudo dnf -y install epel-release 2023-11-02T09:27:44.892 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:02:56 ago on Thu 02 Nov 2023 09:24:48 AM UTC. 2023-11-02T09:27:45.039 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-11-02T09:27:45.040 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-02T09:27:45.040 INFO:teuthology.orchestra.run.smithi156.stdout: Package Architecture Version Repository Size 2023-11-02T09:27:45.041 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-02T09:27:45.041 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2023-11-02T09:27:45.041 INFO:teuthology.orchestra.run.smithi156.stdout: epel-release noarch 9-7.el9 extras-common 19 k 2023-11-02T09:27:45.041 INFO:teuthology.orchestra.run.smithi156.stdout:Installing weak dependencies: 2023-11-02T09:27:45.041 INFO:teuthology.orchestra.run.smithi156.stdout: epel-next-release noarch 9-7.el9 extras-common 8.1 k 2023-11-02T09:27:45.042 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:27:45.042 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-11-02T09:27:45.042 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-02T09:27:45.042 INFO:teuthology.orchestra.run.smithi156.stdout:Install 2 Packages 2023-11-02T09:27:45.042 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:27:45.043 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 27 k 2023-11-02T09:27:45.043 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 29 k 2023-11-02T09:27:45.043 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-11-02T09:27:45.197 INFO:teuthology.orchestra.run.smithi156.stdout:(1/2): epel-release-9-7.el9.noarch.rpm 204 kB/s | 19 kB 00:00 2023-11-02T09:27:45.222 INFO:teuthology.orchestra.run.smithi156.stdout:(2/2): epel-next-release-9-7.el9.noarch.rpm 70 kB/s | 8.1 kB 00:00 2023-11-02T09:27:45.222 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-11-02T09:27:45.222 INFO:teuthology.orchestra.run.smithi156.stdout:Total 148 kB/s | 27 kB 00:00 2023-11-02T09:27:45.238 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS Stream 9 - Extras packages 357 kB/s | 2.1 kB 00:00 2023-11-02T09:27:45.342 INFO:teuthology.orchestra.run.smithi156.stderr:Importing GPG key 0x1D997668: 2023-11-02T09:27:45.343 INFO:teuthology.orchestra.run.smithi156.stderr: Userid : "CentOS Extras SIG (https://wiki.centos.org/SpecialInterestGroup) " 2023-11-02T09:27:45.343 INFO:teuthology.orchestra.run.smithi156.stderr: Fingerprint: 363F C097 2F64 B699 AED3 968E 1FF6 A217 1D99 7668 2023-11-02T09:27:45.343 INFO:teuthology.orchestra.run.smithi156.stderr: From : /etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-SIG-Extras-SHA512 2023-11-02T09:27:45.405 INFO:teuthology.orchestra.run.smithi156.stdout:Key imported successfully 2023-11-02T09:27:45.423 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-11-02T09:27:45.428 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-11-02T09:27:45.428 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-11-02T09:27:45.484 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-11-02T09:27:45.485 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-11-02T09:27:45.609 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-11-02T09:27:45.610 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : epel-release-9-7.el9.noarch 1/2 2023-11-02T09:27:45.610 INFO:teuthology.orchestra.run.smithi156.stdout:warning: /etc/yum.repos.d/epel-testing.repo created as /etc/yum.repos.d/epel-testing.repo.rpmnew 2023-11-02T09:27:45.610 INFO:teuthology.orchestra.run.smithi156.stdout:warning: /etc/yum.repos.d/epel.repo created as /etc/yum.repos.d/epel.repo.rpmnew 2023-11-02T09:27:45.610 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:27:45.670 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: epel-release-9-7.el9.noarch 1/2 2023-11-02T09:27:45.670 INFO:teuthology.orchestra.run.smithi156.stdout:Many EPEL packages require the CodeReady Builder (CRB) repository. 2023-11-02T09:27:45.670 INFO:teuthology.orchestra.run.smithi156.stdout:It is recommended that you run /usr/bin/crb enable to enable the CRB repository. 2023-11-02T09:27:45.671 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:27:45.755 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : epel-next-release-9-7.el9.noarch 2/2 2023-11-02T09:27:46.716 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: epel-next-release-9-7.el9.noarch 2/2 2023-11-02T09:27:46.717 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : epel-next-release-9-7.el9.noarch 1/2 2023-11-02T09:27:47.060 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : epel-release-9-7.el9.noarch 2/2 2023-11-02T09:27:47.061 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:27:47.061 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-11-02T09:27:47.061 INFO:teuthology.orchestra.run.smithi156.stdout: epel-next-release-9-7.el9.noarch epel-release-9-7.el9.noarch 2023-11-02T09:27:47.061 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:27:47.061 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-11-02T09:27:47.200 DEBUG:teuthology.orchestra.run.smithi156:> curl -s https://packagecloud.io/install/repositories/rabbitmq/erlang/script.rpm.sh | sudo bash 2023-11-02T09:27:47.631 INFO:teuthology.orchestra.run.smithi156.stdout:Detected operating system as centos/9. 2023-11-02T09:27:47.631 INFO:teuthology.orchestra.run.smithi156.stdout:Checking for curl... 2023-11-02T09:27:47.631 INFO:teuthology.orchestra.run.smithi156.stdout:Detected curl... 2023-11-02T09:27:47.632 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading repository file: https://packagecloud.io/install/repositories/rabbitmq/erlang/config_file.repo?os=centos&dist=9&source=script 2023-11-02T09:27:48.026 INFO:teuthology.orchestra.run.smithi156.stdout:done. 2023-11-02T09:27:48.026 INFO:teuthology.orchestra.run.smithi156.stdout:Installing pygpgme to verify GPG signatures... 2023-11-02T09:27:49.062 INFO:teuthology.orchestra.run.smithi156.stdout:Extra Packages for Enterprise Linux 9 openh264 4.9 kB/s | 2.5 kB 00:00 2023-11-02T09:27:50.189 INFO:teuthology.orchestra.run.smithi156.stdout:Extra Packages for Enterprise Linux 9 - Next - 1.6 MB/s | 1.6 MB 00:01 2023-11-02T09:27:52.150 INFO:teuthology.orchestra.run.smithi156.stdout:rabbitmq_erlang-source 579 B/s | 819 B 00:01 2023-11-02T09:27:52.565 INFO:teuthology.orchestra.run.smithi156.stdout:rabbitmq_erlang-source 9.3 kB/s | 3.8 kB 00:00 2023-11-02T09:27:52.594 INFO:teuthology.orchestra.run.smithi156.stderr:Importing GPG key 0xDF309A0B: 2023-11-02T09:27:52.594 INFO:teuthology.orchestra.run.smithi156.stderr: Userid : "https://packagecloud.io/rabbitmq/erlang (https://packagecloud.io/docs#gpg_signing) " 2023-11-02T09:27:52.595 INFO:teuthology.orchestra.run.smithi156.stderr: Fingerprint: 2EBD E413 D3CE 5D35 BCD1 5B7C 71C6 3471 DF30 9A0B 2023-11-02T09:27:52.595 INFO:teuthology.orchestra.run.smithi156.stderr: From : https://packagecloud.io/rabbitmq/erlang/gpgkey 2023-11-02T09:27:54.790 INFO:teuthology.orchestra.run.smithi156.stdout:rabbitmq_erlang-source 136 B/s | 296 B 00:02 2023-11-02T09:27:55.624 INFO:teuthology.orchestra.run.smithi156.stdout:No match for argument: pygpgme 2023-11-02T09:27:55.654 INFO:teuthology.orchestra.run.smithi156.stderr:Error: Unable to find a match: pygpgme 2023-11-02T09:27:56.407 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:27:56.407 INFO:teuthology.orchestra.run.smithi156.stdout:WARNING: 2023-11-02T09:27:56.407 INFO:teuthology.orchestra.run.smithi156.stdout:The pygpgme package could not be installed. This means GPG verification is not possible for any RPM installed on your system. 2023-11-02T09:27:56.408 INFO:teuthology.orchestra.run.smithi156.stdout:To fix this, add a repository with pygpgme. Usualy, the EPEL repository for your system will have this. 2023-11-02T09:27:56.408 INFO:teuthology.orchestra.run.smithi156.stdout:More information: https://fedoraproject.org/wiki/EPEL#How_can_I_use_these_extra_packages.3F 2023-11-02T09:27:56.408 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:27:56.409 INFO:teuthology.orchestra.run.smithi156.stdout:Installing yum-utils... 2023-11-02T09:27:57.626 INFO:teuthology.orchestra.run.smithi156.stdout:rabbitmq_erlang-source 1.4 kB/s | 951 B 00:00 2023-11-02T09:27:57.728 INFO:teuthology.orchestra.run.smithi156.stdout:Package yum-utils-4.3.0-11.el9.noarch is already installed. 2023-11-02T09:27:57.784 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-11-02T09:27:57.785 INFO:teuthology.orchestra.run.smithi156.stdout:Nothing to do. 2023-11-02T09:27:57.786 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-11-02T09:27:58.652 INFO:teuthology.orchestra.run.smithi156.stdout:Generating yum cache for rabbitmq_erlang... 2023-11-02T09:28:00.529 INFO:teuthology.orchestra.run.smithi156.stdout:Generating yum cache for rabbitmq_erlang-source... 2023-11-02T09:28:01.409 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:28:01.409 INFO:teuthology.orchestra.run.smithi156.stdout:The repository is setup! You can now install packages. 2023-11-02T09:28:01.411 DEBUG:teuthology.orchestra.run.smithi156:> sudo dnf -y install erlang 2023-11-02T09:28:02.032 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:00:01 ago on Thu 02 Nov 2023 09:28:01 AM UTC. 2023-11-02T09:28:03.794 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-11-02T09:28:03.795 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-02T09:28:03.796 INFO:teuthology.orchestra.run.smithi156.stdout: Package Architecture Version Repository Size 2023-11-02T09:28:03.796 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-02T09:28:03.796 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2023-11-02T09:28:03.796 INFO:teuthology.orchestra.run.smithi156.stdout: erlang x86_64 26.1.2-1.el9 rabbitmq_erlang 21 M 2023-11-02T09:28:03.796 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:28:03.797 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-11-02T09:28:03.797 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-02T09:28:03.797 INFO:teuthology.orchestra.run.smithi156.stdout:Install 1 Package 2023-11-02T09:28:03.797 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:28:03.797 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 21 M 2023-11-02T09:28:03.798 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 37 M 2023-11-02T09:28:03.798 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-11-02T09:28:04.548 INFO:teuthology.orchestra.run.smithi156.stdout:erlang-26.1.2-1.el9.x86_64.rpm 28 MB/s | 21 MB 00:00 2023-11-02T09:28:04.550 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-11-02T09:28:04.550 INFO:teuthology.orchestra.run.smithi156.stdout:Total 28 MB/s | 21 MB 00:00 2023-11-02T09:28:04.551 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-11-02T09:28:04.561 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-11-02T09:28:04.561 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-11-02T09:28:04.783 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-11-02T09:28:04.783 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-11-02T09:28:05.792 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-11-02T09:28:05.929 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : erlang-26.1.2-1.el9.x86_64 1/1 2023-11-02T09:28:06.872 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: erlang-26.1.2-1.el9.x86_64 1/1 2023-11-02T09:28:07.164 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : erlang-26.1.2-1.el9.x86_64 1/1 2023-11-02T09:28:07.165 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:28:07.165 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-11-02T09:28:07.165 INFO:teuthology.orchestra.run.smithi156.stdout: erlang-26.1.2-1.el9.x86_64 2023-11-02T09:28:07.165 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:28:07.165 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-11-02T09:28:07.430 DEBUG:teuthology.orchestra.run.smithi156:> curl -s https://packagecloud.io/install/repositories/rabbitmq/rabbitmq-server/script.rpm.sh | sudo bash 2023-11-02T09:28:07.814 INFO:teuthology.orchestra.run.smithi156.stdout:Detected operating system as centos/9. 2023-11-02T09:28:07.815 INFO:teuthology.orchestra.run.smithi156.stdout:Checking for curl... 2023-11-02T09:28:07.815 INFO:teuthology.orchestra.run.smithi156.stdout:Detected curl... 2023-11-02T09:28:07.815 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading repository file: https://packagecloud.io/install/repositories/rabbitmq/rabbitmq-server/config_file.repo?os=centos&dist=9&source=script 2023-11-02T09:28:08.214 INFO:teuthology.orchestra.run.smithi156.stdout:done. 2023-11-02T09:28:08.215 INFO:teuthology.orchestra.run.smithi156.stdout:Installing pygpgme to verify GPG signatures... 2023-11-02T09:28:09.954 INFO:teuthology.orchestra.run.smithi156.stdout:rabbitmq_rabbitmq-server-source 687 B/s | 819 B 00:01 2023-11-02T09:28:10.373 INFO:teuthology.orchestra.run.smithi156.stdout:rabbitmq_rabbitmq-server-source 9.2 kB/s | 3.9 kB 00:00 2023-11-02T09:28:10.400 INFO:teuthology.orchestra.run.smithi156.stderr:Importing GPG key 0x4D206F89: 2023-11-02T09:28:10.400 INFO:teuthology.orchestra.run.smithi156.stderr: Userid : "https://packagecloud.io/rabbitmq/rabbitmq-server (https://packagecloud.io/docs#gpg_signing) " 2023-11-02T09:28:10.400 INFO:teuthology.orchestra.run.smithi156.stderr: Fingerprint: 8C69 5B02 19AF DEB0 4A05 8ED8 F4E7 8920 4D20 6F89 2023-11-02T09:28:10.400 INFO:teuthology.orchestra.run.smithi156.stderr: From : https://packagecloud.io/rabbitmq/rabbitmq-server/gpgkey 2023-11-02T09:28:12.538 INFO:teuthology.orchestra.run.smithi156.stdout:rabbitmq_rabbitmq-server-source 139 B/s | 296 B 00:02 2023-11-02T09:28:13.204 INFO:teuthology.orchestra.run.smithi156.stdout:No match for argument: pygpgme 2023-11-02T09:28:13.216 INFO:teuthology.orchestra.run.smithi156.stderr:Error: Unable to find a match: pygpgme 2023-11-02T09:28:13.975 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:28:13.976 INFO:teuthology.orchestra.run.smithi156.stdout:WARNING: 2023-11-02T09:28:13.976 INFO:teuthology.orchestra.run.smithi156.stdout:The pygpgme package could not be installed. This means GPG verification is not possible for any RPM installed on your system. 2023-11-02T09:28:13.976 INFO:teuthology.orchestra.run.smithi156.stdout:To fix this, add a repository with pygpgme. Usualy, the EPEL repository for your system will have this. 2023-11-02T09:28:13.976 INFO:teuthology.orchestra.run.smithi156.stdout:More information: https://fedoraproject.org/wiki/EPEL#How_can_I_use_these_extra_packages.3F 2023-11-02T09:28:13.977 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:28:13.977 INFO:teuthology.orchestra.run.smithi156.stdout:Installing yum-utils... 2023-11-02T09:28:15.204 INFO:teuthology.orchestra.run.smithi156.stdout:rabbitmq_rabbitmq-server-source 1.4 kB/s | 951 B 00:00 2023-11-02T09:28:15.301 INFO:teuthology.orchestra.run.smithi156.stdout:Package yum-utils-4.3.0-11.el9.noarch is already installed. 2023-11-02T09:28:15.356 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-11-02T09:28:15.357 INFO:teuthology.orchestra.run.smithi156.stdout:Nothing to do. 2023-11-02T09:28:15.357 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-11-02T09:28:16.180 INFO:teuthology.orchestra.run.smithi156.stdout:Generating yum cache for rabbitmq_rabbitmq-server... 2023-11-02T09:28:18.397 INFO:teuthology.orchestra.run.smithi156.stdout:Generating yum cache for rabbitmq_rabbitmq-server-source... 2023-11-02T09:28:19.092 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:28:19.093 INFO:teuthology.orchestra.run.smithi156.stdout:The repository is setup! You can now install packages. 2023-11-02T09:28:19.094 DEBUG:teuthology.orchestra.run.smithi156:> sudo dnf -y install rabbitmq-server 2023-11-02T09:28:19.953 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-11-02T09:28:19.955 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-02T09:28:19.955 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repository Size 2023-11-02T09:28:19.955 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-02T09:28:19.955 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2023-11-02T09:28:19.955 INFO:teuthology.orchestra.run.smithi156.stdout: rabbitmq-server noarch 3.12.8-1.el8 rabbitmq_rabbitmq-server 17 M 2023-11-02T09:28:19.956 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:28:19.956 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-11-02T09:28:19.956 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-02T09:28:19.956 INFO:teuthology.orchestra.run.smithi156.stdout:Install 1 Package 2023-11-02T09:28:19.956 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:28:19.957 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 17 M 2023-11-02T09:28:19.957 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 22 M 2023-11-02T09:28:19.957 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-11-02T09:28:20.663 INFO:teuthology.orchestra.run.smithi156.stdout:rabbitmq-server-3.12.8-1.el8.noarch.rpm 24 MB/s | 17 MB 00:00 2023-11-02T09:28:20.664 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-11-02T09:28:20.665 INFO:teuthology.orchestra.run.smithi156.stdout:Total 24 MB/s | 17 MB 00:00 2023-11-02T09:28:20.665 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-11-02T09:28:20.675 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-11-02T09:28:20.675 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-11-02T09:28:20.810 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-11-02T09:28:20.810 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-11-02T09:28:21.035 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-11-02T09:28:22.333 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: rabbitmq-server-3.12.8-1.el8.noarch 1/1 2023-11-02T09:28:22.426 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : rabbitmq-server-3.12.8-1.el8.noarch 1/1 2023-11-02T09:28:22.914 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: rabbitmq-server-3.12.8-1.el8.noarch 1/1 2023-11-02T09:28:22.914 INFO:teuthology.orchestra.run.smithi156.stdout:/usr/lib/tmpfiles.d/rabbitmq-server.conf:1: Line references path below legacy directory /var/run/, updating /var/run/rabbitmq → /run/rabbitmq; please update the tmpfiles.d/ drop-in file accordingly. 2023-11-02T09:28:22.917 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:28:24.425 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : rabbitmq-server-3.12.8-1.el8.noarch 1/1 2023-11-02T09:28:24.425 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:28:24.426 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-11-02T09:28:24.426 INFO:teuthology.orchestra.run.smithi156.stdout: rabbitmq-server-3.12.8-1.el8.noarch 2023-11-02T09:28:24.426 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:28:24.426 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-11-02T09:28:24.741 INFO:tasks.rabbitmq:Bringing up Daemon and RabbitMQ service... 2023-11-02T09:28:24.742 DEBUG:teuthology.orchestra.run.smithi156:> sudo systemctl enable rabbitmq-server.service 2023-11-02T09:28:24.790 INFO:teuthology.orchestra.run.smithi156.stderr:Created symlink /etc/systemd/system/multi-user.target.wants/rabbitmq-server.service → /usr/lib/systemd/system/rabbitmq-server.service. 2023-11-02T09:28:24.959 DEBUG:teuthology.orchestra.run.smithi156:> sudo /sbin/service rabbitmq-server start 2023-11-02T09:28:25.003 INFO:teuthology.orchestra.run.smithi156.stderr:Redirecting to /bin/systemctl start rabbitmq-server.service 2023-11-02T09:28:28.799 INFO:teuthology.run_tasks:Running task notification-tests... 2023-11-02T09:28:28.817 DEBUG:tasks.notification_tests:Notifications config is {'client.0': {'extra_attr': ['amqp_test'], 'rgw_server': 'client.0'}} 2023-11-02T09:28:28.818 INFO:tasks.notification_tests:Downloading bucket-notifications-tests... 2023-11-02T09:28:28.818 INFO:tasks.notification_tests:Using branch wip-alimasa-2pc-remove-issue from https://git.ceph.com/ceph-ci.git for bucket notifications tests 2023-11-02T09:28:28.819 DEBUG:teuthology.orchestra.run.smithi156:> git clone -b wip-alimasa-2pc-remove-issue https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/ceph 2023-11-02T09:28:28.867 INFO:teuthology.orchestra.run.smithi156.stderr:Cloning into '/home/ubuntu/cephtest/ceph'... 2023-11-02T09:29:42.829 INFO:tasks.notification_tests:Pre-processing... 2023-11-02T09:29:42.830 DEBUG:teuthology.orchestra.run.smithi156:> mkdir -p /home/ubuntu/.aws/models/s3/2006-03-01/ 2023-11-02T09:29:42.898 DEBUG:teuthology.orchestra.run.smithi156:> cd /home/ubuntu/.aws/models/s3/2006-03-01/ && cp /home/ubuntu/cephtest/ceph/examples/rgw/boto3/service-2.sdk-extras.json service-2.sdk-extras.json 2023-11-02T09:29:42.965 INFO:tasks.notification_tests:Creating rgw user... 2023-11-02T09:29:42.965 DEBUG:tasks.notification_tests:Creating user foo.client.0 on client.0 2023-11-02T09:29:42.966 DEBUG:teuthology.orchestra.run.smithi156:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name 'Mr. foo.client.0' --access-key HXZDMROXJJZZSFNUKJXB --secret FuiiL+NhR9EgO9nEzwifIkdNYM1g71mxJ67Pz3WI5mlJWJO1x1Zv7g== --cluster ceph 2023-11-02T09:29:43.064 INFO:teuthology.orchestra.run.smithi156.stderr:ignoring --setuser ceph since I am not root 2023-11-02T09:29:43.065 INFO:teuthology.orchestra.run.smithi156.stderr:ignoring --setgroup ceph since I am not root 2023-11-02T09:29:43.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.066+0000 7f222e8c0880 -1 asok(0x55b9a3cfe000) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to bind the UNIX domain socket to '/var/run/ceph/ceph-client.0.94056.asok': (13) Permission denied 2023-11-02T09:29:43.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.072+0000 7f222e8c0880 20 rados->read ofs=0 len=0 2023-11-02T09:29:43.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.073+0000 7f222e8c0880 20 rados_obj.operate() r=-2 bl.length=0 2023-11-02T09:29:43.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.073+0000 7f222e8c0880 20 realm 2023-11-02T09:29:43.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.073+0000 7f222e8c0880 20 rados->read ofs=0 len=0 2023-11-02T09:29:43.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.074+0000 7f222e8c0880 20 rados_obj.operate() r=-2 bl.length=0 2023-11-02T09:29:43.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.074+0000 7f222e8c0880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-11-02T09:29:43.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.074+0000 7f222e8c0880 20 rados->read ofs=0 len=0 2023-11-02T09:29:43.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.074+0000 7f222e8c0880 20 rados_obj.operate() r=-2 bl.length=0 2023-11-02T09:29:43.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.074+0000 7f222e8c0880 20 rados->read ofs=0 len=0 2023-11-02T09:29:43.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.075+0000 7f222e8c0880 20 rados_obj.operate() r=0 bl.length=46 2023-11-02T09:29:43.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.075+0000 7f222e8c0880 20 rados->read ofs=0 len=0 2023-11-02T09:29:43.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.075+0000 7f222e8c0880 20 rados_obj.operate() r=0 bl.length=1004 2023-11-02T09:29:43.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.075+0000 7f222e8c0880 20 searching for the correct realm 2023-11-02T09:29:43.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.087+0000 7f222e8c0880 20 RGWRados::pool_iterate: got zone_info.8100026f-34ce-4e78-9bac-c57f344b7c64 2023-11-02T09:29:43.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.087+0000 7f222e8c0880 20 RGWRados::pool_iterate: got zonegroup_info.fc2743cf-89e8-403c-8ea6-8171440e8b91 2023-11-02T09:29:43.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.087+0000 7f222e8c0880 20 RGWRados::pool_iterate: got zone_names.default 2023-11-02T09:29:43.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.087+0000 7f222e8c0880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-11-02T09:29:43.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.087+0000 7f222e8c0880 20 rados->read ofs=0 len=0 2023-11-02T09:29:43.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.087+0000 7f222e8c0880 20 rados_obj.operate() r=-2 bl.length=0 2023-11-02T09:29:43.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.087+0000 7f222e8c0880 20 rados->read ofs=0 len=0 2023-11-02T09:29:43.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.088+0000 7f222e8c0880 20 rados_obj.operate() r=0 bl.length=46 2023-11-02T09:29:43.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.088+0000 7f222e8c0880 20 rados->read ofs=0 len=0 2023-11-02T09:29:43.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.088+0000 7f222e8c0880 20 rados_obj.operate() r=0 bl.length=454 2023-11-02T09:29:43.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.088+0000 7f222e8c0880 20 zone default found 2023-11-02T09:29:43.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.088+0000 7f222e8c0880 4 Realm: () 2023-11-02T09:29:43.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.088+0000 7f222e8c0880 4 ZoneGroup: default (fc2743cf-89e8-403c-8ea6-8171440e8b91) 2023-11-02T09:29:43.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.088+0000 7f222e8c0880 4 Zone: default (8100026f-34ce-4e78-9bac-c57f344b7c64) 2023-11-02T09:29:43.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.088+0000 7f222e8c0880 10 cannot find current period zonegroup using local zonegroup configuration 2023-11-02T09:29:43.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.088+0000 7f222e8c0880 20 zonegroup default 2023-11-02T09:29:43.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.088+0000 7f222e8c0880 20 rados->read ofs=0 len=0 2023-11-02T09:29:43.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.088+0000 7f222e8c0880 20 rados_obj.operate() r=-2 bl.length=0 2023-11-02T09:29:43.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.088+0000 7f222e8c0880 20 rados->read ofs=0 len=0 2023-11-02T09:29:43.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.089+0000 7f222e8c0880 20 rados_obj.operate() r=-2 bl.length=0 2023-11-02T09:29:43.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.089+0000 7f222e8c0880 20 rados->read ofs=0 len=0 2023-11-02T09:29:43.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.089+0000 7f222e8c0880 20 rados_obj.operate() r=-2 bl.length=0 2023-11-02T09:29:43.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.089+0000 7f222e8c0880 20 started sync module instance, tier type = 2023-11-02T09:29:43.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.089+0000 7f222e8c0880 20 started zone id=8100026f-34ce-4e78-9bac-c57f344b7c64 (name=default) with tier type = 2023-11-02T09:29:43.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.100+0000 7f222e8c0880 20 add_watcher() i=0 2023-11-02T09:29:43.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.100+0000 7f222e8c0880 20 add_watcher() i=1 2023-11-02T09:29:43.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.100+0000 7f222e8c0880 20 add_watcher() i=2 2023-11-02T09:29:43.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.100+0000 7f222e8c0880 20 add_watcher() i=3 2023-11-02T09:29:43.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.100+0000 7f222e8c0880 20 add_watcher() i=4 2023-11-02T09:29:43.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.100+0000 7f222e8c0880 20 add_watcher() i=5 2023-11-02T09:29:43.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.100+0000 7f222e8c0880 20 add_watcher() i=6 2023-11-02T09:29:43.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.101+0000 7f222e8c0880 20 add_watcher() i=7 2023-11-02T09:29:43.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.101+0000 7f222e8c0880 2 all 8 watchers are set, enabling cache 2023-11-02T09:29:43.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.103+0000 7f221483a640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-11-02T09:29:43.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.103+0000 7f222e8c0880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-11-02T09:29:43.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.103+0000 7f222e8c0880 20 check_secure_mon_conn(): mode 1 is insecure 2023-11-02T09:29:43.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.108+0000 7f222e8c0880 5 note: GC not initialized 2023-11-02T09:29:43.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.108+0000 7f2210031640 20 reqs_thread_entry: start 2023-11-02T09:29:43.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.108+0000 7f222e8c0880 20 init_complete bucket index max shards: 11 2023-11-02T09:29:43.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.108+0000 7f222e8c0880 20 Filter name: none 2023-11-02T09:29:43.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.108+0000 7f220e02d640 20 reqs_thread_entry: start 2023-11-02T09:29:43.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.109+0000 7f222e8c0880 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2023-11-02T09:29:43.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.109+0000 7f222e8c0880 20 rados->read ofs=0 len=0 2023-11-02T09:29:43.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.109+0000 7f222e8c0880 20 rados_obj.operate() r=-2 bl.length=0 2023-11-02T09:29:43.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.109+0000 7f222e8c0880 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2023-11-02T09:29:43.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.109+0000 7f222e8c0880 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2023-11-02T09:29:43.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.109+0000 7f222e8c0880 10 cache get: name=default.rgw.meta+users.keys+HXZDMROXJJZZSFNUKJXB : miss 2023-11-02T09:29:43.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.109+0000 7f222e8c0880 20 rados->read ofs=0 len=0 2023-11-02T09:29:43.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.109+0000 7f222e8c0880 20 rados_obj.operate() r=-2 bl.length=0 2023-11-02T09:29:43.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.109+0000 7f222e8c0880 10 cache put: name=default.rgw.meta+users.keys+HXZDMROXJJZZSFNUKJXB info.flags=0x0 2023-11-02T09:29:43.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.109+0000 7f222e8c0880 10 adding default.rgw.meta+users.keys+HXZDMROXJJZZSFNUKJXB to cache LRU end 2023-11-02T09:29:43.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.109+0000 7f222e8c0880 10 cache get: name=default.rgw.meta+users.keys+HXZDMROXJJZZSFNUKJXB : hit (negative entry) 2023-11-02T09:29:43.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.109+0000 7f222e8c0880 10 cache get: name=default.rgw.meta+users.keys+HXZDMROXJJZZSFNUKJXB : hit (negative entry) 2023-11-02T09:29:43.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.111+0000 7f222e8c0880 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2023-11-02T09:29:43.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.111+0000 7f222e8c0880 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2023-11-02T09:29:43.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.111+0000 7f222e8c0880 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2023-11-02T09:29:43.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.111+0000 7f2228061640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953472 cookie 94255806248960 notifier 4493 bl.length()=594 2023-11-02T09:29:43.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.111+0000 7f2228061640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2023-11-02T09:29:43.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.111+0000 7f2228061640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2023-11-02T09:29:43.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.113+0000 7f222e8c0880 10 cache put: name=default.rgw.meta+users.keys+HXZDMROXJJZZSFNUKJXB info.flags=0x7 2023-11-02T09:29:43.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.113+0000 7f222e8c0880 10 moving default.rgw.meta+users.keys+HXZDMROXJJZZSFNUKJXB to cache LRU end 2023-11-02T09:29:43.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.113+0000 7f222e8c0880 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:HXZDMROXJJZZSFNUKJXB, ofs0, ns] 2023-11-02T09:29:43.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.113+0000 7f2228061640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953473 cookie 94255806248960 notifier 4493 bl.length()=186 2023-11-02T09:29:43.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.113+0000 7f2228061640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+HXZDMROXJJZZSFNUKJXB info.flags=0x7 2023-11-02T09:29:43.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.113+0000 7f2228061640 10 rgw watcher librados: moving default.rgw.meta+users.keys+HXZDMROXJJZZSFNUKJXB to cache LRU end 2023-11-02T09:29:43.119 INFO:teuthology.orchestra.run.smithi156.stdout:{ 2023-11-02T09:29:43.119 INFO:teuthology.orchestra.run.smithi156.stdout: "user_id": "foo.client.0", 2023-11-02T09:29:43.119 INFO:teuthology.orchestra.run.smithi156.stdout: "display_name": "Mr. foo.client.0", 2023-11-02T09:29:43.119 INFO:teuthology.orchestra.run.smithi156.stdout: "email": "", 2023-11-02T09:29:43.119 INFO:teuthology.orchestra.run.smithi156.stdout: "suspended": 0, 2023-11-02T09:29:43.120 INFO:teuthology.orchestra.run.smithi156.stdout: "max_buckets": 1000, 2023-11-02T09:29:43.120 INFO:teuthology.orchestra.run.smithi156.stdout: "subusers": [], 2023-11-02T09:29:43.120 INFO:teuthology.orchestra.run.smithi156.stdout: "keys": [ 2023-11-02T09:29:43.120 INFO:teuthology.orchestra.run.smithi156.stdout: { 2023-11-02T09:29:43.120 INFO:teuthology.orchestra.run.smithi156.stdout: "user": "foo.client.0", 2023-11-02T09:29:43.120 INFO:teuthology.orchestra.run.smithi156.stdout: "access_key": "HXZDMROXJJZZSFNUKJXB", 2023-11-02T09:29:43.121 INFO:teuthology.orchestra.run.smithi156.stdout: "secret_key": "FuiiL+NhR9EgO9nEzwifIkdNYM1g71mxJ67Pz3WI5mlJWJO1x1Zv7g==" 2023-11-02T09:29:43.121 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-11-02T09:29:43.121 INFO:teuthology.orchestra.run.smithi156.stdout: ], 2023-11-02T09:29:43.121 INFO:teuthology.orchestra.run.smithi156.stdout: "swift_keys": [], 2023-11-02T09:29:43.121 INFO:teuthology.orchestra.run.smithi156.stdout: "caps": [], 2023-11-02T09:29:43.122 INFO:teuthology.orchestra.run.smithi156.stdout: "op_mask": "read, write, delete", 2023-11-02T09:29:43.122 INFO:teuthology.orchestra.run.smithi156.stdout: "default_placement": "", 2023-11-02T09:29:43.122 INFO:teuthology.orchestra.run.smithi156.stdout: "default_storage_class": "", 2023-11-02T09:29:43.122 INFO:teuthology.orchestra.run.smithi156.stdout: "placement_tags": [], 2023-11-02T09:29:43.122 INFO:teuthology.orchestra.run.smithi156.stdout: "bucket_quota": { 2023-11-02T09:29:43.123 INFO:teuthology.orchestra.run.smithi156.stdout: "enabled": false, 2023-11-02T09:29:43.123 INFO:teuthology.orchestra.run.smithi156.stdout: "check_on_raw": false, 2023-11-02T09:29:43.123 INFO:teuthology.orchestra.run.smithi156.stdout: "max_size": -1, 2023-11-02T09:29:43.123 INFO:teuthology.orchestra.run.smithi156.stdout: "max_size_kb": 0, 2023-11-02T09:29:43.123 INFO:teuthology.orchestra.run.smithi156.stdout: "max_objects": -1 2023-11-02T09:29:43.124 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-11-02T09:29:43.124 INFO:teuthology.orchestra.run.smithi156.stdout: "user_quota": { 2023-11-02T09:29:43.124 INFO:teuthology.orchestra.run.smithi156.stdout: "enabled": false, 2023-11-02T09:29:43.124 INFO:teuthology.orchestra.run.smithi156.stdout: "check_on_raw": false, 2023-11-02T09:29:43.125 INFO:teuthology.orchestra.run.smithi156.stdout: "max_size": -1, 2023-11-02T09:29:43.125 INFO:teuthology.orchestra.run.smithi156.stdout: "max_size_kb": 0, 2023-11-02T09:29:43.125 INFO:teuthology.orchestra.run.smithi156.stdout: "max_objects": -1 2023-11-02T09:29:43.125 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-11-02T09:29:43.125 INFO:teuthology.orchestra.run.smithi156.stdout: "temp_url_keys": [], 2023-11-02T09:29:43.126 INFO:teuthology.orchestra.run.smithi156.stdout: "type": "rgw", 2023-11-02T09:29:43.126 INFO:teuthology.orchestra.run.smithi156.stdout: "mfa_ids": [] 2023-11-02T09:29:43.126 INFO:teuthology.orchestra.run.smithi156.stdout:} 2023-11-02T09:29:43.126 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:29:43.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.114+0000 7f221483a640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-11-02T09:29:43.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.116+0000 7f222e8c0880 20 remove_watcher() i=0 2023-11-02T09:29:43.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.116+0000 7f222e8c0880 2 removed watcher, disabling cache 2023-11-02T09:29:43.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.117+0000 7f222e8c0880 20 remove_watcher() i=1 2023-11-02T09:29:43.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.118+0000 7f222e8c0880 20 remove_watcher() i=2 2023-11-02T09:29:43.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.119+0000 7f222e8c0880 20 remove_watcher() i=3 2023-11-02T09:29:43.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.120+0000 7f222e8c0880 20 remove_watcher() i=4 2023-11-02T09:29:43.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.121+0000 7f222e8c0880 20 remove_watcher() i=5 2023-11-02T09:29:43.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.122+0000 7f222e8c0880 20 remove_watcher() i=6 2023-11-02T09:29:43.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:29:43.123+0000 7f222e8c0880 20 remove_watcher() i=7 2023-11-02T09:29:43.131 INFO:tasks.notification_tests:Configuring bucket-notifications-tests... 2023-11-02T09:29:43.131 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-11-02T09:29:43.132 DEBUG:teuthology.orchestra.run.smithi156:> dd of=/home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/bn-tests.client.0.conf 2023-11-02T09:29:43.159 DEBUG:teuthology.orchestra.run.smithi156:> cd /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification && ./bootstrap 2023-11-02T09:29:48.983 INFO:teuthology.orchestra.run.smithi156.stderr:./bootstrap: missing required RPM packages. Installing via sudo. 2023-11-02T09:29:49.549 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:01:30 ago on Thu 02 Nov 2023 09:28:19 AM UTC. 2023-11-02T09:29:49.713 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-11-02T09:29:49.716 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-02T09:29:49.716 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repository Size 2023-11-02T09:29:49.716 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-02T09:29:49.717 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2023-11-02T09:29:49.717 INFO:teuthology.orchestra.run.smithi156.stdout: libevent-devel x86_64 2.1.12-6.el9 CentOS-AppStream 93 k 2023-11-02T09:29:49.717 INFO:teuthology.orchestra.run.smithi156.stdout: libxml2-devel x86_64 2.9.13-4.el9 CentOS-AppStream 828 k 2023-11-02T09:29:49.717 INFO:teuthology.orchestra.run.smithi156.stdout: libxslt-devel x86_64 1.1.34-9.el9 CentOS-AppStream 287 k 2023-11-02T09:29:49.717 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pika noarch 1.2.1-1.el9 epel 244 k 2023-11-02T09:29:49.718 INFO:teuthology.orchestra.run.smithi156.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2023-11-02T09:29:49.718 INFO:teuthology.orchestra.run.smithi156.stdout: zlib-devel x86_64 1.2.11-40.el9 appstream 45 k 2023-11-02T09:29:49.718 INFO:teuthology.orchestra.run.smithi156.stdout:Installing dependencies: 2023-11-02T09:29:49.718 INFO:teuthology.orchestra.run.smithi156.stdout: cmake-filesystem x86_64 3.20.2-8.el9 CentOS-AppStream 11 k 2023-11-02T09:29:49.718 INFO:teuthology.orchestra.run.smithi156.stdout: libgpg-error-devel x86_64 1.42-5.el9 CentOS-AppStream 65 k 2023-11-02T09:29:49.719 INFO:teuthology.orchestra.run.smithi156.stdout: python3-Automat noarch 22.10.0-2.el9 epel 59 k 2023-11-02T09:29:49.719 INFO:teuthology.orchestra.run.smithi156.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2023-11-02T09:29:49.719 INFO:teuthology.orchestra.run.smithi156.stdout: python3-constantly noarch 15.1.0-25.el9 epel 20 k 2023-11-02T09:29:49.719 INFO:teuthology.orchestra.run.smithi156.stdout: python3-hyperlink noarch 21.0.0-10.el9 epel 115 k 2023-11-02T09:29:49.719 INFO:teuthology.orchestra.run.smithi156.stdout: python3-incremental noarch 21.3.0-5.el9 epel 34 k 2023-11-02T09:29:49.719 INFO:teuthology.orchestra.run.smithi156.stdout: python3-service-identity noarch 21.1.0-5.el9 epel 27 k 2023-11-02T09:29:49.720 INFO:teuthology.orchestra.run.smithi156.stdout: python3-zope-interface x86_64 5.4.0-5.el9.1 epel 168 k 2023-11-02T09:29:49.720 INFO:teuthology.orchestra.run.smithi156.stdout: xz-devel x86_64 5.2.5-8.el9 CentOS-AppStream 52 k 2023-11-02T09:29:49.720 INFO:teuthology.orchestra.run.smithi156.stdout:Installing weak dependencies: 2023-11-02T09:29:49.720 INFO:teuthology.orchestra.run.smithi156.stdout: python3-tornado x86_64 6.1.0-9.el9 appstream 698 k 2023-11-02T09:29:49.720 INFO:teuthology.orchestra.run.smithi156.stdout: python3-twisted noarch 22.10.0-3.el9 epel 5.1 M 2023-11-02T09:29:49.721 INFO:teuthology.orchestra.run.smithi156.stdout: python3-twisted+tls noarch 22.10.0-3.el9 epel 9.4 k 2023-11-02T09:29:49.721 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:29:49.721 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-11-02T09:29:49.721 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-02T09:29:49.722 INFO:teuthology.orchestra.run.smithi156.stdout:Install 19 Packages 2023-11-02T09:29:49.722 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:29:49.722 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 7.9 M 2023-11-02T09:29:49.723 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 47 M 2023-11-02T09:29:49.723 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-11-02T09:29:50.336 INFO:teuthology.orchestra.run.smithi156.stdout:(1/19): cmake-filesystem-3.20.2-8.el9.x86_64.rp 86 kB/s | 11 kB 00:00 2023-11-02T09:29:50.361 INFO:teuthology.orchestra.run.smithi156.stdout:(2/19): libgpg-error-devel-1.42-5.el9.x86_64.rp 416 kB/s | 65 kB 00:00 2023-11-02T09:29:50.394 INFO:teuthology.orchestra.run.smithi156.stdout:(3/19): libevent-devel-2.1.12-6.el9.x86_64.rpm 486 kB/s | 93 kB 00:00 2023-11-02T09:29:50.470 INFO:teuthology.orchestra.run.smithi156.stdout:(4/19): libxml2-devel-2.9.13-4.el9.x86_64.rpm 6.0 MB/s | 828 kB 00:00 2023-11-02T09:29:50.495 INFO:teuthology.orchestra.run.smithi156.stdout:(5/19): libxslt-devel-1.1.34-9.el9.x86_64.rpm 2.1 MB/s | 287 kB 00:00 2023-11-02T09:29:50.520 INFO:teuthology.orchestra.run.smithi156.stdout:(6/19): python3-attrs-20.3.0-7.el9.noarch.rpm 619 kB/s | 78 kB 00:00 2023-11-02T09:29:50.546 INFO:teuthology.orchestra.run.smithi156.stdout:(7/19): xz-devel-5.2.5-8.el9.x86_64.rpm 694 kB/s | 52 kB 00:00 2023-11-02T09:29:50.663 INFO:teuthology.orchestra.run.smithi156.stdout:(8/19): zlib-devel-1.2.11-40.el9.x86_64.rpm 318 kB/s | 45 kB 00:00 2023-11-02T09:29:50.788 INFO:teuthology.orchestra.run.smithi156.stdout:(9/19): python3-Automat-22.10.0-2.el9.noarch.rp 243 kB/s | 59 kB 00:00 2023-11-02T09:29:50.830 INFO:teuthology.orchestra.run.smithi156.stdout:(10/19): python3-constantly-15.1.0-25.el9.noarc 118 kB/s | 20 kB 00:00 2023-11-02T09:29:50.855 INFO:teuthology.orchestra.run.smithi156.stdout:(11/19): python3-tornado-6.1.0-9.el9.x86_64.rpm 2.0 MB/s | 698 kB 00:00 2023-11-02T09:29:50.897 INFO:teuthology.orchestra.run.smithi156.stdout:(12/19): python3-incremental-21.3.0-5.el9.noarc 512 kB/s | 34 kB 00:00 2023-11-02T09:29:50.947 INFO:teuthology.orchestra.run.smithi156.stdout:(13/19): python3-service-identity-21.1.0-5.el9. 529 kB/s | 27 kB 00:00 2023-11-02T09:29:50.997 INFO:teuthology.orchestra.run.smithi156.stdout:(14/19): python3-twisted+tls-22.10.0-3.el9.noar 190 kB/s | 9.4 kB 00:00 2023-11-02T09:29:51.023 INFO:teuthology.orchestra.run.smithi156.stdout:(15/19): python3-hyperlink-21.0.0-10.el9.noarch 490 kB/s | 115 kB 00:00 2023-11-02T09:29:51.073 INFO:teuthology.orchestra.run.smithi156.stdout:(16/19): python3-xmltodict-0.12.0-15.el9.noarch 441 kB/s | 22 kB 00:00 2023-11-02T09:29:51.165 INFO:teuthology.orchestra.run.smithi156.stdout:(17/19): python3-zope-interface-5.4.0-5.el9.1.x 1.8 MB/s | 168 kB 00:00 2023-11-02T09:29:51.340 INFO:teuthology.orchestra.run.smithi156.stdout:(18/19): python3-pika-1.2.1-1.el9.noarch.rpm 504 kB/s | 244 kB 00:00 2023-11-02T09:29:51.774 INFO:teuthology.orchestra.run.smithi156.stdout:(19/19): python3-twisted-22.10.0-3.el9.noarch.r 6.6 MB/s | 5.1 MB 00:00 2023-11-02T09:29:51.776 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-11-02T09:29:51.776 INFO:teuthology.orchestra.run.smithi156.stdout:Total 3.8 MB/s | 7.9 MB 00:02 2023-11-02T09:29:51.805 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-11-02T09:29:51.825 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-11-02T09:29:51.826 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-11-02T09:29:52.095 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-11-02T09:29:52.096 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-11-02T09:29:53.002 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-11-02T09:29:53.085 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 1/19 2023-11-02T09:29:53.119 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-Automat-22.10.0-2.el9.noarch 2/19 2023-11-02T09:29:53.177 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-service-identity-21.1.0-5.el9.noarch 3/19 2023-11-02T09:29:53.213 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-zope-interface-5.4.0-5.el9.1.x86_64 4/19 2023-11-02T09:29:53.257 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-incremental-21.3.0-5.el9.noarch 5/19 2023-11-02T09:29:53.292 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-hyperlink-21.0.0-10.el9.noarch 6/19 2023-11-02T09:29:53.321 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-constantly-15.1.0-25.el9.noarch 7/19 2023-11-02T09:29:54.348 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-twisted+tls-22.10.0-3.el9.noarch 8/19 2023-11-02T09:29:54.422 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-twisted-22.10.0-3.el9.noarch 9/19 2023-11-02T09:29:54.552 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 10/19 2023-11-02T09:29:54.590 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-tornado-6.1.0-9.el9.x86_64 11/19 2023-11-02T09:29:54.623 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : xz-devel-5.2.5-8.el9.x86_64 12/19 2023-11-02T09:29:54.652 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libgpg-error-devel-1.42-5.el9.x86_64 13/19 2023-11-02T09:29:54.865 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : cmake-filesystem-3.20.2-8.el9.x86_64 14/19 2023-11-02T09:29:54.962 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libxml2-devel-2.9.13-4.el9.x86_64 15/19 2023-11-02T09:29:55.037 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libxslt-devel-1.1.34-9.el9.x86_64 16/19 2023-11-02T09:29:55.073 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pika-1.2.1-1.el9.noarch 17/19 2023-11-02T09:29:55.118 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 18/19 2023-11-02T09:29:55.204 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libevent-devel-2.1.12-6.el9.x86_64 19/19 2023-11-02T09:29:58.524 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libevent-devel-2.1.12-6.el9.x86_64 19/19 2023-11-02T09:29:58.524 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : cmake-filesystem-3.20.2-8.el9.x86_64 1/19 2023-11-02T09:29:58.524 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libevent-devel-2.1.12-6.el9.x86_64 2/19 2023-11-02T09:29:58.525 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libgpg-error-devel-1.42-5.el9.x86_64 3/19 2023-11-02T09:29:58.525 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libxml2-devel-2.9.13-4.el9.x86_64 4/19 2023-11-02T09:29:58.525 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libxslt-devel-1.1.34-9.el9.x86_64 5/19 2023-11-02T09:29:58.525 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 6/19 2023-11-02T09:29:58.525 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : xz-devel-5.2.5-8.el9.x86_64 7/19 2023-11-02T09:29:58.526 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-tornado-6.1.0-9.el9.x86_64 8/19 2023-11-02T09:29:58.526 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 9/19 2023-11-02T09:29:58.526 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-Automat-22.10.0-2.el9.noarch 10/19 2023-11-02T09:29:58.526 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-constantly-15.1.0-25.el9.noarch 11/19 2023-11-02T09:29:58.526 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-hyperlink-21.0.0-10.el9.noarch 12/19 2023-11-02T09:29:58.527 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-incremental-21.3.0-5.el9.noarch 13/19 2023-11-02T09:29:58.527 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pika-1.2.1-1.el9.noarch 14/19 2023-11-02T09:29:58.527 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-service-identity-21.1.0-5.el9.noarch 15/19 2023-11-02T09:29:58.527 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-twisted+tls-22.10.0-3.el9.noarch 16/19 2023-11-02T09:29:58.527 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-twisted-22.10.0-3.el9.noarch 17/19 2023-11-02T09:29:58.527 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 18/19 2023-11-02T09:29:59.154 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-zope-interface-5.4.0-5.el9.1.x86_64 19/19 2023-11-02T09:29:59.155 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:29:59.155 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-11-02T09:29:59.155 INFO:teuthology.orchestra.run.smithi156.stdout: cmake-filesystem-3.20.2-8.el9.x86_64 2023-11-02T09:29:59.156 INFO:teuthology.orchestra.run.smithi156.stdout: libevent-devel-2.1.12-6.el9.x86_64 2023-11-02T09:29:59.156 INFO:teuthology.orchestra.run.smithi156.stdout: libgpg-error-devel-1.42-5.el9.x86_64 2023-11-02T09:29:59.156 INFO:teuthology.orchestra.run.smithi156.stdout: libxml2-devel-2.9.13-4.el9.x86_64 2023-11-02T09:29:59.156 INFO:teuthology.orchestra.run.smithi156.stdout: libxslt-devel-1.1.34-9.el9.x86_64 2023-11-02T09:29:59.156 INFO:teuthology.orchestra.run.smithi156.stdout: python3-Automat-22.10.0-2.el9.noarch 2023-11-02T09:29:59.157 INFO:teuthology.orchestra.run.smithi156.stdout: python3-attrs-20.3.0-7.el9.noarch 2023-11-02T09:29:59.157 INFO:teuthology.orchestra.run.smithi156.stdout: python3-constantly-15.1.0-25.el9.noarch 2023-11-02T09:29:59.157 INFO:teuthology.orchestra.run.smithi156.stdout: python3-hyperlink-21.0.0-10.el9.noarch 2023-11-02T09:29:59.157 INFO:teuthology.orchestra.run.smithi156.stdout: python3-incremental-21.3.0-5.el9.noarch 2023-11-02T09:29:59.157 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pika-1.2.1-1.el9.noarch 2023-11-02T09:29:59.157 INFO:teuthology.orchestra.run.smithi156.stdout: python3-service-identity-21.1.0-5.el9.noarch 2023-11-02T09:29:59.158 INFO:teuthology.orchestra.run.smithi156.stdout: python3-tornado-6.1.0-9.el9.x86_64 2023-11-02T09:29:59.158 INFO:teuthology.orchestra.run.smithi156.stdout: python3-twisted-22.10.0-3.el9.noarch 2023-11-02T09:29:59.158 INFO:teuthology.orchestra.run.smithi156.stdout: python3-twisted+tls-22.10.0-3.el9.noarch 2023-11-02T09:29:59.158 INFO:teuthology.orchestra.run.smithi156.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2023-11-02T09:29:59.158 INFO:teuthology.orchestra.run.smithi156.stdout: python3-zope-interface-5.4.0-5.el9.1.x86_64 2023-11-02T09:29:59.159 INFO:teuthology.orchestra.run.smithi156.stdout: xz-devel-5.2.5-8.el9.x86_64 2023-11-02T09:29:59.159 INFO:teuthology.orchestra.run.smithi156.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-11-02T09:29:59.159 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:29:59.159 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-11-02T09:30:02.376 INFO:teuthology.orchestra.run.smithi156.stdout:Requirement already satisfied: pip in ./virtualenv/lib/python3.9/site-packages (21.2.3) 2023-11-02T09:30:02.597 INFO:teuthology.orchestra.run.smithi156.stdout:Collecting pip 2023-11-02T09:30:02.690 INFO:teuthology.orchestra.run.smithi156.stdout: Downloading pip-23.3.1-py3-none-any.whl (2.1 MB) 2023-11-02T09:30:03.137 INFO:teuthology.orchestra.run.smithi156.stdout:Installing collected packages: pip 2023-11-02T09:30:03.137 INFO:teuthology.orchestra.run.smithi156.stdout: Attempting uninstall: pip 2023-11-02T09:30:03.137 INFO:teuthology.orchestra.run.smithi156.stdout: Found existing installation: pip 21.2.3 2023-11-02T09:30:03.314 INFO:teuthology.orchestra.run.smithi156.stdout: Uninstalling pip-21.2.3: 2023-11-02T09:30:03.320 INFO:teuthology.orchestra.run.smithi156.stdout: Successfully uninstalled pip-21.2.3 2023-11-02T09:30:04.296 INFO:teuthology.orchestra.run.smithi156.stdout:Successfully installed pip-23.3.1 2023-11-02T09:30:05.039 INFO:teuthology.orchestra.run.smithi156.stdout:Collecting nose>=1.0.0 (from -r requirements.txt (line 1)) 2023-11-02T09:30:05.115 INFO:teuthology.orchestra.run.smithi156.stdout: Downloading nose-1.3.7-py3-none-any.whl (154 kB) 2023-11-02T09:30:05.202 INFO:teuthology.orchestra.run.smithi156.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 154.7/154.7 kB 1.7 MB/s eta 0:00:00 2023-11-02T09:30:05.305 INFO:teuthology.orchestra.run.smithi156.stdout:Collecting boto>=2.6.0 (from -r requirements.txt (line 2)) 2023-11-02T09:30:05.324 INFO:teuthology.orchestra.run.smithi156.stdout: Downloading boto-2.49.0-py2.py3-none-any.whl (1.4 MB) 2023-11-02T09:30:05.428 INFO:teuthology.orchestra.run.smithi156.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.4/1.4 MB 13.3 MB/s eta 0:00:00 2023-11-02T09:30:05.972 INFO:teuthology.orchestra.run.smithi156.stdout:Collecting boto3>=1.0.0 (from -r requirements.txt (line 3)) 2023-11-02T09:30:06.010 INFO:teuthology.orchestra.run.smithi156.stdout: Downloading boto3-1.28.76-py3-none-any.whl.metadata (6.7 kB) 2023-11-02T09:30:06.159 INFO:teuthology.orchestra.run.smithi156.stdout:Collecting configparser>=5.0.0 (from -r requirements.txt (line 4)) 2023-11-02T09:30:06.191 INFO:teuthology.orchestra.run.smithi156.stdout: Downloading configparser-6.0.0-py3-none-any.whl.metadata (11 kB) 2023-11-02T09:30:06.377 INFO:teuthology.orchestra.run.smithi156.stdout:Collecting kafka-python>=2.0.0 (from -r requirements.txt (line 5)) 2023-11-02T09:30:06.394 INFO:teuthology.orchestra.run.smithi156.stdout: Downloading kafka_python-2.0.2-py2.py3-none-any.whl (246 kB) 2023-11-02T09:30:06.440 INFO:teuthology.orchestra.run.smithi156.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 246.5/246.5 kB 5.4 MB/s eta 0:00:00 2023-11-02T09:30:06.442 INFO:teuthology.orchestra.run.smithi156.stdout:Requirement already satisfied: pika in /usr/lib/python3.9/site-packages (from -r requirements.txt (line 6)) (1.2.1) 2023-11-02T09:30:06.511 INFO:teuthology.orchestra.run.smithi156.stdout:Collecting pika (from -r requirements.txt (line 6)) 2023-11-02T09:30:06.529 INFO:teuthology.orchestra.run.smithi156.stdout: Downloading pika-1.3.2-py3-none-any.whl (155 kB) 2023-11-02T09:30:06.583 INFO:teuthology.orchestra.run.smithi156.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 155.4/155.4 kB 2.8 MB/s eta 0:00:00 2023-11-02T09:30:06.660 INFO:teuthology.orchestra.run.smithi156.stdout:Collecting cloudevents (from -r requirements.txt (line 7)) 2023-11-02T09:30:06.678 INFO:teuthology.orchestra.run.smithi156.stdout: Downloading cloudevents-1.10.1-py3-none-any.whl.metadata (6.9 kB) 2023-11-02T09:30:06.725 INFO:teuthology.orchestra.run.smithi156.stdout:Requirement already satisfied: xmltodict in /usr/lib/python3.9/site-packages (from -r requirements.txt (line 8)) (0.12.0) 2023-11-02T09:30:06.801 INFO:teuthology.orchestra.run.smithi156.stdout:Collecting xmltodict (from -r requirements.txt (line 8)) 2023-11-02T09:30:06.818 INFO:teuthology.orchestra.run.smithi156.stdout: Downloading xmltodict-0.13.0-py2.py3-none-any.whl (10.0 kB) 2023-11-02T09:30:07.401 INFO:teuthology.orchestra.run.smithi156.stdout:Collecting botocore<1.32.0,>=1.31.76 (from boto3>=1.0.0->-r requirements.txt (line 3)) 2023-11-02T09:30:07.418 INFO:teuthology.orchestra.run.smithi156.stdout: Downloading botocore-1.31.76-py3-none-any.whl.metadata (6.1 kB) 2023-11-02T09:30:07.547 INFO:teuthology.orchestra.run.smithi156.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3>=1.0.0->-r requirements.txt (line 3)) 2023-11-02T09:30:07.568 INFO:teuthology.orchestra.run.smithi156.stdout: Downloading jmespath-1.0.1-py3-none-any.whl (20 kB) 2023-11-02T09:30:07.709 INFO:teuthology.orchestra.run.smithi156.stdout:Collecting s3transfer<0.8.0,>=0.7.0 (from boto3>=1.0.0->-r requirements.txt (line 3)) 2023-11-02T09:30:07.727 INFO:teuthology.orchestra.run.smithi156.stdout: Downloading s3transfer-0.7.0-py3-none-any.whl.metadata (1.8 kB) 2023-11-02T09:30:07.840 INFO:teuthology.orchestra.run.smithi156.stdout:Collecting deprecation<3.0,>=2.0 (from cloudevents->-r requirements.txt (line 7)) 2023-11-02T09:30:07.857 INFO:teuthology.orchestra.run.smithi156.stdout: Downloading deprecation-2.1.0-py2.py3-none-any.whl (11 kB) 2023-11-02T09:30:07.906 INFO:teuthology.orchestra.run.smithi156.stdout:Requirement already satisfied: python-dateutil<3.0.0,>=2.1 in /usr/lib/python3.9/site-packages (from botocore<1.32.0,>=1.31.76->boto3>=1.0.0->-r requirements.txt (line 3)) (2.8.1) 2023-11-02T09:30:07.907 INFO:teuthology.orchestra.run.smithi156.stdout:Requirement already satisfied: urllib3<1.27,>=1.25.4 in /usr/lib/python3.9/site-packages (from botocore<1.32.0,>=1.31.76->boto3>=1.0.0->-r requirements.txt (line 3)) (1.26.5) 2023-11-02T09:30:07.995 INFO:teuthology.orchestra.run.smithi156.stdout:Collecting packaging (from deprecation<3.0,>=2.0->cloudevents->-r requirements.txt (line 7)) 2023-11-02T09:30:08.012 INFO:teuthology.orchestra.run.smithi156.stdout: Downloading packaging-23.2-py3-none-any.whl.metadata (3.2 kB) 2023-11-02T09:30:08.164 INFO:teuthology.orchestra.run.smithi156.stdout:Requirement already satisfied: six>=1.5 in /usr/lib/python3.9/site-packages (from python-dateutil<3.0.0,>=2.1->botocore<1.32.0,>=1.31.76->boto3>=1.0.0->-r requirements.txt (line 3)) (1.15.0) 2023-11-02T09:30:08.190 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading boto3-1.28.76-py3-none-any.whl (135 kB) 2023-11-02T09:30:08.250 INFO:teuthology.orchestra.run.smithi156.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 135.8/135.8 kB 2.2 MB/s eta 0:00:00 2023-11-02T09:30:08.267 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading configparser-6.0.0-py3-none-any.whl (19 kB) 2023-11-02T09:30:08.334 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading cloudevents-1.10.1-py3-none-any.whl (55 kB) 2023-11-02T09:30:08.385 INFO:teuthology.orchestra.run.smithi156.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 55.0/55.0 kB 920.3 kB/s eta 0:00:00 2023-11-02T09:30:08.408 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading botocore-1.31.76-py3-none-any.whl (11.3 MB) 2023-11-02T09:30:08.654 INFO:teuthology.orchestra.run.smithi156.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11.3/11.3 MB 43.3 MB/s eta 0:00:00 2023-11-02T09:30:08.671 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading s3transfer-0.7.0-py3-none-any.whl (79 kB) 2023-11-02T09:30:08.744 INFO:teuthology.orchestra.run.smithi156.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 79.8/79.8 kB 972.5 kB/s eta 0:00:00 2023-11-02T09:30:08.762 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading packaging-23.2-py3-none-any.whl (53 kB) 2023-11-02T09:30:08.812 INFO:teuthology.orchestra.run.smithi156.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 53.0/53.0 kB 878.0 kB/s eta 0:00:00 2023-11-02T09:30:09.198 INFO:teuthology.orchestra.run.smithi156.stdout:Installing collected packages: nose, kafka-python, boto, xmltodict, pika, packaging, jmespath, configparser, deprecation, botocore, s3transfer, cloudevents, boto3 2023-11-02T09:30:10.059 INFO:teuthology.orchestra.run.smithi156.stdout: Attempting uninstall: xmltodict 2023-11-02T09:30:10.060 INFO:teuthology.orchestra.run.smithi156.stdout: Found existing installation: xmltodict 0.12.0 2023-11-02T09:30:10.061 INFO:teuthology.orchestra.run.smithi156.stdout: Not uninstalling xmltodict at /usr/lib/python3.9/site-packages, outside environment /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/virtualenv 2023-11-02T09:30:10.061 INFO:teuthology.orchestra.run.smithi156.stdout: Can't uninstall 'xmltodict'. No files were found to uninstall. 2023-11-02T09:30:10.117 INFO:teuthology.orchestra.run.smithi156.stdout: Attempting uninstall: pika 2023-11-02T09:30:10.118 INFO:teuthology.orchestra.run.smithi156.stdout: Found existing installation: pika 1.2.1 2023-11-02T09:30:10.119 INFO:teuthology.orchestra.run.smithi156.stdout: Not uninstalling pika at /usr/lib/python3.9/site-packages, outside environment /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/virtualenv 2023-11-02T09:30:10.119 INFO:teuthology.orchestra.run.smithi156.stdout: Can't uninstall 'pika'. No files were found to uninstall. 2023-11-02T09:30:11.499 INFO:teuthology.orchestra.run.smithi156.stdout:Successfully installed boto-2.49.0 boto3-1.28.76 botocore-1.31.76 cloudevents-1.10.1 configparser-6.0.0 deprecation-2.1.0 jmespath-1.0.1 kafka-python-2.0.2 nose-1.3.7 packaging-23.2 pika-1.3.2 s3transfer-0.7.0 xmltodict-0.13.0 2023-11-02T09:30:11.845 INFO:teuthology.orchestra.run.smithi156.stdout:running develop 2023-11-02T09:30:11.924 INFO:teuthology.orchestra.run.smithi156.stdout:running egg_info 2023-11-02T09:30:11.924 INFO:teuthology.orchestra.run.smithi156.stdout:creating bn_tests.egg-info 2023-11-02T09:30:11.924 INFO:teuthology.orchestra.run.smithi156.stdout:writing bn_tests.egg-info/PKG-INFO 2023-11-02T09:30:11.924 INFO:teuthology.orchestra.run.smithi156.stdout:writing dependency_links to bn_tests.egg-info/dependency_links.txt 2023-11-02T09:30:11.925 INFO:teuthology.orchestra.run.smithi156.stdout:writing requirements to bn_tests.egg-info/requires.txt 2023-11-02T09:30:11.925 INFO:teuthology.orchestra.run.smithi156.stdout:writing top-level names to bn_tests.egg-info/top_level.txt 2023-11-02T09:30:11.925 INFO:teuthology.orchestra.run.smithi156.stdout:writing manifest file 'bn_tests.egg-info/SOURCES.txt' 2023-11-02T09:30:11.926 INFO:teuthology.orchestra.run.smithi156.stdout:reading manifest file 'bn_tests.egg-info/SOURCES.txt' 2023-11-02T09:30:11.926 INFO:teuthology.orchestra.run.smithi156.stdout:writing manifest file 'bn_tests.egg-info/SOURCES.txt' 2023-11-02T09:30:11.943 INFO:teuthology.orchestra.run.smithi156.stdout:running build_ext 2023-11-02T09:30:11.951 INFO:teuthology.orchestra.run.smithi156.stdout:Creating /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/virtualenv/lib/python3.9/site-packages/bn-tests.egg-link (link to .) 2023-11-02T09:30:11.951 INFO:teuthology.orchestra.run.smithi156.stdout:Adding bn-tests 0.0.1 to easy-install.pth file 2023-11-02T09:30:11.952 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:30:11.952 INFO:teuthology.orchestra.run.smithi156.stdout:Installed /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification 2023-11-02T09:30:11.953 INFO:teuthology.orchestra.run.smithi156.stdout:Processing dependencies for bn-tests==0.0.1 2023-11-02T09:30:11.967 INFO:teuthology.orchestra.run.smithi156.stdout:Searching for boto3==1.28.76 2023-11-02T09:30:11.967 INFO:teuthology.orchestra.run.smithi156.stdout:Best match: boto3 1.28.76 2023-11-02T09:30:11.967 INFO:teuthology.orchestra.run.smithi156.stdout:Adding boto3 1.28.76 to easy-install.pth file 2023-11-02T09:30:11.967 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:30:11.968 INFO:teuthology.orchestra.run.smithi156.stdout:Using /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/virtualenv/lib/python3.9/site-packages 2023-11-02T09:30:11.972 INFO:teuthology.orchestra.run.smithi156.stdout:Searching for boto==2.49.0 2023-11-02T09:30:11.972 INFO:teuthology.orchestra.run.smithi156.stdout:Best match: boto 2.49.0 2023-11-02T09:30:11.972 INFO:teuthology.orchestra.run.smithi156.stdout:Adding boto 2.49.0 to easy-install.pth file 2023-11-02T09:30:11.973 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:30:11.973 INFO:teuthology.orchestra.run.smithi156.stdout:Using /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/virtualenv/lib/python3.9/site-packages 2023-11-02T09:30:11.973 INFO:teuthology.orchestra.run.smithi156.stdout:Searching for botocore==1.31.76 2023-11-02T09:30:11.973 INFO:teuthology.orchestra.run.smithi156.stdout:Best match: botocore 1.31.76 2023-11-02T09:30:11.974 INFO:teuthology.orchestra.run.smithi156.stdout:Adding botocore 1.31.76 to easy-install.pth file 2023-11-02T09:30:11.974 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:30:11.974 INFO:teuthology.orchestra.run.smithi156.stdout:Using /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/virtualenv/lib/python3.9/site-packages 2023-11-02T09:30:11.974 INFO:teuthology.orchestra.run.smithi156.stdout:Searching for s3transfer==0.7.0 2023-11-02T09:30:11.974 INFO:teuthology.orchestra.run.smithi156.stdout:Best match: s3transfer 0.7.0 2023-11-02T09:30:11.975 INFO:teuthology.orchestra.run.smithi156.stdout:Adding s3transfer 0.7.0 to easy-install.pth file 2023-11-02T09:30:11.975 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:30:11.975 INFO:teuthology.orchestra.run.smithi156.stdout:Using /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/virtualenv/lib/python3.9/site-packages 2023-11-02T09:30:11.975 INFO:teuthology.orchestra.run.smithi156.stdout:Searching for jmespath==1.0.1 2023-11-02T09:30:11.975 INFO:teuthology.orchestra.run.smithi156.stdout:Best match: jmespath 1.0.1 2023-11-02T09:30:11.975 INFO:teuthology.orchestra.run.smithi156.stdout:Adding jmespath 1.0.1 to easy-install.pth file 2023-11-02T09:30:11.976 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:30:11.976 INFO:teuthology.orchestra.run.smithi156.stdout:Using /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/virtualenv/lib/python3.9/site-packages 2023-11-02T09:30:11.976 INFO:teuthology.orchestra.run.smithi156.stdout:Searching for python-dateutil==2.8.1 2023-11-02T09:30:11.976 INFO:teuthology.orchestra.run.smithi156.stdout:Best match: python-dateutil 2.8.1 2023-11-02T09:30:11.976 INFO:teuthology.orchestra.run.smithi156.stdout:Adding python-dateutil 2.8.1 to easy-install.pth file 2023-11-02T09:30:11.977 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:30:11.977 INFO:teuthology.orchestra.run.smithi156.stdout:Using /usr/lib/python3.9/site-packages 2023-11-02T09:30:11.981 INFO:teuthology.orchestra.run.smithi156.stdout:Searching for urllib3==1.26.5 2023-11-02T09:30:11.981 INFO:teuthology.orchestra.run.smithi156.stdout:Best match: urllib3 1.26.5 2023-11-02T09:30:11.982 INFO:teuthology.orchestra.run.smithi156.stdout:Adding urllib3 1.26.5 to easy-install.pth file 2023-11-02T09:30:11.982 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:30:11.982 INFO:teuthology.orchestra.run.smithi156.stdout:Using /usr/lib/python3.9/site-packages 2023-11-02T09:30:11.983 INFO:teuthology.orchestra.run.smithi156.stdout:Searching for six==1.15.0 2023-11-02T09:30:11.983 INFO:teuthology.orchestra.run.smithi156.stdout:Best match: six 1.15.0 2023-11-02T09:30:11.983 INFO:teuthology.orchestra.run.smithi156.stdout:Adding six 1.15.0 to easy-install.pth file 2023-11-02T09:30:11.984 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:30:11.984 INFO:teuthology.orchestra.run.smithi156.stdout:Using /usr/lib/python3.9/site-packages 2023-11-02T09:30:11.984 INFO:teuthology.orchestra.run.smithi156.stdout:Finished processing dependencies for bn-tests==0.0.1 2023-11-02T09:30:12.002 INFO:tasks.notification_tests:Running bucket-notifications-tests... 2023-11-02T09:30:12.002 DEBUG:teuthology.orchestra.run.smithi156:bucket notification tests against different endpoints> BNTESTS_CONF=/home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/bn-tests.client.0.conf /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/virtualenv/bin/python -m nose -s /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/test_bn.py -v -a amqp_test 2023-11-02T09:30:21.725 INFO:teuthology.orchestra.run.smithi156.stderr:test s3 notification filter on master ... ok 2023-11-02T09:30:34.609 INFO:teuthology.orchestra.run.smithi156.stderr:test pushing amqp s3 notification on master ... ok 2023-11-02T09:30:41.693 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn.test_ps_s3_creation_triggers_on_master ... ok 2023-11-02T09:30:41.995 INFO:teuthology.orchestra.run.smithi156.stderr:test that uploads object using HTTP POST ... ok 2023-11-02T09:30:47.674 INFO:teuthology.orchestra.run.smithi156.stderr:test multipart object upload on master ... ok 2023-11-02T09:30:59.405 INFO:teuthology.orchestra.run.smithi156.stderr:test s3 notification of metadata on master ... ok 2023-11-02T09:31:11.324 INFO:teuthology.orchestra.run.smithi156.stderr:test s3 notification of metadata on master ... ok 2023-11-02T09:31:23.042 INFO:teuthology.orchestra.run.smithi156.stderr:test s3 notification of tags on master ... ok 2023-11-02T09:31:28.780 INFO:teuthology.orchestra.run.smithi156.stderr:test s3 notification of object versions ... ok 2023-11-02T09:31:36.517 INFO:teuthology.orchestra.run.smithi156.stdout:send: b'GET /uicwqr-1?notification=uicwqr-1_notif_4 HTTP/1.1\r\nAccept-Encoding: identity\r\nContent-Length: 0\r\nAuthorization: AWS HXZDMROXJJZZSFNUKJXB:fNYHD5rFH+rOUeOCIMMfOjbxrnA=\r\nDate: Thu, 02 Nov 2023 09:30:12 +0000\r\nHost: smithi156.front.sepia.ceph.com:80\r\n\r\n' 2023-11-02T09:31:36.517 INFO:teuthology.orchestra.run.smithi156.stdout:Zero length chunk ignored 2023-11-02T09:31:36.517 INFO:teuthology.orchestra.run.smithi156.stdout:reply: 'HTTP/1.1 200 OK\r\n' 2023-11-02T09:31:36.518 INFO:teuthology.orchestra.run.smithi156.stdout:header: x-amz-request-id: tx00000d9401f449c8cc847-0065436c24-117b-default 2023-11-02T09:31:36.518 INFO:teuthology.orchestra.run.smithi156.stdout:header: Content-Type: application/xml 2023-11-02T09:31:36.518 INFO:teuthology.orchestra.run.smithi156.stdout:header: Server: Ceph Object Gateway (reef) 2023-11-02T09:31:36.518 INFO:teuthology.orchestra.run.smithi156.stdout:header: Content-Length: 504 2023-11-02T09:31:36.518 INFO:teuthology.orchestra.run.smithi156.stdout:header: Date: Thu, 02 Nov 2023 09:30:12 GMT 2023-11-02T09:31:36.519 INFO:teuthology.orchestra.run.smithi156.stdout:header: Connection: Keep-Alive 2023-11-02T09:31:36.519 INFO:teuthology.orchestra.run.smithi156.stdout:wait for 5sec for the messages... 2023-11-02T09:31:36.519 INFO:teuthology.orchestra.run.smithi156.stdout:send: b'DELETE /uicwqr-1?notification HTTP/1.1\r\nAccept-Encoding: identity\r\nContent-Length: 0\r\nAuthorization: AWS HXZDMROXJJZZSFNUKJXB:lPFNavYpu/3XCkHwHjPbemp/Mv8=\r\nDate: Thu, 02 Nov 2023 09:30:21 +0000\r\nHost: smithi156.front.sepia.ceph.com:80\r\n\r\n' 2023-11-02T09:31:36.519 INFO:teuthology.orchestra.run.smithi156.stdout:Zero length chunk ignored 2023-11-02T09:31:36.519 INFO:teuthology.orchestra.run.smithi156.stdout:reply: 'HTTP/1.1 200 OK\r\n' 2023-11-02T09:31:36.520 INFO:teuthology.orchestra.run.smithi156.stdout:header: x-amz-request-id: tx0000014196147cc1e4d14-0065436c2d-117b-default 2023-11-02T09:31:36.520 INFO:teuthology.orchestra.run.smithi156.stdout:header: Server: Ceph Object Gateway (reef) 2023-11-02T09:31:36.520 INFO:teuthology.orchestra.run.smithi156.stdout:header: Content-Length: 0 2023-11-02T09:31:36.520 INFO:teuthology.orchestra.run.smithi156.stdout:header: Date: Thu, 02 Nov 2023 09:30:21 GMT 2023-11-02T09:31:36.520 INFO:teuthology.orchestra.run.smithi156.stdout:header: Connection: Keep-Alive 2023-11-02T09:31:36.521 INFO:teuthology.orchestra.run.smithi156.stdout:send: b'DELETE /uicwqr-1?notification HTTP/1.1\r\nAccept-Encoding: identity\r\nContent-Length: 0\r\nAuthorization: AWS HXZDMROXJJZZSFNUKJXB:lPFNavYpu/3XCkHwHjPbemp/Mv8=\r\nDate: Thu, 02 Nov 2023 09:30:21 +0000\r\nHost: smithi156.front.sepia.ceph.com:80\r\n\r\n' 2023-11-02T09:31:36.521 INFO:teuthology.orchestra.run.smithi156.stdout:Zero length chunk ignored 2023-11-02T09:31:36.521 INFO:teuthology.orchestra.run.smithi156.stdout:reply: 'HTTP/1.1 200 OK\r\n' 2023-11-02T09:31:36.521 INFO:teuthology.orchestra.run.smithi156.stdout:header: x-amz-request-id: tx00000fa574c0509265b5d-0065436c2d-117b-default 2023-11-02T09:31:36.521 INFO:teuthology.orchestra.run.smithi156.stdout:header: Server: Ceph Object Gateway (reef) 2023-11-02T09:31:36.522 INFO:teuthology.orchestra.run.smithi156.stdout:header: Content-Length: 0 2023-11-02T09:31:36.522 INFO:teuthology.orchestra.run.smithi156.stdout:header: Date: Thu, 02 Nov 2023 09:30:21 GMT 2023-11-02T09:31:36.522 INFO:teuthology.orchestra.run.smithi156.stdout:header: Connection: Keep-Alive 2023-11-02T09:31:36.522 INFO:teuthology.orchestra.run.smithi156.stdout:average time for creation + qmqp notification is: 24.25114631652832 milliseconds 2023-11-02T09:31:36.522 INFO:teuthology.orchestra.run.smithi156.stdout:wait for 5sec for the messages... 2023-11-02T09:31:36.523 INFO:teuthology.orchestra.run.smithi156.stdout:total number of objects: 100 2023-11-02T09:31:36.523 INFO:teuthology.orchestra.run.smithi156.stdout:average time for deletion + amqp notification is: 2.8856325149536133 milliseconds 2023-11-02T09:31:36.523 INFO:teuthology.orchestra.run.smithi156.stdout:wait for 5sec for the messages... 2023-11-02T09:31:36.523 INFO:teuthology.orchestra.run.smithi156.stdout:send: b'DELETE /uicwqr-2?notification HTTP/1.1\r\nAccept-Encoding: identity\r\nContent-Length: 0\r\nAuthorization: AWS HXZDMROXJJZZSFNUKJXB:woPfkzcL0S9dUIcG3PD0nTtX5go=\r\nDate: Thu, 02 Nov 2023 09:30:34 +0000\r\nHost: smithi156.front.sepia.ceph.com:80\r\n\r\n' 2023-11-02T09:31:36.523 INFO:teuthology.orchestra.run.smithi156.stdout:Zero length chunk ignored 2023-11-02T09:31:36.524 INFO:teuthology.orchestra.run.smithi156.stdout:reply: 'HTTP/1.1 200 OK\r\n' 2023-11-02T09:31:36.524 INFO:teuthology.orchestra.run.smithi156.stdout:header: x-amz-request-id: tx0000033f392a128717e1f-0065436c3a-117b-default 2023-11-02T09:31:36.524 INFO:teuthology.orchestra.run.smithi156.stdout:header: Server: Ceph Object Gateway (reef) 2023-11-02T09:31:36.524 INFO:teuthology.orchestra.run.smithi156.stdout:header: Content-Length: 0 2023-11-02T09:31:36.524 INFO:teuthology.orchestra.run.smithi156.stdout:header: Date: Thu, 02 Nov 2023 09:30:34 GMT 2023-11-02T09:31:36.525 INFO:teuthology.orchestra.run.smithi156.stdout:header: Connection: Keep-Alive 2023-11-02T09:31:36.525 INFO:teuthology.orchestra.run.smithi156.stdout:wait for 5sec for the messages... 2023-11-02T09:31:36.525 INFO:teuthology.orchestra.run.smithi156.stdout:send: b'DELETE /uicwqr-3?notification HTTP/1.1\r\nAccept-Encoding: identity\r\nContent-Length: 0\r\nAuthorization: AWS HXZDMROXJJZZSFNUKJXB:/p7s+Ugt/eRSdwnpgIcQ0OgGHfo=\r\nDate: Thu, 02 Nov 2023 09:30:41 +0000\r\nHost: smithi156.front.sepia.ceph.com:80\r\n\r\n' 2023-11-02T09:31:36.525 INFO:teuthology.orchestra.run.smithi156.stdout:Zero length chunk ignored 2023-11-02T09:31:36.525 INFO:teuthology.orchestra.run.smithi156.stdout:reply: 'HTTP/1.1 200 OK\r\n' 2023-11-02T09:31:36.525 INFO:teuthology.orchestra.run.smithi156.stdout:header: x-amz-request-id: tx000009703656163de9920-0065436c41-117b-default 2023-11-02T09:31:36.526 INFO:teuthology.orchestra.run.smithi156.stdout:header: Server: Ceph Object Gateway (reef) 2023-11-02T09:31:36.526 INFO:teuthology.orchestra.run.smithi156.stdout:header: Content-Length: 0 2023-11-02T09:31:36.526 INFO:teuthology.orchestra.run.smithi156.stdout:header: Date: Thu, 02 Nov 2023 09:30:41 GMT 2023-11-02T09:31:36.526 INFO:teuthology.orchestra.run.smithi156.stdout:header: Connection: Keep-Alive 2023-11-02T09:31:36.526 INFO:teuthology.orchestra.run.smithi156.stdout:send: b'DELETE /uicwqr-4?notification HTTP/1.1\r\nAccept-Encoding: identity\r\nContent-Length: 0\r\nAuthorization: AWS HXZDMROXJJZZSFNUKJXB:+yvfC0oYMkm8wlS4xPbPYVkiP10=\r\nDate: Thu, 02 Nov 2023 09:30:41 +0000\r\nHost: smithi156.front.sepia.ceph.com:80\r\n\r\n' 2023-11-02T09:31:36.527 INFO:teuthology.orchestra.run.smithi156.stdout:Zero length chunk ignored 2023-11-02T09:31:36.527 INFO:teuthology.orchestra.run.smithi156.stdout:reply: 'HTTP/1.1 200 OK\r\n' 2023-11-02T09:31:36.527 INFO:teuthology.orchestra.run.smithi156.stdout:header: x-amz-request-id: tx0000088ad24bd9bdbef03-0065436c41-117b-default 2023-11-02T09:31:36.527 INFO:teuthology.orchestra.run.smithi156.stdout:header: Server: Ceph Object Gateway (reef) 2023-11-02T09:31:36.527 INFO:teuthology.orchestra.run.smithi156.stdout:header: Content-Length: 0 2023-11-02T09:31:36.528 INFO:teuthology.orchestra.run.smithi156.stdout:header: Date: Thu, 02 Nov 2023 09:30:41 GMT 2023-11-02T09:31:36.528 INFO:teuthology.orchestra.run.smithi156.stdout:header: Connection: Keep-Alive 2023-11-02T09:31:36.528 INFO:teuthology.orchestra.run.smithi156.stdout:wait for 5sec for the messages... 2023-11-02T09:31:36.529 INFO:teuthology.orchestra.run.smithi156.stdout:send: b'DELETE /uicwqr-5?notification HTTP/1.1\r\nAccept-Encoding: identity\r\nContent-Length: 0\r\nAuthorization: AWS HXZDMROXJJZZSFNUKJXB:NsDMibBSNMoNG3DlKKqgHGKbiYQ=\r\nDate: Thu, 02 Nov 2023 09:30:47 +0000\r\nHost: smithi156.front.sepia.ceph.com:80\r\n\r\n' 2023-11-02T09:31:36.530 INFO:teuthology.orchestra.run.smithi156.stdout:Zero length chunk ignored 2023-11-02T09:31:36.530 INFO:teuthology.orchestra.run.smithi156.stdout:reply: 'HTTP/1.1 200 OK\r\n' 2023-11-02T09:31:36.531 INFO:teuthology.orchestra.run.smithi156.stdout:header: x-amz-request-id: tx00000a93e51194f85f703-0065436c47-117b-default 2023-11-02T09:31:36.531 INFO:teuthology.orchestra.run.smithi156.stdout:header: Server: Ceph Object Gateway (reef) 2023-11-02T09:31:36.532 INFO:teuthology.orchestra.run.smithi156.stdout:header: Content-Length: 0 2023-11-02T09:31:36.532 INFO:teuthology.orchestra.run.smithi156.stdout:header: Date: Thu, 02 Nov 2023 09:30:47 GMT 2023-11-02T09:31:36.532 INFO:teuthology.orchestra.run.smithi156.stdout:header: Connection: Keep-Alive 2023-11-02T09:31:36.533 INFO:teuthology.orchestra.run.smithi156.stdout:wait for 5sec for the messages... 2023-11-02T09:31:36.533 INFO:teuthology.orchestra.run.smithi156.stdout:wait for 5sec for the messages... 2023-11-02T09:31:36.533 INFO:teuthology.orchestra.run.smithi156.stdout:send: b'DELETE /uicwqr-6?notification HTTP/1.1\r\nAccept-Encoding: identity\r\nContent-Length: 0\r\nAuthorization: AWS HXZDMROXJJZZSFNUKJXB:mCSmqQZGG5Zvs4jTP8/oJkXS72I=\r\nDate: Thu, 02 Nov 2023 09:30:59 +0000\r\nHost: smithi156.front.sepia.ceph.com:80\r\n\r\n' 2023-11-02T09:31:36.533 INFO:teuthology.orchestra.run.smithi156.stdout:Zero length chunk ignored 2023-11-02T09:31:36.534 INFO:teuthology.orchestra.run.smithi156.stdout:reply: 'HTTP/1.1 200 OK\r\n' 2023-11-02T09:31:36.534 INFO:teuthology.orchestra.run.smithi156.stdout:header: x-amz-request-id: tx0000025e3087220f3711c-0065436c53-117b-default 2023-11-02T09:31:36.534 INFO:teuthology.orchestra.run.smithi156.stdout:header: Server: Ceph Object Gateway (reef) 2023-11-02T09:31:36.535 INFO:teuthology.orchestra.run.smithi156.stdout:header: Content-Length: 0 2023-11-02T09:31:36.535 INFO:teuthology.orchestra.run.smithi156.stdout:header: Date: Thu, 02 Nov 2023 09:30:59 GMT 2023-11-02T09:31:36.535 INFO:teuthology.orchestra.run.smithi156.stdout:header: Connection: Keep-Alive 2023-11-02T09:31:36.536 INFO:teuthology.orchestra.run.smithi156.stdout:wait for 5sec for the messages... 2023-11-02T09:31:36.536 INFO:teuthology.orchestra.run.smithi156.stdout:wait for 5sec for the messages... 2023-11-02T09:31:36.536 INFO:teuthology.orchestra.run.smithi156.stdout:send: b'DELETE /uicwqr-7?notification HTTP/1.1\r\nAccept-Encoding: identity\r\nContent-Length: 0\r\nAuthorization: AWS HXZDMROXJJZZSFNUKJXB:XKi/Ej+aRmEMqzfBJDn1L4xgK/k=\r\nDate: Thu, 02 Nov 2023 09:31:11 +0000\r\nHost: smithi156.front.sepia.ceph.com:80\r\n\r\n' 2023-11-02T09:31:36.536 INFO:teuthology.orchestra.run.smithi156.stdout:Zero length chunk ignored 2023-11-02T09:31:36.537 INFO:teuthology.orchestra.run.smithi156.stdout:reply: 'HTTP/1.1 200 OK\r\n' 2023-11-02T09:31:36.537 INFO:teuthology.orchestra.run.smithi156.stdout:header: x-amz-request-id: tx0000015a87b8479e8d9aa-0065436c5f-117b-default 2023-11-02T09:31:36.537 INFO:teuthology.orchestra.run.smithi156.stdout:header: Server: Ceph Object Gateway (reef) 2023-11-02T09:31:36.538 INFO:teuthology.orchestra.run.smithi156.stdout:header: Content-Length: 0 2023-11-02T09:31:36.538 INFO:teuthology.orchestra.run.smithi156.stdout:header: Date: Thu, 02 Nov 2023 09:31:11 GMT 2023-11-02T09:31:36.538 INFO:teuthology.orchestra.run.smithi156.stdout:header: Connection: Keep-Alive 2023-11-02T09:31:36.538 INFO:teuthology.orchestra.run.smithi156.stdout:wait for 5sec for the messages... 2023-11-02T09:31:36.539 INFO:teuthology.orchestra.run.smithi156.stdout:wait for 5sec for the messages... 2023-11-02T09:31:36.539 INFO:teuthology.orchestra.run.smithi156.stdout:send: b'DELETE /uicwqr-8?notification HTTP/1.1\r\nAccept-Encoding: identity\r\nContent-Length: 0\r\nAuthorization: AWS HXZDMROXJJZZSFNUKJXB:d/I5I923lHrCWIROLn2oGObGGZc=\r\nDate: Thu, 02 Nov 2023 09:31:22 +0000\r\nHost: smithi156.front.sepia.ceph.com:80\r\n\r\n' 2023-11-02T09:31:36.540 INFO:teuthology.orchestra.run.smithi156.stdout:Zero length chunk ignored 2023-11-02T09:31:36.541 INFO:teuthology.orchestra.run.smithi156.stdout:reply: 'HTTP/1.1 200 OK\r\n' 2023-11-02T09:31:36.542 INFO:teuthology.orchestra.run.smithi156.stdout:header: x-amz-request-id: tx000004b5e0ad468bb32d4-0065436c6a-117b-default 2023-11-02T09:31:36.542 INFO:teuthology.orchestra.run.smithi156.stdout:header: Server: Ceph Object Gateway (reef) 2023-11-02T09:31:36.542 INFO:teuthology.orchestra.run.smithi156.stdout:header: Content-Length: 0 2023-11-02T09:31:36.542 INFO:teuthology.orchestra.run.smithi156.stdout:header: Date: Thu, 02 Nov 2023 09:31:22 GMT 2023-11-02T09:31:36.543 INFO:teuthology.orchestra.run.smithi156.stdout:header: Connection: Keep-Alive 2023-11-02T09:31:36.544 INFO:teuthology.orchestra.run.smithi156.stdout:wait for 5sec for the messages... 2023-11-02T09:31:36.544 INFO:teuthology.orchestra.run.smithi156.stdout:version ok: .BozxI38Isn52rMKIhLOkvm.glyKf1d in: ['.BozxI38Isn52rMKIhLOkvm.glyKf1d', 'K-oAM5txN4speLB3UDXSEz23MWQxrvM', None] 2023-11-02T09:31:36.544 INFO:teuthology.orchestra.run.smithi156.stdout:version ok: K-oAM5txN4speLB3UDXSEz23MWQxrvM in: ['.BozxI38Isn52rMKIhLOkvm.glyKf1d', 'K-oAM5txN4speLB3UDXSEz23MWQxrvM', None] 2023-11-02T09:31:36.544 INFO:teuthology.orchestra.run.smithi156.stdout:version mismatch: JoiLJpbvZfPHhhdcL2fwxqWqBVQawNN not in: ['.BozxI38Isn52rMKIhLOkvm.glyKf1d', 'K-oAM5txN4speLB3UDXSEz23MWQxrvM', None] 2023-11-02T09:31:36.544 INFO:teuthology.orchestra.run.smithi156.stdout:send: b'DELETE /uicwqr-9?notification HTTP/1.1\r\nAccept-Encoding: identity\r\nContent-Length: 0\r\nAuthorization: AWS HXZDMROXJJZZSFNUKJXB:NXmIdCeZLJinq9HBuRwz8tuEw48=\r\nDate: Thu, 02 Nov 2023 09:31:28 +0000\r\nHost: smithi156.front.sepia.ceph.com:80\r\n\r\n' 2023-11-02T09:31:36.545 INFO:teuthology.orchestra.run.smithi156.stdout:Zero length chunk ignored 2023-11-02T09:31:36.545 INFO:teuthology.orchestra.run.smithi156.stdout:reply: 'HTTP/1.1 200 OK\r\n' 2023-11-02T09:31:36.545 INFO:teuthology.orchestra.run.smithi156.stdout:header: x-amz-request-id: tx0000093027f53c5e32c9e-0065436c70-117b-default 2023-11-02T09:31:36.545 INFO:teuthology.orchestra.run.smithi156.stdout:header: Server: Ceph Object Gateway (reef) 2023-11-02T09:31:36.545 INFO:teuthology.orchestra.run.smithi156.stdout:header: Content-Length: 0 2023-11-02T09:31:36.546 INFO:teuthology.orchestra.run.smithi156.stdout:header: Date: Thu, 02 Nov 2023 09:31:28 GMT 2023-11-02T09:31:36.546 INFO:teuthology.orchestra.run.smithi156.stdout:header: Connection: Keep-Alive 2023-11-02T09:31:36.546 INFO:teuthology.orchestra.run.smithi156.stdout:wait for 5sec for the messages... 2023-11-02T09:31:36.546 INFO:teuthology.orchestra.run.smithi156.stdout:version ok: DK0ZwZj0dVmr.Tcoz7rndNVgildds8n in: ['SIx9xaYHyOl4elNplk8rfPfKKu9M0IH', 'AhcvDgI9l9vOaPGnX1dhWvzx5PDN3i7', 'DK0ZwZj0dVmr.Tcoz7rndNVgildds8n'] 2023-11-02T09:31:36.546 INFO:teuthology.orchestra.run.smithi156.stdout:version ok: DK0ZwZj0dVmr.Tcoz7rndNVgildds8n in: ['SIx9xaYHyOl4elNplk8rfPfKKu9M0IH', 'AhcvDgI9l9vOaPGnX1dhWvzx5PDN3i7', 'DK0ZwZj0dVmr.Tcoz7rndNVgildds8n'] 2023-11-02T09:31:36.546 INFO:teuthology.orchestra.run.smithi156.stdout:version ok: AhcvDgI9l9vOaPGnX1dhWvzx5PDN3i7 in: ['SIx9xaYHyOl4elNplk8rfPfKKu9M0IH', 'AhcvDgI9l9vOaPGnX1dhWvzx5PDN3i7', 'DK0ZwZj0dVmr.Tcoz7rndNVgildds8n'] 2023-11-02T09:31:36.547 INFO:teuthology.orchestra.run.smithi156.stdout:version ok: AhcvDgI9l9vOaPGnX1dhWvzx5PDN3i7 in: ['SIx9xaYHyOl4elNplk8rfPfKKu9M0IH', 'AhcvDgI9l9vOaPGnX1dhWvzx5PDN3i7', 'DK0ZwZj0dVmr.Tcoz7rndNVgildds8n'] 2023-11-02T09:31:36.547 INFO:teuthology.orchestra.run.smithi156.stdout:version ok: SIx9xaYHyOl4elNplk8rfPfKKu9M0IH in: ['SIx9xaYHyOl4elNplk8rfPfKKu9M0IH', 'AhcvDgI9l9vOaPGnX1dhWvzx5PDN3i7', 'DK0ZwZj0dVmr.Tcoz7rndNVgildds8n'] 2023-11-02T09:31:36.547 INFO:teuthology.orchestra.run.smithi156.stdout:version ok: SIx9xaYHyOl4elNplk8rfPfKKu9M0IH in: ['SIx9xaYHyOl4elNplk8rfPfKKu9M0IH', 'AhcvDgI9l9vOaPGnX1dhWvzx5PDN3i7', 'DK0ZwZj0dVmr.Tcoz7rndNVgildds8n'] 2023-11-02T09:31:36.547 INFO:teuthology.orchestra.run.smithi156.stdout:send: b'DELETE /uicwqr-10?notification HTTP/1.1\r\nAccept-Encoding: identity\r\nContent-Length: 0\r\nAuthorization: AWS HXZDMROXJJZZSFNUKJXB:jZuTpReUaFjVgxssnPZKKEZmNmk=\r\nDate: Thu, 02 Nov 2023 09:31:36 +0000\r\nHost: smithi156.front.sepia.ceph.com:80\r\n\r\n' 2023-11-02T09:31:36.547 INFO:teuthology.orchestra.run.smithi156.stdout:Zero length chunk ignored 2023-11-02T09:31:36.557 INFO:teuthology.orchestra.run.smithi156.stderr:test s3 notification of deletion markers on master ... ok 2023-11-02T09:32:19.052 INFO:tasks.ceph.osd.7.smithi186.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6872-g84d22000/rpm/el9/BUILD/ceph-18.0.0-6872-g84d22000/src/cls/2pc_queue/cls_2pc_queue.cc: In function 'int cls_2pc_queue_remove_entries(cls_method_context_t, ceph::bufferlist*, ceph::bufferlist*)' thread 7fd324546640 time 2023-11-02T09:32:19.050801+0000 2023-11-02T09:32:19.053 INFO:tasks.ceph.osd.7.smithi186.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6872-g84d22000/rpm/el9/BUILD/ceph-18.0.0-6872-g84d22000/src/cls/2pc_queue/cls_2pc_queue.cc: 615: FAILED ceph_assert(len == rem_2pc_op.entries_to_remove) 2023-11-02T09:32:19.054 INFO:tasks.ceph.osd.7.smithi186.stderr: ceph version 18.0.0-6872-g84d22000 (84d22000a111c0f6e32c6bf0246b078c52c8bdde) reef (dev) 2023-11-02T09:32:19.054 INFO:tasks.ceph.osd.7.smithi186.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x11e) [0x5585e1911147] 2023-11-02T09:32:19.055 INFO:tasks.ceph.osd.7.smithi186.stderr: 2: ceph-osd(+0x46e303) [0x5585e1911303] 2023-11-02T09:32:19.055 INFO:tasks.ceph.osd.7.smithi186.stderr: 3: /usr/lib64/rados-classes/libcls_2pc_queue.so(+0x12b7d) [0x7fd3341d2b7d] 2023-11-02T09:32:19.055 INFO:tasks.ceph.osd.7.smithi186.stderr: 4: ceph-osd(+0x63988d) [0x5585e1adc88d] 2023-11-02T09:32:19.055 INFO:tasks.ceph.osd.7.smithi186.stderr: 5: (ClassHandler::ClassMethod::exec(void*, ceph::buffer::v15_2_0::list&, ceph::buffer::v15_2_0::list&)+0x5d) [0x5585e1adfc3d] 2023-11-02T09:32:19.055 INFO:tasks.ceph.osd.7.smithi186.stderr: 6: (PrimaryLogPG::do_osd_ops(PrimaryLogPG::OpContext*, std::vector >&)+0x59c) [0x5585e1b6816c] 2023-11-02T09:32:19.056 INFO:tasks.ceph.osd.7.smithi186.stderr: 7: (PrimaryLogPG::prepare_transaction(PrimaryLogPG::OpContext*)+0x9e) [0x5585e1b7f4de] 2023-11-02T09:32:19.056 INFO:tasks.ceph.osd.7.smithi186.stderr: 8: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x376) [0x5585e1b5a8a6] 2023-11-02T09:32:19.056 INFO:tasks.ceph.osd.7.smithi186.stderr: 9: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2f7f) [0x5585e1b51cbf] 2023-11-02T09:32:19.056 INFO:tasks.ceph.osd.7.smithi186.stderr: 10: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x197) [0x5585e1a95147] 2023-11-02T09:32:19.057 INFO:tasks.ceph.osd.7.smithi186.stderr: 11: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x69) [0x5585e1c95159] 2023-11-02T09:32:19.057 INFO:tasks.ceph.osd.7.smithi186.stderr: 12: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0xb97) [0x5585e1aa4257] 2023-11-02T09:32:19.059 INFO:tasks.ceph.osd.7.smithi186.stderr: 13: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x262) [0x5585e1f6d9a2] 2023-11-02T09:32:19.059 INFO:tasks.ceph.osd.7.smithi186.stderr: 14: ceph-osd(+0xacaf14) [0x5585e1f6df14] 2023-11-02T09:32:19.059 INFO:tasks.ceph.osd.7.smithi186.stderr: 15: /lib64/libc.so.6(+0x9f802) [0x7fd345c9f802] 2023-11-02T09:32:19.059 INFO:tasks.ceph.osd.7.smithi186.stderr: 16: /lib64/libc.so.6(+0x3f450) [0x7fd345c3f450] 2023-11-02T09:32:19.060 INFO:tasks.ceph.osd.7.smithi186.stderr:2023-11-02T09:32:19.052+0000 7fd324546640 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6872-g84d22000/rpm/el9/BUILD/ceph-18.0.0-6872-g84d22000/src/cls/2pc_queue/cls_2pc_queue.cc: In function 'int cls_2pc_queue_remove_entries(cls_method_context_t, ceph::bufferlist*, ceph::bufferlist*)' thread 7fd324546640 time 2023-11-02T09:32:19.050801+0000 2023-11-02T09:32:19.060 INFO:tasks.ceph.osd.7.smithi186.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6872-g84d22000/rpm/el9/BUILD/ceph-18.0.0-6872-g84d22000/src/cls/2pc_queue/cls_2pc_queue.cc: 615: FAILED ceph_assert(len == rem_2pc_op.entries_to_remove) 2023-11-02T09:32:19.060 INFO:tasks.ceph.osd.7.smithi186.stderr: 2023-11-02T09:32:19.060 INFO:tasks.ceph.osd.7.smithi186.stderr: ceph version 18.0.0-6872-g84d22000 (84d22000a111c0f6e32c6bf0246b078c52c8bdde) reef (dev) 2023-11-02T09:32:19.061 INFO:tasks.ceph.osd.7.smithi186.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x11e) [0x5585e1911147] 2023-11-02T09:32:19.061 INFO:tasks.ceph.osd.7.smithi186.stderr: 2: ceph-osd(+0x46e303) [0x5585e1911303] 2023-11-02T09:32:19.061 INFO:tasks.ceph.osd.7.smithi186.stderr: 3: /usr/lib64/rados-classes/libcls_2pc_queue.so(+0x12b7d) [0x7fd3341d2b7d] 2023-11-02T09:32:19.061 INFO:tasks.ceph.osd.7.smithi186.stderr: 4: ceph-osd(+0x63988d) [0x5585e1adc88d] 2023-11-02T09:32:19.061 INFO:tasks.ceph.osd.7.smithi186.stderr: 5: (ClassHandler::ClassMethod::exec(void*, ceph::buffer::v15_2_0::list&, ceph::buffer::v15_2_0::list&)+0x5d) [0x5585e1adfc3d] 2023-11-02T09:32:19.062 INFO:tasks.ceph.osd.7.smithi186.stderr: 6: (PrimaryLogPG::do_osd_ops(PrimaryLogPG::OpContext*, std::vector >&)+0x59c) [0x5585e1b6816c] 2023-11-02T09:32:19.062 INFO:tasks.ceph.osd.7.smithi186.stderr: 7: (PrimaryLogPG::prepare_transaction(PrimaryLogPG::OpContext*)+0x9e) [0x5585e1b7f4de] 2023-11-02T09:32:19.062 INFO:tasks.ceph.osd.7.smithi186.stderr: 8: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x376) [0x5585e1b5a8a6] 2023-11-02T09:32:19.062 INFO:tasks.ceph.osd.7.smithi186.stderr: 9: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2f7f) [0x5585e1b51cbf] 2023-11-02T09:32:19.063 INFO:tasks.ceph.osd.7.smithi186.stderr: 10: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x197) [0x5585e1a95147] 2023-11-02T09:32:19.063 INFO:tasks.ceph.osd.7.smithi186.stderr: 11: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x69) [0x5585e1c95159] 2023-11-02T09:32:19.063 INFO:tasks.ceph.osd.7.smithi186.stderr: 12: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0xb97) [0x5585e1aa4257] 2023-11-02T09:32:19.063 INFO:tasks.ceph.osd.7.smithi186.stderr: 13: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x262) [0x5585e1f6d9a2] 2023-11-02T09:32:19.065 INFO:tasks.ceph.osd.7.smithi186.stderr: 14: ceph-osd(+0xacaf14) [0x5585e1f6df14] 2023-11-02T09:32:19.065 INFO:tasks.ceph.osd.7.smithi186.stderr: 15: /lib64/libc.so.6(+0x9f802) [0x7fd345c9f802] 2023-11-02T09:32:19.065 INFO:tasks.ceph.osd.7.smithi186.stderr: 16: /lib64/libc.so.6(+0x3f450) [0x7fd345c3f450] 2023-11-02T09:32:19.066 INFO:tasks.ceph.osd.7.smithi186.stderr: 2023-11-02T09:32:19.066 INFO:tasks.ceph.osd.7.smithi186.stderr:*** Caught signal (Aborted) ** 2023-11-02T09:32:19.066 INFO:tasks.ceph.osd.7.smithi186.stderr: in thread 7fd324546640 thread_name:tp_osd_tp 2023-11-02T09:32:19.067 INFO:tasks.ceph.osd.7.smithi186.stderr: ceph version 18.0.0-6872-g84d22000 (84d22000a111c0f6e32c6bf0246b078c52c8bdde) reef (dev) 2023-11-02T09:32:19.067 INFO:tasks.ceph.osd.7.smithi186.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fd345c54db0] 2023-11-02T09:32:19.067 INFO:tasks.ceph.osd.7.smithi186.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fd345ca154c] 2023-11-02T09:32:19.068 INFO:tasks.ceph.osd.7.smithi186.stderr: 3: raise() 2023-11-02T09:32:19.068 INFO:tasks.ceph.osd.7.smithi186.stderr: 4: abort() 2023-11-02T09:32:19.068 INFO:tasks.ceph.osd.7.smithi186.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x179) [0x5585e19111a2] 2023-11-02T09:32:19.068 INFO:tasks.ceph.osd.7.smithi186.stderr: 6: ceph-osd(+0x46e303) [0x5585e1911303] 2023-11-02T09:32:19.071 INFO:tasks.ceph.osd.7.smithi186.stderr: 7: /usr/lib64/rados-classes/libcls_2pc_queue.so(+0x12b7d) [0x7fd3341d2b7d] 2023-11-02T09:32:19.072 INFO:tasks.ceph.osd.7.smithi186.stderr: 8: ceph-osd(+0x63988d) [0x5585e1adc88d] 2023-11-02T09:32:19.072 INFO:tasks.ceph.osd.7.smithi186.stderr: 9: (ClassHandler::ClassMethod::exec(void*, ceph::buffer::v15_2_0::list&, ceph::buffer::v15_2_0::list&)+0x5d) [0x5585e1adfc3d] 2023-11-02T09:32:19.072 INFO:tasks.ceph.osd.7.smithi186.stderr: 10: (PrimaryLogPG::do_osd_ops(PrimaryLogPG::OpContext*, std::vector >&)+0x59c) [0x5585e1b6816c] 2023-11-02T09:32:19.072 INFO:tasks.ceph.osd.7.smithi186.stderr: 11: (PrimaryLogPG::prepare_transaction(PrimaryLogPG::OpContext*)+0x9e) [0x5585e1b7f4de] 2023-11-02T09:32:19.072 INFO:tasks.ceph.osd.7.smithi186.stderr: 12: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x376) [0x5585e1b5a8a6] 2023-11-02T09:32:19.073 INFO:tasks.ceph.osd.7.smithi186.stderr: 13: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2f7f) [0x5585e1b51cbf] 2023-11-02T09:32:19.073 INFO:tasks.ceph.osd.7.smithi186.stderr: 14: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x197) [0x5585e1a95147] 2023-11-02T09:32:19.073 INFO:tasks.ceph.osd.7.smithi186.stderr: 15: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x69) [0x5585e1c95159] 2023-11-02T09:32:19.073 INFO:tasks.ceph.osd.7.smithi186.stderr: 16: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0xb97) [0x5585e1aa4257] 2023-11-02T09:32:19.073 INFO:tasks.ceph.osd.7.smithi186.stderr: 17: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x262) [0x5585e1f6d9a2] 2023-11-02T09:32:19.074 INFO:tasks.ceph.osd.7.smithi186.stderr: 18: ceph-osd(+0xacaf14) [0x5585e1f6df14] 2023-11-02T09:32:19.074 INFO:tasks.ceph.osd.7.smithi186.stderr: 19: /lib64/libc.so.6(+0x9f802) [0x7fd345c9f802] 2023-11-02T09:32:19.074 INFO:tasks.ceph.osd.7.smithi186.stderr: 20: /lib64/libc.so.6(+0x3f450) [0x7fd345c3f450] 2023-11-02T09:32:19.074 INFO:tasks.ceph.osd.7.smithi186.stderr:2023-11-02T09:32:19.055+0000 7fd324546640 -1 *** Caught signal (Aborted) ** 2023-11-02T09:32:19.074 INFO:tasks.ceph.osd.7.smithi186.stderr: in thread 7fd324546640 thread_name:tp_osd_tp 2023-11-02T09:32:19.075 INFO:tasks.ceph.osd.7.smithi186.stderr: 2023-11-02T09:32:19.075 INFO:tasks.ceph.osd.7.smithi186.stderr: ceph version 18.0.0-6872-g84d22000 (84d22000a111c0f6e32c6bf0246b078c52c8bdde) reef (dev) 2023-11-02T09:32:19.075 INFO:tasks.ceph.osd.7.smithi186.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fd345c54db0] 2023-11-02T09:32:19.075 INFO:tasks.ceph.osd.7.smithi186.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fd345ca154c] 2023-11-02T09:32:19.075 INFO:tasks.ceph.osd.7.smithi186.stderr: 3: raise() 2023-11-02T09:32:19.076 INFO:tasks.ceph.osd.7.smithi186.stderr: 4: abort() 2023-11-02T09:32:19.076 INFO:tasks.ceph.osd.7.smithi186.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x179) [0x5585e19111a2] 2023-11-02T09:32:19.076 INFO:tasks.ceph.osd.7.smithi186.stderr: 6: ceph-osd(+0x46e303) [0x5585e1911303] 2023-11-02T09:32:19.076 INFO:tasks.ceph.osd.7.smithi186.stderr: 7: /usr/lib64/rados-classes/libcls_2pc_queue.so(+0x12b7d) [0x7fd3341d2b7d] 2023-11-02T09:32:19.077 INFO:tasks.ceph.osd.7.smithi186.stderr: 8: ceph-osd(+0x63988d) [0x5585e1adc88d] 2023-11-02T09:32:19.077 INFO:tasks.ceph.osd.7.smithi186.stderr: 9: (ClassHandler::ClassMethod::exec(void*, ceph::buffer::v15_2_0::list&, ceph::buffer::v15_2_0::list&)+0x5d) [0x5585e1adfc3d] 2023-11-02T09:32:19.077 INFO:tasks.ceph.osd.7.smithi186.stderr: 10: (PrimaryLogPG::do_osd_ops(PrimaryLogPG::OpContext*, std::vector >&)+0x59c) [0x5585e1b6816c] 2023-11-02T09:32:19.077 INFO:tasks.ceph.osd.7.smithi186.stderr: 11: (PrimaryLogPG::prepare_transaction(PrimaryLogPG::OpContext*)+0x9e) [0x5585e1b7f4de] 2023-11-02T09:32:19.078 INFO:tasks.ceph.osd.7.smithi186.stderr: 12: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x376) [0x5585e1b5a8a6] 2023-11-02T09:32:19.078 INFO:tasks.ceph.osd.7.smithi186.stderr: 13: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2f7f) [0x5585e1b51cbf] 2023-11-02T09:32:19.078 INFO:tasks.ceph.osd.7.smithi186.stderr: 14: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x197) [0x5585e1a95147] 2023-11-02T09:32:19.078 INFO:tasks.ceph.osd.7.smithi186.stderr: 15: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x69) [0x5585e1c95159] 2023-11-02T09:32:19.078 INFO:tasks.ceph.osd.7.smithi186.stderr: 16: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0xb97) [0x5585e1aa4257] 2023-11-02T09:32:19.079 INFO:tasks.ceph.osd.7.smithi186.stderr: 17: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x262) [0x5585e1f6d9a2] 2023-11-02T09:32:19.079 INFO:tasks.ceph.osd.7.smithi186.stderr: 18: ceph-osd(+0xacaf14) [0x5585e1f6df14] 2023-11-02T09:32:19.079 INFO:tasks.ceph.osd.7.smithi186.stderr: 19: /lib64/libc.so.6(+0x9f802) [0x7fd345c9f802] 2023-11-02T09:32:19.080 INFO:tasks.ceph.osd.7.smithi186.stderr: 20: /lib64/libc.so.6(+0x3f450) [0x7fd345c3f450] 2023-11-02T09:32:19.080 INFO:tasks.ceph.osd.7.smithi186.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-02T09:32:19.080 INFO:tasks.ceph.osd.7.smithi186.stderr: 2023-11-02T09:32:19.081 INFO:tasks.ceph.osd.7.smithi186.stderr: -1> 2023-11-02T09:32:19.052+0000 7fd324546640 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6872-g84d22000/rpm/el9/BUILD/ceph-18.0.0-6872-g84d22000/src/cls/2pc_queue/cls_2pc_queue.cc: In function 'int cls_2pc_queue_remove_entries(cls_method_context_t, ceph::bufferlist*, ceph::bufferlist*)' thread 7fd324546640 time 2023-11-02T09:32:19.050801+0000 2023-11-02T09:32:19.081 INFO:tasks.ceph.osd.7.smithi186.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6872-g84d22000/rpm/el9/BUILD/ceph-18.0.0-6872-g84d22000/src/cls/2pc_queue/cls_2pc_queue.cc: 615: FAILED ceph_assert(len == rem_2pc_op.entries_to_remove) 2023-11-02T09:32:19.081 INFO:tasks.ceph.osd.7.smithi186.stderr: 2023-11-02T09:32:19.083 INFO:tasks.ceph.osd.7.smithi186.stderr: ceph version 18.0.0-6872-g84d22000 (84d22000a111c0f6e32c6bf0246b078c52c8bdde) reef (dev) 2023-11-02T09:32:19.083 INFO:tasks.ceph.osd.7.smithi186.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x11e) [0x5585e1911147] 2023-11-02T09:32:19.084 INFO:tasks.ceph.osd.7.smithi186.stderr: 2: ceph-osd(+0x46e303) [0x5585e1911303] 2023-11-02T09:32:19.084 INFO:tasks.ceph.osd.7.smithi186.stderr: 3: /usr/lib64/rados-classes/libcls_2pc_queue.so(+0x12b7d) [0x7fd3341d2b7d] 2023-11-02T09:32:19.084 INFO:tasks.ceph.osd.7.smithi186.stderr: 4: ceph-osd(+0x63988d) [0x5585e1adc88d] 2023-11-02T09:32:19.084 INFO:tasks.ceph.osd.7.smithi186.stderr: 5: (ClassHandler::ClassMethod::exec(void*, ceph::buffer::v15_2_0::list&, ceph::buffer::v15_2_0::list&)+0x5d) [0x5585e1adfc3d] 2023-11-02T09:32:19.084 INFO:tasks.ceph.osd.7.smithi186.stderr: 6: (PrimaryLogPG::do_osd_ops(PrimaryLogPG::OpContext*, std::vector >&)+0x59c) [0x5585e1b6816c] 2023-11-02T09:32:19.085 INFO:tasks.ceph.osd.7.smithi186.stderr: 7: (PrimaryLogPG::prepare_transaction(PrimaryLogPG::OpContext*)+0x9e) [0x5585e1b7f4de] 2023-11-02T09:32:19.085 INFO:tasks.ceph.osd.7.smithi186.stderr: 8: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x376) [0x5585e1b5a8a6] 2023-11-02T09:32:19.085 INFO:tasks.ceph.osd.7.smithi186.stderr: 9: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2f7f) [0x5585e1b51cbf] 2023-11-02T09:32:19.085 INFO:tasks.ceph.osd.7.smithi186.stderr: 10: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x197) [0x5585e1a95147] 2023-11-02T09:32:19.085 INFO:tasks.ceph.osd.7.smithi186.stderr: 11: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x69) [0x5585e1c95159] 2023-11-02T09:32:19.086 INFO:tasks.ceph.osd.7.smithi186.stderr: 12: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0xb97) [0x5585e1aa4257] 2023-11-02T09:32:19.086 INFO:tasks.ceph.osd.7.smithi186.stderr: 13: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x262) [0x5585e1f6d9a2] 2023-11-02T09:32:19.086 INFO:tasks.ceph.osd.7.smithi186.stderr: 14: ceph-osd(+0xacaf14) [0x5585e1f6df14] 2023-11-02T09:32:19.086 INFO:tasks.ceph.osd.7.smithi186.stderr: 15: /lib64/libc.so.6(+0x9f802) [0x7fd345c9f802] 2023-11-02T09:32:19.086 INFO:tasks.ceph.osd.7.smithi186.stderr: 16: /lib64/libc.so.6(+0x3f450) [0x7fd345c3f450] 2023-11-02T09:32:19.087 INFO:tasks.ceph.osd.7.smithi186.stderr: 2023-11-02T09:32:19.087 INFO:tasks.ceph.osd.7.smithi186.stderr: 0> 2023-11-02T09:32:19.055+0000 7fd324546640 -1 *** Caught signal (Aborted) ** 2023-11-02T09:32:19.087 INFO:tasks.ceph.osd.7.smithi186.stderr: in thread 7fd324546640 thread_name:tp_osd_tp 2023-11-02T09:32:19.087 INFO:tasks.ceph.osd.7.smithi186.stderr: 2023-11-02T09:32:19.087 INFO:tasks.ceph.osd.7.smithi186.stderr: ceph version 18.0.0-6872-g84d22000 (84d22000a111c0f6e32c6bf0246b078c52c8bdde) reef (dev) 2023-11-02T09:32:19.088 INFO:tasks.ceph.osd.7.smithi186.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fd345c54db0] 2023-11-02T09:32:19.088 INFO:tasks.ceph.osd.7.smithi186.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fd345ca154c] 2023-11-02T09:32:19.088 INFO:tasks.ceph.osd.7.smithi186.stderr: 3: raise() 2023-11-02T09:32:19.088 INFO:tasks.ceph.osd.7.smithi186.stderr: 4: abort() 2023-11-02T09:32:19.089 INFO:tasks.ceph.osd.7.smithi186.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x179) [0x5585e19111a2] 2023-11-02T09:32:19.089 INFO:tasks.ceph.osd.7.smithi186.stderr: 6: ceph-osd(+0x46e303) [0x5585e1911303] 2023-11-02T09:32:19.089 INFO:tasks.ceph.osd.7.smithi186.stderr: 7: /usr/lib64/rados-classes/libcls_2pc_queue.so(+0x12b7d) [0x7fd3341d2b7d] 2023-11-02T09:32:19.090 INFO:tasks.ceph.osd.7.smithi186.stderr: 8: ceph-osd(+0x63988d) [0x5585e1adc88d] 2023-11-02T09:32:19.090 INFO:tasks.ceph.osd.7.smithi186.stderr: 9: (ClassHandler::ClassMethod::exec(void*, ceph::buffer::v15_2_0::list&, ceph::buffer::v15_2_0::list&)+0x5d) [0x5585e1adfc3d] 2023-11-02T09:32:19.090 INFO:tasks.ceph.osd.7.smithi186.stderr: 10: (PrimaryLogPG::do_osd_ops(PrimaryLogPG::OpContext*, std::vector >&)+0x59c) [0x5585e1b6816c] 2023-11-02T09:32:19.090 INFO:tasks.ceph.osd.7.smithi186.stderr: 11: (PrimaryLogPG::prepare_transaction(PrimaryLogPG::OpContext*)+0x9e) [0x5585e1b7f4de] 2023-11-02T09:32:19.091 INFO:tasks.ceph.osd.7.smithi186.stderr: 12: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x376) [0x5585e1b5a8a6] 2023-11-02T09:32:19.091 INFO:tasks.ceph.osd.7.smithi186.stderr: 13: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2f7f) [0x5585e1b51cbf] 2023-11-02T09:32:19.091 INFO:tasks.ceph.osd.7.smithi186.stderr: 14: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x197) [0x5585e1a95147] 2023-11-02T09:32:19.091 INFO:tasks.ceph.osd.7.smithi186.stderr: 15: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x69) [0x5585e1c95159] 2023-11-02T09:32:19.091 INFO:tasks.ceph.osd.7.smithi186.stderr: 16: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0xb97) [0x5585e1aa4257] 2023-11-02T09:32:19.092 INFO:tasks.ceph.osd.7.smithi186.stderr: 17: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x262) [0x5585e1f6d9a2] 2023-11-02T09:32:19.092 INFO:tasks.ceph.osd.7.smithi186.stderr: 18: ceph-osd(+0xacaf14) [0x5585e1f6df14] 2023-11-02T09:32:19.092 INFO:tasks.ceph.osd.7.smithi186.stderr: 19: /lib64/libc.so.6(+0x9f802) [0x7fd345c9f802] 2023-11-02T09:32:19.092 INFO:tasks.ceph.osd.7.smithi186.stderr: 20: /lib64/libc.so.6(+0x3f450) [0x7fd345c3f450] 2023-11-02T09:32:19.093 INFO:tasks.ceph.osd.7.smithi186.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-02T09:32:19.093 INFO:tasks.ceph.osd.7.smithi186.stderr: 2023-11-02T09:32:19.093 INFO:tasks.ceph.osd.7.smithi186.stderr: -1> 2023-11-02T09:32:19.052+0000 7fd324546640 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6872-g84d22000/rpm/el9/BUILD/ceph-18.0.0-6872-g84d22000/src/cls/2pc_queue/cls_2pc_queue.cc: In function 'int cls_2pc_queue_remove_entries(cls_method_context_t, ceph::bufferlist*, ceph::bufferlist*)' thread 7fd324546640 time 2023-11-02T09:32:19.050801+0000 2023-11-02T09:32:19.093 INFO:tasks.ceph.osd.7.smithi186.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6872-g84d22000/rpm/el9/BUILD/ceph-18.0.0-6872-g84d22000/src/cls/2pc_queue/cls_2pc_queue.cc: 615: FAILED ceph_assert(len == rem_2pc_op.entries_to_remove) 2023-11-02T09:32:19.093 INFO:tasks.ceph.osd.7.smithi186.stderr: 2023-11-02T09:32:19.095 INFO:tasks.ceph.osd.7.smithi186.stderr: ceph version 18.0.0-6872-g84d22000 (84d22000a111c0f6e32c6bf0246b078c52c8bdde) reef (dev) 2023-11-02T09:32:19.095 INFO:tasks.ceph.osd.7.smithi186.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x11e) [0x5585e1911147] 2023-11-02T09:32:19.095 INFO:tasks.ceph.osd.7.smithi186.stderr: 2: ceph-osd(+0x46e303) [0x5585e1911303] 2023-11-02T09:32:19.095 INFO:tasks.ceph.osd.7.smithi186.stderr: 3: /usr/lib64/rados-classes/libcls_2pc_queue.so(+0x12b7d) [0x7fd3341d2b7d] 2023-11-02T09:32:19.096 INFO:tasks.ceph.osd.7.smithi186.stderr: 4: ceph-osd(+0x63988d) [0x5585e1adc88d] 2023-11-02T09:32:19.096 INFO:tasks.ceph.osd.7.smithi186.stderr: 5: (ClassHandler::ClassMethod::exec(void*, ceph::buffer::v15_2_0::list&, ceph::buffer::v15_2_0::list&)+0x5d) [0x5585e1adfc3d] 2023-11-02T09:32:19.096 INFO:tasks.ceph.osd.7.smithi186.stderr: 6: (PrimaryLogPG::do_osd_ops(PrimaryLogPG::OpContext*, std::vector >&)+0x59c) [0x5585e1b6816c] 2023-11-02T09:32:19.096 INFO:tasks.ceph.osd.7.smithi186.stderr: 7: (PrimaryLogPG::prepare_transaction(PrimaryLogPG::OpContext*)+0x9e) [0x5585e1b7f4de] 2023-11-02T09:32:19.096 INFO:tasks.ceph.osd.7.smithi186.stderr: 8: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x376) [0x5585e1b5a8a6] 2023-11-02T09:32:19.097 INFO:tasks.ceph.osd.7.smithi186.stderr: 9: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2f7f) [0x5585e1b51cbf] 2023-11-02T09:32:19.097 INFO:tasks.ceph.osd.7.smithi186.stderr: 10: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x197) [0x5585e1a95147] 2023-11-02T09:32:19.097 INFO:tasks.ceph.osd.7.smithi186.stderr: 11: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x69) [0x5585e1c95159] 2023-11-02T09:32:19.097 INFO:tasks.ceph.osd.7.smithi186.stderr: 12: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0xb97) [0x5585e1aa4257] 2023-11-02T09:32:19.097 INFO:tasks.ceph.osd.7.smithi186.stderr: 13: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x262) [0x5585e1f6d9a2] 2023-11-02T09:32:19.097 INFO:tasks.ceph.osd.7.smithi186.stderr: 14: ceph-osd(+0xacaf14) [0x5585e1f6df14] 2023-11-02T09:32:19.098 INFO:tasks.ceph.osd.7.smithi186.stderr: 15: /lib64/libc.so.6(+0x9f802) [0x7fd345c9f802] 2023-11-02T09:32:19.098 INFO:tasks.ceph.osd.7.smithi186.stderr: 16: /lib64/libc.so.6(+0x3f450) [0x7fd345c3f450] 2023-11-02T09:32:19.098 INFO:tasks.ceph.osd.7.smithi186.stderr: 2023-11-02T09:32:19.098 INFO:tasks.ceph.osd.7.smithi186.stderr: 0> 2023-11-02T09:32:19.055+0000 7fd324546640 -1 *** Caught signal (Aborted) ** 2023-11-02T09:32:19.098 INFO:tasks.ceph.osd.7.smithi186.stderr: in thread 7fd324546640 thread_name:tp_osd_tp 2023-11-02T09:32:19.099 INFO:tasks.ceph.osd.7.smithi186.stderr: 2023-11-02T09:32:19.099 INFO:tasks.ceph.osd.7.smithi186.stderr: ceph version 18.0.0-6872-g84d22000 (84d22000a111c0f6e32c6bf0246b078c52c8bdde) reef (dev) 2023-11-02T09:32:19.099 INFO:tasks.ceph.osd.7.smithi186.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fd345c54db0] 2023-11-02T09:32:19.099 INFO:tasks.ceph.osd.7.smithi186.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fd345ca154c] 2023-11-02T09:32:19.099 INFO:tasks.ceph.osd.7.smithi186.stderr: 3: raise() 2023-11-02T09:32:19.100 INFO:tasks.ceph.osd.7.smithi186.stderr: 4: abort() 2023-11-02T09:32:19.100 INFO:tasks.ceph.osd.7.smithi186.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x179) [0x5585e19111a2] 2023-11-02T09:32:19.100 INFO:tasks.ceph.osd.7.smithi186.stderr: 6: ceph-osd(+0x46e303) [0x5585e1911303] 2023-11-02T09:32:19.100 INFO:tasks.ceph.osd.7.smithi186.stderr: 7: /usr/lib64/rados-classes/libcls_2pc_queue.so(+0x12b7d) [0x7fd3341d2b7d] 2023-11-02T09:32:19.100 INFO:tasks.ceph.osd.7.smithi186.stderr: 8: ceph-osd(+0x63988d) [0x5585e1adc88d] 2023-11-02T09:32:19.101 INFO:tasks.ceph.osd.7.smithi186.stderr: 9: (ClassHandler::ClassMethod::exec(void*, ceph::buffer::v15_2_0::list&, ceph::buffer::v15_2_0::list&)+0x5d) [0x5585e1adfc3d] 2023-11-02T09:32:19.101 INFO:tasks.ceph.osd.7.smithi186.stderr: 10: (PrimaryLogPG::do_osd_ops(PrimaryLogPG::OpContext*, std::vector >&)+0x59c) [0x5585e1b6816c] 2023-11-02T09:32:19.101 INFO:tasks.ceph.osd.7.smithi186.stderr: 11: (PrimaryLogPG::prepare_transaction(PrimaryLogPG::OpContext*)+0x9e) [0x5585e1b7f4de] 2023-11-02T09:32:19.101 INFO:tasks.ceph.osd.7.smithi186.stderr: 12: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x376) [0x5585e1b5a8a6] 2023-11-02T09:32:19.101 INFO:tasks.ceph.osd.7.smithi186.stderr: 13: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2f7f) [0x5585e1b51cbf] 2023-11-02T09:32:19.102 INFO:tasks.ceph.osd.7.smithi186.stderr: 14: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x197) [0x5585e1a95147] 2023-11-02T09:32:19.102 INFO:tasks.ceph.osd.7.smithi186.stderr: 15: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x69) [0x5585e1c95159] 2023-11-02T09:32:19.103 INFO:tasks.ceph.osd.7.smithi186.stderr: 16: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0xb97) [0x5585e1aa4257] 2023-11-02T09:32:19.103 INFO:tasks.ceph.osd.7.smithi186.stderr: 17: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x262) [0x5585e1f6d9a2] 2023-11-02T09:32:19.104 INFO:tasks.ceph.osd.7.smithi186.stderr: 18: ceph-osd(+0xacaf14) [0x5585e1f6df14] 2023-11-02T09:32:19.104 INFO:tasks.ceph.osd.7.smithi186.stderr: 19: /lib64/libc.so.6(+0x9f802) [0x7fd345c9f802] 2023-11-02T09:32:19.104 INFO:tasks.ceph.osd.7.smithi186.stderr: 20: /lib64/libc.so.6(+0x3f450) [0x7fd345c3f450] 2023-11-02T09:32:19.104 INFO:tasks.ceph.osd.7.smithi186.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-02T09:32:19.104 INFO:tasks.ceph.osd.7.smithi186.stderr: 2023-11-02T09:32:19.851 INFO:tasks.ceph.osd.7.smithi186.stderr:daemon-helper: command crashed with signal 6 2023-11-02T09:32:21.078 INFO:tasks.ceph.osd.6.smithi186.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6872-g84d22000/rpm/el9/BUILD/ceph-18.0.0-6872-g84d22000/src/cls/2pc_queue/cls_2pc_queue.cc: In function 'int cls_2pc_queue_remove_entries(cls_method_context_t, ceph::bufferlist*, ceph::bufferlist*)' thread 7f8a5761a640 time 2023-11-02T09:32:21.077285+0000 2023-11-02T09:32:21.079 INFO:tasks.ceph.osd.6.smithi186.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6872-g84d22000/rpm/el9/BUILD/ceph-18.0.0-6872-g84d22000/src/cls/2pc_queue/cls_2pc_queue.cc: 615: FAILED ceph_assert(len == rem_2pc_op.entries_to_remove) 2023-11-02T09:32:21.081 INFO:tasks.ceph.osd.6.smithi186.stderr: ceph version 18.0.0-6872-g84d22000 (84d22000a111c0f6e32c6bf0246b078c52c8bdde) reef (dev) 2023-11-02T09:32:21.081 INFO:tasks.ceph.osd.6.smithi186.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x11e) [0x55822e3b2147] 2023-11-02T09:32:21.082 INFO:tasks.ceph.osd.6.smithi186.stderr: 2: ceph-osd(+0x46e303) [0x55822e3b2303] 2023-11-02T09:32:21.082 INFO:tasks.ceph.osd.6.smithi186.stderr: 3: /usr/lib64/rados-classes/libcls_2pc_queue.so(+0x12b7d) [0x7f8a672a6b7d] 2023-11-02T09:32:21.082 INFO:tasks.ceph.osd.6.smithi186.stderr: 4: ceph-osd(+0x63988d) [0x55822e57d88d] 2023-11-02T09:32:21.082 INFO:tasks.ceph.osd.6.smithi186.stderr: 5: (ClassHandler::ClassMethod::exec(void*, ceph::buffer::v15_2_0::list&, ceph::buffer::v15_2_0::list&)+0x5d) [0x55822e580c3d] 2023-11-02T09:32:21.083 INFO:tasks.ceph.osd.6.smithi186.stderr: 6: (PrimaryLogPG::do_osd_ops(PrimaryLogPG::OpContext*, std::vector >&)+0x59c) [0x55822e60916c] 2023-11-02T09:32:21.083 INFO:tasks.ceph.osd.6.smithi186.stderr: 7: (PrimaryLogPG::prepare_transaction(PrimaryLogPG::OpContext*)+0x9e) [0x55822e6204de] 2023-11-02T09:32:21.083 INFO:tasks.ceph.osd.6.smithi186.stderr: 8: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x376) [0x55822e5fb8a6] 2023-11-02T09:32:21.083 INFO:tasks.ceph.osd.6.smithi186.stderr: 9: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2f7f) [0x55822e5f2cbf] 2023-11-02T09:32:21.083 INFO:tasks.ceph.osd.6.smithi186.stderr: 10: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x197) [0x55822e536147] 2023-11-02T09:32:21.083 INFO:tasks.ceph.osd.6.smithi186.stderr: 11: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x69) [0x55822e736159] 2023-11-02T09:32:21.084 INFO:tasks.ceph.osd.6.smithi186.stderr: 12: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0xb97) [0x55822e545257] 2023-11-02T09:32:21.084 INFO:tasks.ceph.osd.6.smithi186.stderr: 13: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x262) [0x55822ea0e9a2] 2023-11-02T09:32:21.084 INFO:tasks.ceph.osd.6.smithi186.stderr: 14: ceph-osd(+0xacaf14) [0x55822ea0ef14] 2023-11-02T09:32:21.084 INFO:tasks.ceph.osd.6.smithi186.stderr: 15: /lib64/libc.so.6(+0x9f802) [0x7f8a78c9f802] 2023-11-02T09:32:21.084 INFO:tasks.ceph.osd.6.smithi186.stderr: 16: /lib64/libc.so.6(+0x3f450) [0x7f8a78c3f450] 2023-11-02T09:32:21.085 INFO:tasks.ceph.osd.6.smithi186.stderr:*** Caught signal (Aborted) ** 2023-11-02T09:32:21.085 INFO:tasks.ceph.osd.6.smithi186.stderr: in thread 7f8a5761a640 thread_name:tp_osd_tp 2023-11-02T09:32:21.085 INFO:tasks.ceph.osd.6.smithi186.stderr:2023-11-02T09:32:21.079+0000 7f8a5761a640 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6872-g84d22000/rpm/el9/BUILD/ceph-18.0.0-6872-g84d22000/src/cls/2pc_queue/cls_2pc_queue.cc: In function 'int cls_2pc_queue_remove_entries(cls_method_context_t, ceph::bufferlist*, ceph::bufferlist*)' thread 7f8a5761a640 time 2023-11-02T09:32:21.077285+0000 2023-11-02T09:32:21.085 INFO:tasks.ceph.osd.6.smithi186.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6872-g84d22000/rpm/el9/BUILD/ceph-18.0.0-6872-g84d22000/src/cls/2pc_queue/cls_2pc_queue.cc: 615: FAILED ceph_assert(len == rem_2pc_op.entries_to_remove) 2023-11-02T09:32:21.085 INFO:tasks.ceph.osd.6.smithi186.stderr: 2023-11-02T09:32:21.086 INFO:tasks.ceph.osd.6.smithi186.stderr: ceph version 18.0.0-6872-g84d22000 (84d22000a111c0f6e32c6bf0246b078c52c8bdde) reef (dev) 2023-11-02T09:32:21.086 INFO:tasks.ceph.osd.6.smithi186.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x11e) [0x55822e3b2147] 2023-11-02T09:32:21.086 INFO:tasks.ceph.osd.6.smithi186.stderr: 2: ceph-osd(+0x46e303) [0x55822e3b2303] 2023-11-02T09:32:21.086 INFO:tasks.ceph.osd.6.smithi186.stderr: 3: /usr/lib64/rados-classes/libcls_2pc_queue.so(+0x12b7d) [0x7f8a672a6b7d] 2023-11-02T09:32:21.086 INFO:tasks.ceph.osd.6.smithi186.stderr: 4: ceph-osd(+0x63988d) [0x55822e57d88d] 2023-11-02T09:32:21.087 INFO:tasks.ceph.osd.6.smithi186.stderr: 5: (ClassHandler::ClassMethod::exec(void*, ceph::buffer::v15_2_0::list&, ceph::buffer::v15_2_0::list&)+0x5d) [0x55822e580c3d] 2023-11-02T09:32:21.087 INFO:tasks.ceph.osd.6.smithi186.stderr: 6: (PrimaryLogPG::do_osd_ops(PrimaryLogPG::OpContext*, std::vector >&)+0x59c) [0x55822e60916c] 2023-11-02T09:32:21.087 INFO:tasks.ceph.osd.6.smithi186.stderr: 7: (PrimaryLogPG::prepare_transaction(PrimaryLogPG::OpContext*)+0x9e) [0x55822e6204de] 2023-11-02T09:32:21.087 INFO:tasks.ceph.osd.6.smithi186.stderr: 8: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x376) [0x55822e5fb8a6] 2023-11-02T09:32:21.087 INFO:tasks.ceph.osd.6.smithi186.stderr: 9: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2f7f) [0x55822e5f2cbf] 2023-11-02T09:32:21.087 INFO:tasks.ceph.osd.6.smithi186.stderr: 10: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x197) [0x55822e536147] 2023-11-02T09:32:21.088 INFO:tasks.ceph.osd.6.smithi186.stderr: 11: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x69) [0x55822e736159] 2023-11-02T09:32:21.088 INFO:tasks.ceph.osd.6.smithi186.stderr: 12: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0xb97) [0x55822e545257] 2023-11-02T09:32:21.088 INFO:tasks.ceph.osd.6.smithi186.stderr: 13: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x262) [0x55822ea0e9a2] 2023-11-02T09:32:21.088 INFO:tasks.ceph.osd.6.smithi186.stderr: 14: ceph-osd(+0xacaf14) [0x55822ea0ef14] 2023-11-02T09:32:21.088 INFO:tasks.ceph.osd.6.smithi186.stderr: 15: /lib64/libc.so.6(+0x9f802) [0x7f8a78c9f802] 2023-11-02T09:32:21.089 INFO:tasks.ceph.osd.6.smithi186.stderr: 16: /lib64/libc.so.6(+0x3f450) [0x7f8a78c3f450] 2023-11-02T09:32:21.089 INFO:tasks.ceph.osd.6.smithi186.stderr: 2023-11-02T09:32:21.089 INFO:tasks.ceph.osd.6.smithi186.stderr: ceph version 18.0.0-6872-g84d22000 (84d22000a111c0f6e32c6bf0246b078c52c8bdde) reef (dev) 2023-11-02T09:32:21.090 INFO:tasks.ceph.osd.6.smithi186.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f8a78c54db0] 2023-11-02T09:32:21.090 INFO:tasks.ceph.osd.6.smithi186.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f8a78ca154c] 2023-11-02T09:32:21.090 INFO:tasks.ceph.osd.6.smithi186.stderr: 3: raise() 2023-11-02T09:32:21.090 INFO:tasks.ceph.osd.6.smithi186.stderr: 4: abort() 2023-11-02T09:32:21.091 INFO:tasks.ceph.osd.6.smithi186.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x179) [0x55822e3b21a2] 2023-11-02T09:32:21.091 INFO:tasks.ceph.osd.6.smithi186.stderr: 6: ceph-osd(+0x46e303) [0x55822e3b2303] 2023-11-02T09:32:21.091 INFO:tasks.ceph.osd.6.smithi186.stderr: 7: /usr/lib64/rados-classes/libcls_2pc_queue.so(+0x12b7d) [0x7f8a672a6b7d] 2023-11-02T09:32:21.091 INFO:tasks.ceph.osd.6.smithi186.stderr: 8: ceph-osd(+0x63988d) [0x55822e57d88d] 2023-11-02T09:32:21.091 INFO:tasks.ceph.osd.6.smithi186.stderr: 9: (ClassHandler::ClassMethod::exec(void*, ceph::buffer::v15_2_0::list&, ceph::buffer::v15_2_0::list&)+0x5d) [0x55822e580c3d] 2023-11-02T09:32:21.092 INFO:tasks.ceph.osd.6.smithi186.stderr: 10: (PrimaryLogPG::do_osd_ops(PrimaryLogPG::OpContext*, std::vector >&)+0x59c) [0x55822e60916c] 2023-11-02T09:32:21.092 INFO:tasks.ceph.osd.6.smithi186.stderr: 11: (PrimaryLogPG::prepare_transaction(PrimaryLogPG::OpContext*)+0x9e) [0x55822e6204de] 2023-11-02T09:32:21.092 INFO:tasks.ceph.osd.6.smithi186.stderr: 12: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x376) [0x55822e5fb8a6] 2023-11-02T09:32:21.092 INFO:tasks.ceph.osd.6.smithi186.stderr: 13: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2f7f) [0x55822e5f2cbf] 2023-11-02T09:32:21.093 INFO:tasks.ceph.osd.6.smithi186.stderr: 14: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x197) [0x55822e536147] 2023-11-02T09:32:21.093 INFO:tasks.ceph.osd.6.smithi186.stderr: 15: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x69) [0x55822e736159] 2023-11-02T09:32:21.093 INFO:tasks.ceph.osd.6.smithi186.stderr: 16: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0xb97) [0x55822e545257] 2023-11-02T09:32:21.093 INFO:tasks.ceph.osd.6.smithi186.stderr: 17: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x262) [0x55822ea0e9a2] 2023-11-02T09:32:21.093 INFO:tasks.ceph.osd.6.smithi186.stderr: 18: ceph-osd(+0xacaf14) [0x55822ea0ef14] 2023-11-02T09:32:21.094 INFO:tasks.ceph.osd.6.smithi186.stderr: 19: /lib64/libc.so.6(+0x9f802) [0x7f8a78c9f802] 2023-11-02T09:32:21.094 INFO:tasks.ceph.osd.6.smithi186.stderr: 20: /lib64/libc.so.6(+0x3f450) [0x7f8a78c3f450] 2023-11-02T09:32:21.094 INFO:tasks.ceph.osd.6.smithi186.stderr:2023-11-02T09:32:21.082+0000 7f8a5761a640 -1 *** Caught signal (Aborted) ** 2023-11-02T09:32:21.094 INFO:tasks.ceph.osd.6.smithi186.stderr: in thread 7f8a5761a640 thread_name:tp_osd_tp 2023-11-02T09:32:21.094 INFO:tasks.ceph.osd.6.smithi186.stderr: 2023-11-02T09:32:21.094 INFO:tasks.ceph.osd.6.smithi186.stderr: ceph version 18.0.0-6872-g84d22000 (84d22000a111c0f6e32c6bf0246b078c52c8bdde) reef (dev) 2023-11-02T09:32:21.095 INFO:tasks.ceph.osd.6.smithi186.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f8a78c54db0] 2023-11-02T09:32:21.095 INFO:tasks.ceph.osd.6.smithi186.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f8a78ca154c] 2023-11-02T09:32:21.095 INFO:tasks.ceph.osd.6.smithi186.stderr: 3: raise() 2023-11-02T09:32:21.095 INFO:tasks.ceph.osd.6.smithi186.stderr: 4: abort() 2023-11-02T09:32:21.095 INFO:tasks.ceph.osd.6.smithi186.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x179) [0x55822e3b21a2] 2023-11-02T09:32:21.096 INFO:tasks.ceph.osd.6.smithi186.stderr: 6: ceph-osd(+0x46e303) [0x55822e3b2303] 2023-11-02T09:32:21.096 INFO:tasks.ceph.osd.6.smithi186.stderr: 7: /usr/lib64/rados-classes/libcls_2pc_queue.so(+0x12b7d) [0x7f8a672a6b7d] 2023-11-02T09:32:21.096 INFO:tasks.ceph.osd.6.smithi186.stderr: 8: ceph-osd(+0x63988d) [0x55822e57d88d] 2023-11-02T09:32:21.096 INFO:tasks.ceph.osd.6.smithi186.stderr: 9: (ClassHandler::ClassMethod::exec(void*, ceph::buffer::v15_2_0::list&, ceph::buffer::v15_2_0::list&)+0x5d) [0x55822e580c3d] 2023-11-02T09:32:21.096 INFO:tasks.ceph.osd.6.smithi186.stderr: 10: (PrimaryLogPG::do_osd_ops(PrimaryLogPG::OpContext*, std::vector >&)+0x59c) [0x55822e60916c] 2023-11-02T09:32:21.097 INFO:tasks.ceph.osd.6.smithi186.stderr: 11: (PrimaryLogPG::prepare_transaction(PrimaryLogPG::OpContext*)+0x9e) [0x55822e6204de] 2023-11-02T09:32:21.097 INFO:tasks.ceph.osd.6.smithi186.stderr: 12: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x376) [0x55822e5fb8a6] 2023-11-02T09:32:21.098 INFO:tasks.ceph.osd.6.smithi186.stderr: 13: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2f7f) [0x55822e5f2cbf] 2023-11-02T09:32:21.098 INFO:tasks.ceph.osd.6.smithi186.stderr: 14: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x197) [0x55822e536147] 2023-11-02T09:32:21.098 INFO:tasks.ceph.osd.6.smithi186.stderr: 15: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x69) [0x55822e736159] 2023-11-02T09:32:21.098 INFO:tasks.ceph.osd.6.smithi186.stderr: 16: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0xb97) [0x55822e545257] 2023-11-02T09:32:21.098 INFO:tasks.ceph.osd.6.smithi186.stderr: 17: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x262) [0x55822ea0e9a2] 2023-11-02T09:32:21.099 INFO:tasks.ceph.osd.6.smithi186.stderr: 18: ceph-osd(+0xacaf14) [0x55822ea0ef14] 2023-11-02T09:32:21.099 INFO:tasks.ceph.osd.6.smithi186.stderr: 19: /lib64/libc.so.6(+0x9f802) [0x7f8a78c9f802] 2023-11-02T09:32:21.099 INFO:tasks.ceph.osd.6.smithi186.stderr: 20: /lib64/libc.so.6(+0x3f450) [0x7f8a78c3f450] 2023-11-02T09:32:21.099 INFO:tasks.ceph.osd.6.smithi186.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-02T09:32:21.099 INFO:tasks.ceph.osd.6.smithi186.stderr: 2023-11-02T09:32:21.101 INFO:tasks.ceph.osd.6.smithi186.stderr: -94> 2023-11-02T09:32:21.079+0000 7f8a5761a640 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6872-g84d22000/rpm/el9/BUILD/ceph-18.0.0-6872-g84d22000/src/cls/2pc_queue/cls_2pc_queue.cc: In function 'int cls_2pc_queue_remove_entries(cls_method_context_t, ceph::bufferlist*, ceph::bufferlist*)' thread 7f8a5761a640 time 2023-11-02T09:32:21.077285+0000 2023-11-02T09:32:21.105 INFO:tasks.ceph.osd.6.smithi186.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6872-g84d22000/rpm/el9/BUILD/ceph-18.0.0-6872-g84d22000/src/cls/2pc_queue/cls_2pc_queue.cc: 615: FAILED ceph_assert(len == rem_2pc_op.entries_to_remove) 2023-11-02T09:32:21.105 INFO:tasks.ceph.osd.6.smithi186.stderr: 2023-11-02T09:32:21.105 INFO:tasks.ceph.osd.6.smithi186.stderr: ceph version 18.0.0-6872-g84d22000 (84d22000a111c0f6e32c6bf0246b078c52c8bdde) reef (dev) 2023-11-02T09:32:21.106 INFO:tasks.ceph.osd.6.smithi186.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x11e) [0x55822e3b2147] 2023-11-02T09:32:21.106 INFO:tasks.ceph.osd.6.smithi186.stderr: 2: ceph-osd(+0x46e303) [0x55822e3b2303] 2023-11-02T09:32:21.106 INFO:tasks.ceph.osd.6.smithi186.stderr: 3: /usr/lib64/rados-classes/libcls_2pc_queue.so(+0x12b7d) [0x7f8a672a6b7d] 2023-11-02T09:32:21.107 INFO:tasks.ceph.osd.6.smithi186.stderr: 4: ceph-osd(+0x63988d) [0x55822e57d88d] 2023-11-02T09:32:21.107 INFO:tasks.ceph.osd.6.smithi186.stderr: 5: (ClassHandler::ClassMethod::exec(void*, ceph::buffer::v15_2_0::list&, ceph::buffer::v15_2_0::list&)+0x5d) [0x55822e580c3d] 2023-11-02T09:32:21.107 INFO:tasks.ceph.osd.6.smithi186.stderr: 6: (PrimaryLogPG::do_osd_ops(PrimaryLogPG::OpContext*, std::vector >&)+0x59c) [0x55822e60916c] 2023-11-02T09:32:21.107 INFO:tasks.ceph.osd.6.smithi186.stderr: 7: (PrimaryLogPG::prepare_transaction(PrimaryLogPG::OpContext*)+0x9e) [0x55822e6204de] 2023-11-02T09:32:21.107 INFO:tasks.ceph.osd.6.smithi186.stderr: 8: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x376) [0x55822e5fb8a6] 2023-11-02T09:32:21.108 INFO:tasks.ceph.osd.6.smithi186.stderr: 9: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2f7f) [0x55822e5f2cbf] 2023-11-02T09:32:21.108 INFO:tasks.ceph.osd.6.smithi186.stderr: 10: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x197) [0x55822e536147] 2023-11-02T09:32:21.108 INFO:tasks.ceph.osd.6.smithi186.stderr: 11: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x69) [0x55822e736159] 2023-11-02T09:32:21.108 INFO:tasks.ceph.osd.6.smithi186.stderr: 12: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0xb97) [0x55822e545257] 2023-11-02T09:32:21.109 INFO:tasks.ceph.osd.6.smithi186.stderr: 13: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x262) [0x55822ea0e9a2] 2023-11-02T09:32:21.109 INFO:tasks.ceph.osd.6.smithi186.stderr: 14: ceph-osd(+0xacaf14) [0x55822ea0ef14] 2023-11-02T09:32:21.109 INFO:tasks.ceph.osd.6.smithi186.stderr: 15: /lib64/libc.so.6(+0x9f802) [0x7f8a78c9f802] 2023-11-02T09:32:21.109 INFO:tasks.ceph.osd.6.smithi186.stderr: 16: /lib64/libc.so.6(+0x3f450) [0x7f8a78c3f450] 2023-11-02T09:32:21.109 INFO:tasks.ceph.osd.6.smithi186.stderr: 2023-11-02T09:32:21.109 INFO:tasks.ceph.osd.6.smithi186.stderr: 0> 2023-11-02T09:32:21.082+0000 7f8a5761a640 -1 *** Caught signal (Aborted) ** 2023-11-02T09:32:21.110 INFO:tasks.ceph.osd.6.smithi186.stderr: in thread 7f8a5761a640 thread_name:tp_osd_tp 2023-11-02T09:32:21.110 INFO:tasks.ceph.osd.6.smithi186.stderr: 2023-11-02T09:32:21.110 INFO:tasks.ceph.osd.6.smithi186.stderr: ceph version 18.0.0-6872-g84d22000 (84d22000a111c0f6e32c6bf0246b078c52c8bdde) reef (dev) 2023-11-02T09:32:21.110 INFO:tasks.ceph.osd.6.smithi186.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f8a78c54db0] 2023-11-02T09:32:21.110 INFO:tasks.ceph.osd.6.smithi186.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f8a78ca154c] 2023-11-02T09:32:21.111 INFO:tasks.ceph.osd.6.smithi186.stderr: 3: raise() 2023-11-02T09:32:21.111 INFO:tasks.ceph.osd.6.smithi186.stderr: 4: abort() 2023-11-02T09:32:21.111 INFO:tasks.ceph.osd.6.smithi186.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x179) [0x55822e3b21a2] 2023-11-02T09:32:21.111 INFO:tasks.ceph.osd.6.smithi186.stderr: 6: ceph-osd(+0x46e303) [0x55822e3b2303] 2023-11-02T09:32:21.111 INFO:tasks.ceph.osd.6.smithi186.stderr: 7: /usr/lib64/rados-classes/libcls_2pc_queue.so(+0x12b7d) [0x7f8a672a6b7d] 2023-11-02T09:32:21.112 INFO:tasks.ceph.osd.6.smithi186.stderr: 8: ceph-osd(+0x63988d) [0x55822e57d88d] 2023-11-02T09:32:21.112 INFO:tasks.ceph.osd.6.smithi186.stderr: 9: (ClassHandler::ClassMethod::exec(void*, ceph::buffer::v15_2_0::list&, ceph::buffer::v15_2_0::list&)+0x5d) [0x55822e580c3d] 2023-11-02T09:32:21.112 INFO:tasks.ceph.osd.6.smithi186.stderr: 10: (PrimaryLogPG::do_osd_ops(PrimaryLogPG::OpContext*, std::vector >&)+0x59c) [0x55822e60916c] 2023-11-02T09:32:21.112 INFO:tasks.ceph.osd.6.smithi186.stderr: 11: (PrimaryLogPG::prepare_transaction(PrimaryLogPG::OpContext*)+0x9e) [0x55822e6204de] 2023-11-02T09:32:21.112 INFO:tasks.ceph.osd.6.smithi186.stderr: 12: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x376) [0x55822e5fb8a6] 2023-11-02T09:32:21.113 INFO:tasks.ceph.osd.6.smithi186.stderr: 13: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2f7f) [0x55822e5f2cbf] 2023-11-02T09:32:21.113 INFO:tasks.ceph.osd.6.smithi186.stderr: 14: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x197) [0x55822e536147] 2023-11-02T09:32:21.113 INFO:tasks.ceph.osd.6.smithi186.stderr: 15: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x69) [0x55822e736159] 2023-11-02T09:32:21.113 INFO:tasks.ceph.osd.6.smithi186.stderr: 16: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0xb97) [0x55822e545257] 2023-11-02T09:32:21.113 INFO:tasks.ceph.osd.6.smithi186.stderr: 17: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x262) [0x55822ea0e9a2] 2023-11-02T09:32:21.114 INFO:tasks.ceph.osd.6.smithi186.stderr: 18: ceph-osd(+0xacaf14) [0x55822ea0ef14] 2023-11-02T09:32:21.114 INFO:tasks.ceph.osd.6.smithi186.stderr: 19: /lib64/libc.so.6(+0x9f802) [0x7f8a78c9f802] 2023-11-02T09:32:21.114 INFO:tasks.ceph.osd.6.smithi186.stderr: 20: /lib64/libc.so.6(+0x3f450) [0x7f8a78c3f450] 2023-11-02T09:32:21.114 INFO:tasks.ceph.osd.6.smithi186.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-02T09:32:21.114 INFO:tasks.ceph.osd.6.smithi186.stderr: 2023-11-02T09:32:21.115 INFO:tasks.ceph.osd.6.smithi186.stderr: -94> 2023-11-02T09:32:21.079+0000 7f8a5761a640 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6872-g84d22000/rpm/el9/BUILD/ceph-18.0.0-6872-g84d22000/src/cls/2pc_queue/cls_2pc_queue.cc: In function 'int cls_2pc_queue_remove_entries(cls_method_context_t, ceph::bufferlist*, ceph::bufferlist*)' thread 7f8a5761a640 time 2023-11-02T09:32:21.077285+0000 2023-11-02T09:32:21.115 INFO:tasks.ceph.osd.6.smithi186.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6872-g84d22000/rpm/el9/BUILD/ceph-18.0.0-6872-g84d22000/src/cls/2pc_queue/cls_2pc_queue.cc: 615: FAILED ceph_assert(len == rem_2pc_op.entries_to_remove) 2023-11-02T09:32:21.116 INFO:tasks.ceph.osd.6.smithi186.stderr: 2023-11-02T09:32:21.116 INFO:tasks.ceph.osd.6.smithi186.stderr: ceph version 18.0.0-6872-g84d22000 (84d22000a111c0f6e32c6bf0246b078c52c8bdde) reef (dev) 2023-11-02T09:32:21.116 INFO:tasks.ceph.osd.6.smithi186.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x11e) [0x55822e3b2147] 2023-11-02T09:32:21.116 INFO:tasks.ceph.osd.6.smithi186.stderr: 2: ceph-osd(+0x46e303) [0x55822e3b2303] 2023-11-02T09:32:21.116 INFO:tasks.ceph.osd.6.smithi186.stderr: 3: /usr/lib64/rados-classes/libcls_2pc_queue.so(+0x12b7d) [0x7f8a672a6b7d] 2023-11-02T09:32:21.117 INFO:tasks.ceph.osd.6.smithi186.stderr: 4: ceph-osd(+0x63988d) [0x55822e57d88d] 2023-11-02T09:32:21.117 INFO:tasks.ceph.osd.6.smithi186.stderr: 5: (ClassHandler::ClassMethod::exec(void*, ceph::buffer::v15_2_0::list&, ceph::buffer::v15_2_0::list&)+0x5d) [0x55822e580c3d] 2023-11-02T09:32:21.117 INFO:tasks.ceph.osd.6.smithi186.stderr: 6: (PrimaryLogPG::do_osd_ops(PrimaryLogPG::OpContext*, std::vector >&)+0x59c) [0x55822e60916c] 2023-11-02T09:32:21.117 INFO:tasks.ceph.osd.6.smithi186.stderr: 7: (PrimaryLogPG::prepare_transaction(PrimaryLogPG::OpContext*)+0x9e) [0x55822e6204de] 2023-11-02T09:32:21.117 INFO:tasks.ceph.osd.6.smithi186.stderr: 8: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x376) [0x55822e5fb8a6] 2023-11-02T09:32:21.118 INFO:tasks.ceph.osd.6.smithi186.stderr: 9: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2f7f) [0x55822e5f2cbf] 2023-11-02T09:32:21.118 INFO:tasks.ceph.osd.6.smithi186.stderr: 10: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x197) [0x55822e536147] 2023-11-02T09:32:21.118 INFO:tasks.ceph.osd.6.smithi186.stderr: 11: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x69) [0x55822e736159] 2023-11-02T09:32:21.118 INFO:tasks.ceph.osd.6.smithi186.stderr: 12: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0xb97) [0x55822e545257] 2023-11-02T09:32:21.119 INFO:tasks.ceph.osd.6.smithi186.stderr: 13: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x262) [0x55822ea0e9a2] 2023-11-02T09:32:21.119 INFO:tasks.ceph.osd.6.smithi186.stderr: 14: ceph-osd(+0xacaf14) [0x55822ea0ef14] 2023-11-02T09:32:21.119 INFO:tasks.ceph.osd.6.smithi186.stderr: 15: /lib64/libc.so.6(+0x9f802) [0x7f8a78c9f802] 2023-11-02T09:32:21.119 INFO:tasks.ceph.osd.6.smithi186.stderr: 16: /lib64/libc.so.6(+0x3f450) [0x7f8a78c3f450] 2023-11-02T09:32:21.119 INFO:tasks.ceph.osd.6.smithi186.stderr: 2023-11-02T09:32:21.120 INFO:tasks.ceph.osd.6.smithi186.stderr: 0> 2023-11-02T09:32:21.082+0000 7f8a5761a640 -1 *** Caught signal (Aborted) ** 2023-11-02T09:32:21.120 INFO:tasks.ceph.osd.6.smithi186.stderr: in thread 7f8a5761a640 thread_name:tp_osd_tp 2023-11-02T09:32:21.120 INFO:tasks.ceph.osd.6.smithi186.stderr: 2023-11-02T09:32:21.120 INFO:tasks.ceph.osd.6.smithi186.stderr: ceph version 18.0.0-6872-g84d22000 (84d22000a111c0f6e32c6bf0246b078c52c8bdde) reef (dev) 2023-11-02T09:32:21.120 INFO:tasks.ceph.osd.6.smithi186.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f8a78c54db0] 2023-11-02T09:32:21.121 INFO:tasks.ceph.osd.6.smithi186.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f8a78ca154c] 2023-11-02T09:32:21.121 INFO:tasks.ceph.osd.6.smithi186.stderr: 3: raise() 2023-11-02T09:32:21.121 INFO:tasks.ceph.osd.6.smithi186.stderr: 4: abort() 2023-11-02T09:32:21.126 INFO:tasks.ceph.osd.6.smithi186.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x179) [0x55822e3b21a2] 2023-11-02T09:32:21.126 INFO:tasks.ceph.osd.6.smithi186.stderr: 6: ceph-osd(+0x46e303) [0x55822e3b2303] 2023-11-02T09:32:21.126 INFO:tasks.ceph.osd.6.smithi186.stderr: 7: /usr/lib64/rados-classes/libcls_2pc_queue.so(+0x12b7d) [0x7f8a672a6b7d] 2023-11-02T09:32:21.127 INFO:tasks.ceph.osd.6.smithi186.stderr: 8: ceph-osd(+0x63988d) [0x55822e57d88d] 2023-11-02T09:32:21.127 INFO:tasks.ceph.osd.6.smithi186.stderr: 9: (ClassHandler::ClassMethod::exec(void*, ceph::buffer::v15_2_0::list&, ceph::buffer::v15_2_0::list&)+0x5d) [0x55822e580c3d] 2023-11-02T09:32:21.127 INFO:tasks.ceph.osd.6.smithi186.stderr: 10: (PrimaryLogPG::do_osd_ops(PrimaryLogPG::OpContext*, std::vector >&)+0x59c) [0x55822e60916c] 2023-11-02T09:32:21.127 INFO:tasks.ceph.osd.6.smithi186.stderr: 11: (PrimaryLogPG::prepare_transaction(PrimaryLogPG::OpContext*)+0x9e) [0x55822e6204de] 2023-11-02T09:32:21.127 INFO:tasks.ceph.osd.6.smithi186.stderr: 12: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x376) [0x55822e5fb8a6] 2023-11-02T09:32:21.128 INFO:tasks.ceph.osd.6.smithi186.stderr: 13: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2f7f) [0x55822e5f2cbf] 2023-11-02T09:32:21.128 INFO:tasks.ceph.osd.6.smithi186.stderr: 14: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x197) [0x55822e536147] 2023-11-02T09:32:21.128 INFO:tasks.ceph.osd.6.smithi186.stderr: 15: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x69) [0x55822e736159] 2023-11-02T09:32:21.128 INFO:tasks.ceph.osd.6.smithi186.stderr: 16: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0xb97) [0x55822e545257] 2023-11-02T09:32:21.128 INFO:tasks.ceph.osd.6.smithi186.stderr: 17: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x262) [0x55822ea0e9a2] 2023-11-02T09:32:21.129 INFO:tasks.ceph.osd.6.smithi186.stderr: 18: ceph-osd(+0xacaf14) [0x55822ea0ef14] 2023-11-02T09:32:21.129 INFO:tasks.ceph.osd.6.smithi186.stderr: 19: /lib64/libc.so.6(+0x9f802) [0x7f8a78c9f802] 2023-11-02T09:32:21.129 INFO:tasks.ceph.osd.6.smithi186.stderr: 20: /lib64/libc.so.6(+0x3f450) [0x7f8a78c3f450] 2023-11-02T09:32:21.129 INFO:tasks.ceph.osd.6.smithi186.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-02T09:32:21.129 INFO:tasks.ceph.osd.6.smithi186.stderr: 2023-11-02T09:32:21.683 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-11-02T09:32:21.871 INFO:tasks.ceph.osd.6.smithi186.stderr:daemon-helper: command crashed with signal 6 2023-11-02T09:32:27.892 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-11-02T09:32:27.893 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~6s 2023-11-02T09:32:34.100 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~6s 2023-11-02T09:32:34.101 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~13s 2023-11-02T09:32:40.309 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~12s 2023-11-02T09:32:40.309 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~19s 2023-11-02T09:32:46.518 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~19s 2023-11-02T09:32:46.518 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~25s 2023-11-02T09:32:52.726 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~25s 2023-11-02T09:32:52.727 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~31s 2023-11-02T09:32:58.938 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~31s 2023-11-02T09:32:58.938 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~37s 2023-11-02T09:32:59.008 INFO:teuthology.orchestra.run.smithi156.stderr:test pushing persistent notification amqp ... FAIL 2023-11-02T09:33:05.148 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~37s 2023-11-02T09:33:05.148 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~44s 2023-11-02T09:33:11.358 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~43s 2023-11-02T09:33:11.359 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~50s 2023-11-02T09:33:17.568 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~50s 2023-11-02T09:33:17.569 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~56s 2023-11-02T09:33:23.778 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~56s 2023-11-02T09:33:23.778 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~62s 2023-11-02T09:33:29.990 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~62s 2023-11-02T09:33:29.990 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~68s 2023-11-02T09:33:36.200 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~68s 2023-11-02T09:33:36.200 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~75s 2023-11-02T09:33:42.407 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~75s 2023-11-02T09:33:42.408 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~81s 2023-11-02T09:33:48.619 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~81s 2023-11-02T09:33:48.620 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~87s 2023-11-02T09:33:54.829 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~87s 2023-11-02T09:33:54.830 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~93s 2023-11-02T09:34:01.038 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~93s 2023-11-02T09:34:01.039 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~99s 2023-11-02T09:34:07.249 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~99s 2023-11-02T09:34:07.250 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~106s 2023-11-02T09:34:13.464 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~106s 2023-11-02T09:34:13.465 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~112s 2023-11-02T09:34:19.677 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~112s 2023-11-02T09:34:19.678 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~118s 2023-11-02T09:34:25.891 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~118s 2023-11-02T09:34:25.891 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~124s 2023-11-02T09:34:32.097 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~124s 2023-11-02T09:34:32.180 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~131s 2023-11-02T09:34:38.390 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~130s 2023-11-02T09:34:38.390 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~137s 2023-11-02T09:34:44.603 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~137s 2023-11-02T09:34:44.604 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~143s 2023-11-02T09:34:50.816 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~143s 2023-11-02T09:34:50.817 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~149s 2023-11-02T09:34:57.025 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~149s 2023-11-02T09:34:57.025 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~155s 2023-11-02T09:35:03.235 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~155s 2023-11-02T09:35:03.235 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~162s 2023-11-02T09:35:09.450 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~162s 2023-11-02T09:35:09.450 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~168s 2023-11-02T09:35:15.659 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~168s 2023-11-02T09:35:15.660 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~174s 2023-11-02T09:35:21.871 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~174s 2023-11-02T09:35:21.872 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~180s 2023-11-02T09:35:28.082 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~180s 2023-11-02T09:35:28.083 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~186s 2023-11-02T09:35:34.290 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~186s 2023-11-02T09:35:34.290 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~193s 2023-11-02T09:35:40.498 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~193s 2023-11-02T09:35:40.498 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~199s 2023-11-02T09:35:46.707 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~199s 2023-11-02T09:35:46.708 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~205s 2023-11-02T09:35:52.920 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~205s 2023-11-02T09:35:52.920 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~211s 2023-11-02T09:35:59.128 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~211s 2023-11-02T09:35:59.129 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~218s 2023-11-02T09:36:05.342 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~217s 2023-11-02T09:36:05.343 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~224s 2023-11-02T09:36:11.551 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~224s 2023-11-02T09:36:11.552 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~230s 2023-11-02T09:36:17.761 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~230s 2023-11-02T09:36:17.762 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~236s 2023-11-02T09:36:23.971 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~236s 2023-11-02T09:36:23.972 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~242s 2023-11-02T09:36:30.181 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~242s 2023-11-02T09:36:30.181 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~249s 2023-11-02T09:36:36.391 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~248s 2023-11-02T09:36:36.391 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~255s 2023-11-02T09:36:42.605 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~255s 2023-11-02T09:36:42.606 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~261s 2023-11-02T09:36:48.814 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~261s 2023-11-02T09:36:48.815 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~267s 2023-11-02T09:36:55.023 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~267s 2023-11-02T09:36:55.023 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~273s 2023-11-02T09:37:01.231 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~273s 2023-11-02T09:37:01.231 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~280s 2023-11-02T09:37:07.439 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~280s 2023-11-02T09:37:07.440 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~286s 2023-11-02T09:37:13.648 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~286s 2023-11-02T09:37:13.648 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~292s 2023-11-02T09:37:19.855 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~292s 2023-11-02T09:37:19.856 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~298s 2023-11-02T09:37:26.065 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~298s 2023-11-02T09:37:26.065 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~304s 2023-11-02T09:37:26.065 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2023-11-02T09:37:27.278 INFO:tasks.ceph.osd.0:Sent signal 15 2023-11-02T09:37:27.279 INFO:tasks.ceph.osd.1:Sent signal 15 2023-11-02T09:37:27.279 INFO:tasks.ceph.osd.2:Sent signal 15 2023-11-02T09:37:27.279 INFO:tasks.ceph.osd.3:Sent signal 15 2023-11-02T09:37:27.280 INFO:tasks.ceph.osd.4:Sent signal 15 2023-11-02T09:37:27.280 INFO:tasks.ceph.osd.5:Sent signal 15 2023-11-02T09:37:27.281 INFO:tasks.ceph.mon.a:Sent signal 15 2023-11-02T09:37:27.281 INFO:tasks.ceph.mon.c:Sent signal 15 2023-11-02T09:37:27.281 INFO:tasks.ceph.mon.b:Sent signal 15 2023-11-02T09:37:27.282 INFO:tasks.rgw.client.0:Sent signal 15 2023-11-02T09:37:27.283 INFO:tasks.ceph.mgr.y:Sent signal 15 2023-11-02T09:37:27.283 INFO:tasks.ceph.mgr.x:Sent signal 15 2023-11-02T09:37:27.284 INFO:tasks.ceph.osd.4.smithi186.stderr:2023-11-02T09:37:27.279+0000 7fc5ff3e7640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 84806) UID: 0 2023-11-02T09:37:27.284 INFO:tasks.ceph.osd.4.smithi186.stderr:2023-11-02T09:37:27.279+0000 7fc5ff3e7640 -1 osd.4 41 *** Got signal Terminated *** 2023-11-02T09:37:27.285 INFO:tasks.ceph.osd.4.smithi186.stderr:2023-11-02T09:37:27.279+0000 7fc5ff3e7640 -1 osd.4 41 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-02T09:37:27.285 INFO:tasks.ceph.osd.0.smithi156.stderr:2023-11-02T09:37:27.278+0000 7fc80c948640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 84880) UID: 0 2023-11-02T09:37:27.286 INFO:tasks.ceph.osd.0.smithi156.stderr:2023-11-02T09:37:27.278+0000 7fc80c948640 -1 osd.0 41 *** Got signal Terminated *** 2023-11-02T09:37:27.286 INFO:tasks.ceph.osd.5.smithi186.stderr:2023-11-02T09:37:27.279+0000 7fd0a6b55640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 84813) UID: 0 2023-11-02T09:37:27.286 INFO:tasks.ceph.osd.5.smithi186.stderr:2023-11-02T09:37:27.279+0000 7fd0a6b55640 -1 osd.5 41 *** Got signal Terminated *** 2023-11-02T09:37:27.287 INFO:tasks.ceph.osd.5.smithi186.stderr:2023-11-02T09:37:27.279+0000 7fd0a6b55640 -1 osd.5 41 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-02T09:37:27.287 INFO:tasks.ceph.osd.1.smithi156.stderr:2023-11-02T09:37:27.278+0000 7fa020680640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 84881) UID: 0 2023-11-02T09:37:27.287 INFO:tasks.ceph.osd.1.smithi156.stderr:2023-11-02T09:37:27.278+0000 7fa020680640 -1 osd.1 41 *** Got signal Terminated *** 2023-11-02T09:37:27.287 INFO:tasks.ceph.osd.1.smithi156.stderr:2023-11-02T09:37:27.278+0000 7fa020680640 -1 osd.1 41 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-02T09:37:27.288 INFO:tasks.ceph.mon.b.smithi186.stderr:2023-11-02T09:37:27.280+0000 7fd346ebc640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i b (PID: 84217) UID: 0 2023-11-02T09:37:27.288 INFO:tasks.ceph.mon.b.smithi186.stderr:2023-11-02T09:37:27.280+0000 7fd346ebc640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2023-11-02T09:37:27.288 INFO:tasks.ceph.osd.0.smithi156.stderr:2023-11-02T09:37:27.278+0000 7fc80c948640 -1 osd.0 41 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-02T09:37:27.289 INFO:tasks.ceph.osd.2.smithi156.stderr:2023-11-02T09:37:27.278+0000 7fd336de2640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 84884) UID: 0 2023-11-02T09:37:27.289 INFO:tasks.ceph.osd.2.smithi156.stderr:2023-11-02T09:37:27.278+0000 7fd336de2640 -1 osd.2 41 *** Got signal Terminated *** 2023-11-02T09:37:27.289 INFO:tasks.ceph.osd.2.smithi156.stderr:2023-11-02T09:37:27.278+0000 7fd336de2640 -1 osd.2 41 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-02T09:37:27.290 INFO:tasks.ceph.osd.3.smithi156.stderr:2023-11-02T09:37:27.279+0000 7f7f0b90f640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 84886) UID: 0 2023-11-02T09:37:27.290 INFO:tasks.ceph.osd.3.smithi156.stderr:2023-11-02T09:37:27.279+0000 7f7f0b90f640 -1 osd.3 41 *** Got signal Terminated *** 2023-11-02T09:37:27.290 INFO:tasks.ceph.osd.3.smithi156.stderr:2023-11-02T09:37:27.279+0000 7f7f0b90f640 -1 osd.3 41 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-02T09:37:27.291 INFO:tasks.ceph.mon.a.smithi156.stderr:2023-11-02T09:37:27.280+0000 7f166707b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 84519) UID: 0 2023-11-02T09:37:27.291 INFO:tasks.ceph.mon.a.smithi156.stderr:2023-11-02T09:37:27.280+0000 7f166707b640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-11-02T09:37:27.292 INFO:tasks.ceph.mon.c.smithi156.stderr:2023-11-02T09:37:27.280+0000 7f566d873640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i c (PID: 84521) UID: 0 2023-11-02T09:37:27.292 INFO:tasks.ceph.mon.c.smithi156.stderr:2023-11-02T09:37:27.280+0000 7f566d873640 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2023-11-02T09:37:27.297 INFO:tasks.rgw.client.0.smithi156.stdout:2023-11-02T09:37:27.281+0000 7f6a052f0640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 92416) UID: 0 2023-11-02T09:37:27.298 INFO:tasks.rgw.client.0.smithi156.stdout:2023-11-02T09:37:27.281+0000 7f6a0b810880 -1 shutting down 2023-11-02T09:37:27.298 INFO:tasks.ceph.mgr.y.smithi156.stderr:2023-11-02T09:37:27.282+0000 7f4b4e18e640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mgr -f --cluster ceph -i y (PID: 84567) UID: 0 2023-11-02T09:37:27.298 INFO:tasks.ceph.mgr.y.smithi156.stderr:2023-11-02T09:37:27.282+0000 7f4b4e18e640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2023-11-02T09:37:27.484 INFO:tasks.ceph.mgr.x.smithi186.stderr:daemon-helper: command crashed with signal 15 2023-11-02T09:40:49.349 INFO:teuthology.orchestra.run.smithi156.stderr:test pushing persistent notification of large notifications ... ERROR 2023-11-02T09:40:49.350 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:49.358 INFO:teuthology.orchestra.run.smithi156.stderr:====================================================================== 2023-11-02T09:40:49.358 INFO:teuthology.orchestra.run.smithi156.stderr:ERROR: test pushing persistent notification of large notifications 2023-11-02T09:40:49.359 INFO:teuthology.orchestra.run.smithi156.stderr:---------------------------------------------------------------------- 2023-11-02T09:40:49.359 INFO:teuthology.orchestra.run.smithi156.stderr:Traceback (most recent call last): 2023-11-02T09:40:49.359 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/virtualenv/lib64/python3.9/site-packages/nose/case.py", line 198, in runTest 2023-11-02T09:40:49.359 INFO:teuthology.orchestra.run.smithi156.stderr: self.test(*self.arg) 2023-11-02T09:40:49.359 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/test_bn.py", line 3952, in test_ps_s3_persistent_notification_large 2023-11-02T09:40:49.360 INFO:teuthology.orchestra.run.smithi156.stderr: keys = list(bucket.list()) 2023-11-02T09:40:49.361 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/virtualenv/lib64/python3.9/site-packages/boto/s3/bucketlistresultset.py", line 32, in bucket_lister 2023-11-02T09:40:49.361 INFO:teuthology.orchestra.run.smithi156.stderr: rs = bucket.get_all_keys(prefix=prefix, marker=marker, 2023-11-02T09:40:49.361 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/virtualenv/lib64/python3.9/site-packages/boto/s3/bucket.py", line 472, in get_all_keys 2023-11-02T09:40:49.361 INFO:teuthology.orchestra.run.smithi156.stderr: return self._get_all([('Contents', self.key_class), 2023-11-02T09:40:49.362 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/virtualenv/lib64/python3.9/site-packages/boto/s3/bucket.py", line 398, in _get_all 2023-11-02T09:40:49.362 INFO:teuthology.orchestra.run.smithi156.stderr: response = self.connection.make_request('GET', self.name, 2023-11-02T09:40:49.362 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/virtualenv/lib64/python3.9/site-packages/boto/s3/connection.py", line 667, in make_request 2023-11-02T09:40:49.362 INFO:teuthology.orchestra.run.smithi156.stderr: return super(S3Connection, self).make_request( 2023-11-02T09:40:49.362 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/virtualenv/lib64/python3.9/site-packages/boto/connection.py", line 1070, in make_request 2023-11-02T09:40:49.363 INFO:teuthology.orchestra.run.smithi156.stderr: return self._mexe(http_request, sender, override_num_retries, 2023-11-02T09:40:49.363 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/virtualenv/lib64/python3.9/site-packages/boto/connection.py", line 1030, in _mexe 2023-11-02T09:40:49.363 INFO:teuthology.orchestra.run.smithi156.stderr: raise ex 2023-11-02T09:40:49.363 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/virtualenv/lib64/python3.9/site-packages/boto/connection.py", line 942, in _mexe 2023-11-02T09:40:49.365 INFO:teuthology.orchestra.run.smithi156.stderr: connection.request(request.method, request.path, 2023-11-02T09:40:49.365 INFO:teuthology.orchestra.run.smithi156.stderr: File "/usr/lib64/python3.9/http/client.py", line 1285, in request 2023-11-02T09:40:49.367 INFO:teuthology.orchestra.run.smithi156.stderr: self._send_request(method, url, body, headers, encode_chunked) 2023-11-02T09:40:49.367 INFO:teuthology.orchestra.run.smithi156.stderr: File "/usr/lib64/python3.9/http/client.py", line 1331, in _send_request 2023-11-02T09:40:49.367 INFO:teuthology.orchestra.run.smithi156.stderr: self.endheaders(body, encode_chunked=encode_chunked) 2023-11-02T09:40:49.367 INFO:teuthology.orchestra.run.smithi156.stderr: File "/usr/lib64/python3.9/http/client.py", line 1280, in endheaders 2023-11-02T09:40:49.368 INFO:teuthology.orchestra.run.smithi156.stderr: self._send_output(message_body, encode_chunked=encode_chunked) 2023-11-02T09:40:49.368 INFO:teuthology.orchestra.run.smithi156.stderr: File "/usr/lib64/python3.9/http/client.py", line 1040, in _send_output 2023-11-02T09:40:49.368 INFO:teuthology.orchestra.run.smithi156.stderr: self.send(msg) 2023-11-02T09:40:49.368 INFO:teuthology.orchestra.run.smithi156.stderr: File "/usr/lib64/python3.9/http/client.py", line 980, in send 2023-11-02T09:40:49.368 INFO:teuthology.orchestra.run.smithi156.stderr: self.connect() 2023-11-02T09:40:49.369 INFO:teuthology.orchestra.run.smithi156.stderr: File "/usr/lib64/python3.9/http/client.py", line 946, in connect 2023-11-02T09:40:49.369 INFO:teuthology.orchestra.run.smithi156.stderr: self.sock = self._create_connection( 2023-11-02T09:40:49.369 INFO:teuthology.orchestra.run.smithi156.stderr: File "/usr/lib64/python3.9/socket.py", line 844, in create_connection 2023-11-02T09:40:49.369 INFO:teuthology.orchestra.run.smithi156.stderr: raise err 2023-11-02T09:40:49.369 INFO:teuthology.orchestra.run.smithi156.stderr: File "/usr/lib64/python3.9/socket.py", line 832, in create_connection 2023-11-02T09:40:49.370 INFO:teuthology.orchestra.run.smithi156.stderr: sock.connect(sa) 2023-11-02T09:40:49.370 INFO:teuthology.orchestra.run.smithi156.stderr:ConnectionRefusedError: [Errno 111] Connection refused 2023-11-02T09:40:49.370 INFO:teuthology.orchestra.run.smithi156.stderr:-------------------- >> begin captured logging << -------------------- 2023-11-02T09:40:49.370 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Using access key provided by client. 2023-11-02T09:40:49.370 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Using secret key provided by client. 2023-11-02T09:40:49.371 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/ 2023-11-02T09:40:49.371 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/ 2023-11-02T09:40:49.371 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.371 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/ 2023-11-02T09:40:49.371 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.372 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:49.372 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.372 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.372 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.372 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:49.373 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.373 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.373 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.373 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:49.373 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:49.373 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:59 GMT 2023-11-02T09:40:49.374 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/ 2023-11-02T09:40:49.374 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.374 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:XnPkQ2kwhCEmf3/Eqr5javipxp4= 2023-11-02T09:40:49.374 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:59 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:XnPkQ2kwhCEmf3/Eqr5javipxp4=', 'Content-Length': '0'} 2023-11-02T09:40:49.375 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx0000032042e1698cb8c9a-0065436ccb-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Thu, 02 Nov 2023 09:32:59 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:49.375 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: Using EPollPoller 2023-11-02T09:40:49.375 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.base_connection: DEBUG: Created default connection workflow 2023-11-02T09:40:49.375 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.connection_workflow: DEBUG: Starting AMQP Connection workflow asynchronously. 2023-11-02T09:40:49.375 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: call_later: added timeout with deadline=933.346617591 and callback=functools.partial(>, first=True); now=933.346617591; delay=0 2023-11-02T09:40:49.376 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.connection_workflow: DEBUG: Beginning a new AMQP connection workflow cycle; attempts remaining after this: 0 2023-11-02T09:40:49.376 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: call_later: added timeout with deadline=933.346726326 and callback=>; now=933.346726326; delay=0 2023-11-02T09:40:49.376 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.connection_workflow: DEBUG: _try_next_config_async: 'localhost':5672 2023-11-02T09:40:49.376 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: add_callback_threadsafe: added callback=> 2023-11-02T09:40:49.376 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: process_timeouts: invoking callback=> 2023-11-02T09:40:49.380 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: Invoking asynchronous getaddrinfo() completion callback; host='localhost' 2023-11-02T09:40:49.380 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.connection_workflow: DEBUG: getaddrinfo returned 2 records 2023-11-02T09:40:49.380 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.connection_workflow: DEBUG: Attempting to connect using address record (, , 6, '', ('::1', 5672, 0, 0)) 2023-11-02T09:40:49.381 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.connection_workflow: INFO: Pika version 1.3.2 connecting to ('::1', 5672, 0, 0) 2023-11-02T09:40:49.381 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: add_callback_threadsafe: added callback=> 2023-11-02T09:40:49.382 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: call_later: added timeout with deadline=943.347630091 and callback=>; now=933.347630091; delay=10.0 2023-11-02T09:40:49.384 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: call_later: added timeout with deadline=948.347669993 and callback=>; now=933.347669993; delay=15.0 2023-11-02T09:40:49.384 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: process_timeouts: invoking callback=> 2023-11-02T09:40:49.385 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.set_writer(20, >) 2023-11-02T09:40:49.385 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: set_writer(20, _) added handler Wr 2023-11-02T09:40:49.385 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Connection-establishment is in progress for . 2023-11-02T09:40:49.385 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: INFO: Socket connected: 2023-11-02T09:40:49.386 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: _AsyncSocketConnector._report_completion(None); 2023-11-02T09:40:49.386 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.remove_writer(20) 2023-11-02T09:40:49.386 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: remove_writer(20) removed handler 2023-11-02T09:40:49.386 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: remove_timeout: removing timeout with deadline=943.347630091 and callback=> 2023-11-02T09:40:49.386 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.connection_workflow: DEBUG: TCP connection to broker established: . 2023-11-02T09:40:49.387 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: _AsyncStreamConnector.start(); 2023-11-02T09:40:49.387 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: add_callback_threadsafe: added callback=> 2023-11-02T09:40:49.387 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: process_timeouts: invoking callback=> 2023-11-02T09:40:49.387 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: _AsyncStreamConnector._start_async(); 2023-11-02T09:40:49.387 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: _AsyncStreamConnector._linkup() 2023-11-02T09:40:49.388 INFO:teuthology.orchestra.run.smithi156.stderr:pika.connection: DEBUG: New Connection state: CLOSED (prev=CLOSED) 2023-11-02T09:40:49.388 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Added: {'callback': >>, 'one_shot': True, 'only': None, 'arguments': None, 'calls': 1} 2023-11-02T09:40:49.388 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Added: {'callback': >>, 'one_shot': True, 'only': None, 'arguments': None, 'calls': 1} 2023-11-02T09:40:49.388 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Added: {'callback': >>, 'one_shot': False, 'only': None, 'arguments': None} 2023-11-02T09:40:49.388 INFO:teuthology.orchestra.run.smithi156.stderr:pika.connection: DEBUG: New Connection state: INIT (prev=CLOSED) 2023-11-02T09:40:49.389 INFO:teuthology.orchestra.run.smithi156.stderr:pika.connection: DEBUG: Using external connection workflow. 2023-11-02T09:40:49.389 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: _AsyncTransportBase.__init__: 2023-11-02T09:40:49.389 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.set_reader(20, >) 2023-11-02T09:40:49.389 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: set_reader(20, _) added handler Rd 2023-11-02T09:40:49.389 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: _linkup(): created transport 2023-11-02T09:40:49.390 INFO:teuthology.orchestra.run.smithi156.stderr:pika.connection: DEBUG: New Connection state: PROTOCOL (prev=INIT) 2023-11-02T09:40:49.390 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.set_writer(20, >) 2023-11-02T09:40:49.390 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: set_writer(20, _) updated handler RdWr 2023-11-02T09:40:49.390 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned on writability watcher: 2023-11-02T09:40:49.391 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: _linkup(): introduced transport to protocol ; _StreamingProtocolShim: params=> 2023-11-02T09:40:49.391 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: _AsyncStreamConnector._report_completion((, _StreamingProtocolShim: params=>)); 2023-11-02T09:40:49.391 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.connection_workflow: INFO: Streaming transport linked up: (, _StreamingProtocolShim: params=>). 2023-11-02T09:40:49.391 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Removing callback #0: {'callback': params=>>, 'one_shot': False, 'only': None, 'arguments': None} 2023-11-02T09:40:49.391 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Added: {'callback': >, 'one_shot': False, 'only': None, 'arguments': None} 2023-11-02T09:40:49.392 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Added: {'callback': >, 'one_shot': False, 'only': None, 'arguments': None} 2023-11-02T09:40:49.392 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: _AsyncStreamConnector._cleanup(False) 2023-11-02T09:40:49.392 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.remove_writer(20) 2023-11-02T09:40:49.392 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: remove_writer(20) updated handler Rd 2023-11-02T09:40:49.392 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned off writability watcher: 2023-11-02T09:40:49.393 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Processing 0:Connection.Start 2023-11-02T09:40:49.393 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Processing use of oneshot callback 2023-11-02T09:40:49.393 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: 0 registered uses left 2023-11-02T09:40:49.393 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Removing callback #0: {'callback': params=>>, 'one_shot': True, 'only': None, 'arguments': None, 'calls': 0} 2023-11-02T09:40:49.393 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Calling params=>> for "0:Connection.Start" 2023-11-02T09:40:49.394 INFO:teuthology.orchestra.run.smithi156.stderr:pika.connection: DEBUG: New Connection state: START (prev=PROTOCOL) 2023-11-02T09:40:49.394 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Added: {'callback': params=>>, 'one_shot': True, 'only': None, 'arguments': None, 'calls': 1} 2023-11-02T09:40:49.394 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.set_writer(20, >) 2023-11-02T09:40:49.394 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: set_writer(20, _) updated handler RdWr 2023-11-02T09:40:49.395 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned on writability watcher: 2023-11-02T09:40:49.395 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Recv would block on 2023-11-02T09:40:49.395 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.remove_writer(20) 2023-11-02T09:40:49.395 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: remove_writer(20) updated handler Rd 2023-11-02T09:40:49.395 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned off writability watcher: 2023-11-02T09:40:49.396 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Processing 0:Connection.Tune 2023-11-02T09:40:49.396 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Processing use of oneshot callback 2023-11-02T09:40:49.396 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: 0 registered uses left 2023-11-02T09:40:49.396 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Removing callback #0: {'callback': params=>>, 'one_shot': True, 'only': None, 'arguments': None, 'calls': 0} 2023-11-02T09:40:49.398 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Calling params=>> for "0:Connection.Tune" 2023-11-02T09:40:49.398 INFO:teuthology.orchestra.run.smithi156.stderr:pika.connection: DEBUG: New Connection state: TUNE (prev=START) 2023-11-02T09:40:49.399 INFO:teuthology.orchestra.run.smithi156.stderr:pika.connection: DEBUG: Creating a HeartbeatChecker: 60 2023-11-02T09:40:49.399 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: timeout: 60.000000 send_interval: 30.000000 check_interval: 65.000000 2023-11-02T09:40:49.399 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: call_later: added timeout with deadline=963.351649543 and callback=>; now=933.351649543; delay=30.0 2023-11-02T09:40:49.399 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: call_later: added timeout with deadline=998.351690334 and callback=>; now=933.351690334; delay=65 2023-11-02T09:40:49.399 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.set_writer(20, >) 2023-11-02T09:40:49.400 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: set_writer(20, _) updated handler RdWr 2023-11-02T09:40:49.400 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned on writability watcher: 2023-11-02T09:40:49.400 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Added: {'callback': params=>>, 'one_shot': True, 'only': None, 'arguments': None, 'calls': 1} 2023-11-02T09:40:49.400 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Recv would block on 2023-11-02T09:40:49.401 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.remove_writer(20) 2023-11-02T09:40:49.401 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: remove_writer(20) updated handler Rd 2023-11-02T09:40:49.401 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned off writability watcher: 2023-11-02T09:40:49.401 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Processing 0:Connection.OpenOk 2023-11-02T09:40:49.402 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Processing use of oneshot callback 2023-11-02T09:40:49.402 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: 0 registered uses left 2023-11-02T09:40:49.402 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Removing callback #0: {'callback': params=>>, 'one_shot': True, 'only': None, 'arguments': None, 'calls': 0} 2023-11-02T09:40:49.402 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Calling params=>> for "0:Connection.OpenOk" 2023-11-02T09:40:49.403 INFO:teuthology.orchestra.run.smithi156.stderr:pika.connection: DEBUG: New Connection state: OPEN (prev=TUNE) 2023-11-02T09:40:49.403 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Processing 0:_on_connection_open_ok 2023-11-02T09:40:49.403 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Calling > for "0:_on_connection_open_ok" 2023-11-02T09:40:49.403 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.connection_workflow: DEBUG: AMQPConnector: AMQP handshake attempt completed; state=3; error=None; 'localhost'/(, , 6, '', ('::1', 5672, 0, 0)) 2023-11-02T09:40:49.404 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.connection_workflow: DEBUG: AMQPConnector: AMQP connection established for 'localhost'/(, , 6, '', ('::1', 5672, 0, 0)): params=> 2023-11-02T09:40:49.404 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.connection_workflow: INFO: AMQPConnector - reporting success: params=> 2023-11-02T09:40:49.404 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: remove_timeout: removing timeout with deadline=948.347669993 and callback=> 2023-11-02T09:40:49.404 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.connection_workflow: DEBUG: Connection attempt completed with params=> 2023-11-02T09:40:49.405 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.connection_workflow: INFO: AMQPConnectionWorkflow - reporting success: params=> 2023-11-02T09:40:49.405 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Recv would block on 2023-11-02T09:40:49.405 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.blocking_connection: INFO: Connection workflow succeeded: params=> 2023-11-02T09:40:49.405 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Added: {'callback': >, 'one_shot': False, 'only': None, 'arguments': None} 2023-11-02T09:40:49.406 INFO:teuthology.orchestra.run.smithi156.stderr:pika.connection: DEBUG: Creating channel 1 2023-11-02T09:40:49.406 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Added: {'callback': params=>>, 'one_shot': True, 'only': params=>>, 'arguments': None, 'calls': 1} 2023-11-02T09:40:49.406 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Added: {'callback': params=>>>, 'one_shot': False, 'only': None, 'arguments': None} 2023-11-02T09:40:49.406 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Added: {'callback': params=>>>, 'one_shot': False, 'only': None, 'arguments': None} 2023-11-02T09:40:49.406 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Added: {'callback': params=>>>, 'one_shot': False, 'only': None, 'arguments': None} 2023-11-02T09:40:49.407 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Added: {'callback': params=>>>, 'one_shot': True, 'only': None, 'arguments': None, 'calls': 1} 2023-11-02T09:40:49.407 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.set_writer(20, >) 2023-11-02T09:40:49.409 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: set_writer(20, _) updated handler RdWr 2023-11-02T09:40:49.409 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned on writability watcher: 2023-11-02T09:40:49.410 INFO:teuthology.orchestra.run.smithi156.stderr:pika.channel: DEBUG: Entering blocking state on frame ; acceptable_replies=[] 2023-11-02T09:40:49.411 INFO:teuthology.orchestra.run.smithi156.stderr:pika.channel: DEBUG: Adding on_synchronous_complete callback 2023-11-02T09:40:49.411 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Added: {'callback': params=>>>, 'one_shot': True, 'only': None, 'arguments': None, 'calls': 1} 2023-11-02T09:40:49.411 INFO:teuthology.orchestra.run.smithi156.stderr:pika.channel: DEBUG: Adding passed-in RPC response callback 2023-11-02T09:40:49.413 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Added: {'callback': params=>>>, 'one_shot': True, 'only': None, 'arguments': None, 'calls': 1} 2023-11-02T09:40:49.413 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Added: {'callback': params=>>>>, 'one_shot': False, 'only': None, 'arguments': None} 2023-11-02T09:40:49.413 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Added: {'callback': >, 'one_shot': False, 'only': None, 'arguments': None} 2023-11-02T09:40:49.414 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Added: {'callback': params=>>>>, 'one_shot': False, 'only': params=>>, 'arguments': None} 2023-11-02T09:40:49.414 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Added: {'callback': >, 'one_shot': False, 'only': None, 'arguments': None} 2023-11-02T09:40:49.415 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.blocking_connection: INFO: Created channel=1 2023-11-02T09:40:49.415 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.remove_writer(20) 2023-11-02T09:40:49.416 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: remove_writer(20) updated handler Rd 2023-11-02T09:40:49.417 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned off writability watcher: 2023-11-02T09:40:49.417 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Processing 1:Channel.OpenOk 2023-11-02T09:40:49.417 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Processing use of oneshot callback 2023-11-02T09:40:49.418 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: 0 registered uses left 2023-11-02T09:40:49.418 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Removing callback #0: {'callback': params=>>>, 'one_shot': True, 'only': None, 'arguments': None, 'calls': 0} 2023-11-02T09:40:49.420 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Processing use of oneshot callback 2023-11-02T09:40:49.425 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: 0 registered uses left 2023-11-02T09:40:49.425 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Removing callback #0: {'callback': params=>>>, 'one_shot': True, 'only': None, 'arguments': None, 'calls': 0} 2023-11-02T09:40:49.425 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Calling params=>>> for "1:Channel.OpenOk" 2023-11-02T09:40:49.426 INFO:teuthology.orchestra.run.smithi156.stderr:pika.channel: DEBUG: 0 blocked frames 2023-11-02T09:40:49.426 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Calling params=>>> for "1:Channel.OpenOk" 2023-11-02T09:40:49.426 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Recv would block on 2023-11-02T09:40:49.426 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.set_writer(20, >) 2023-11-02T09:40:49.427 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: set_writer(20, _) updated handler RdWr 2023-11-02T09:40:49.427 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned on writability watcher: 2023-11-02T09:40:49.427 INFO:teuthology.orchestra.run.smithi156.stderr:pika.channel: DEBUG: Entering blocking state on frame ; acceptable_replies=[] 2023-11-02T09:40:49.427 INFO:teuthology.orchestra.run.smithi156.stderr:pika.channel: DEBUG: Adding on_synchronous_complete callback 2023-11-02T09:40:49.427 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Added: {'callback': params=>>>, 'one_shot': True, 'only': None, 'arguments': None, 'calls': 1} 2023-11-02T09:40:49.428 INFO:teuthology.orchestra.run.smithi156.stderr:pika.channel: DEBUG: Adding passed-in RPC response callback 2023-11-02T09:40:49.428 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Added: {'callback': >, 'one_shot': True, 'only': None, 'arguments': None, 'calls': 1} 2023-11-02T09:40:49.428 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.remove_writer(20) 2023-11-02T09:40:49.428 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: remove_writer(20) updated handler Rd 2023-11-02T09:40:49.428 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned off writability watcher: 2023-11-02T09:40:49.429 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Processing 1:Exchange.DeclareOk 2023-11-02T09:40:49.430 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Processing use of oneshot callback 2023-11-02T09:40:49.430 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: 0 registered uses left 2023-11-02T09:40:49.431 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Removing callback #0: {'callback': params=>>>, 'one_shot': True, 'only': None, 'arguments': None, 'calls': 0} 2023-11-02T09:40:49.431 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Processing use of oneshot callback 2023-11-02T09:40:49.431 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: 0 registered uses left 2023-11-02T09:40:49.432 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Removing callback #0: {'callback': >, 'one_shot': True, 'only': None, 'arguments': None, 'calls': 0} 2023-11-02T09:40:49.432 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Calling params=>>> for "1:Exchange.DeclareOk" 2023-11-02T09:40:49.432 INFO:teuthology.orchestra.run.smithi156.stderr:pika.channel: DEBUG: 0 blocked frames 2023-11-02T09:40:49.432 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Calling > for "1:Exchange.DeclareOk" 2023-11-02T09:40:49.432 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Recv would block on 2023-11-02T09:40:49.433 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.set_writer(20, >) 2023-11-02T09:40:49.433 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: set_writer(20, _) updated handler RdWr 2023-11-02T09:40:49.434 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned on writability watcher: 2023-11-02T09:40:49.434 INFO:teuthology.orchestra.run.smithi156.stderr:pika.channel: DEBUG: Entering blocking state on frame ; acceptable_replies=[] 2023-11-02T09:40:49.435 INFO:teuthology.orchestra.run.smithi156.stderr:pika.channel: DEBUG: Adding on_synchronous_complete callback 2023-11-02T09:40:49.435 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Added: {'callback': params=>>>, 'one_shot': True, 'only': None, 'arguments': None, 'calls': 1} 2023-11-02T09:40:49.435 INFO:teuthology.orchestra.run.smithi156.stderr:pika.channel: DEBUG: Adding passed-in RPC response callback 2023-11-02T09:40:49.435 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Added: {'callback': >, 'one_shot': True, 'only': None, 'arguments': None, 'calls': 1} 2023-11-02T09:40:49.435 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.remove_writer(20) 2023-11-02T09:40:49.436 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: remove_writer(20) updated handler Rd 2023-11-02T09:40:49.436 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned off writability watcher: 2023-11-02T09:40:49.437 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Processing 1:Queue.DeclareOk 2023-11-02T09:40:49.437 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Processing use of oneshot callback 2023-11-02T09:40:49.437 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: 0 registered uses left 2023-11-02T09:40:49.437 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Removing callback #0: {'callback': params=>>>, 'one_shot': True, 'only': None, 'arguments': None, 'calls': 0} 2023-11-02T09:40:49.437 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Processing use of oneshot callback 2023-11-02T09:40:49.438 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: 0 registered uses left 2023-11-02T09:40:49.438 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Removing callback #0: {'callback': >, 'one_shot': True, 'only': None, 'arguments': None, 'calls': 0} 2023-11-02T09:40:49.438 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Calling params=>>> for "1:Queue.DeclareOk" 2023-11-02T09:40:49.438 INFO:teuthology.orchestra.run.smithi156.stderr:pika.channel: DEBUG: 0 blocked frames 2023-11-02T09:40:49.439 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Calling > for "1:Queue.DeclareOk" 2023-11-02T09:40:49.439 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Recv would block on 2023-11-02T09:40:49.439 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.set_writer(20, >) 2023-11-02T09:40:49.439 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: set_writer(20, _) updated handler RdWr 2023-11-02T09:40:49.439 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned on writability watcher: 2023-11-02T09:40:49.440 INFO:teuthology.orchestra.run.smithi156.stderr:pika.channel: DEBUG: Entering blocking state on frame ; acceptable_replies=[] 2023-11-02T09:40:49.440 INFO:teuthology.orchestra.run.smithi156.stderr:pika.channel: DEBUG: Adding on_synchronous_complete callback 2023-11-02T09:40:49.441 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Added: {'callback': params=>>>, 'one_shot': True, 'only': None, 'arguments': None, 'calls': 1} 2023-11-02T09:40:49.442 INFO:teuthology.orchestra.run.smithi156.stderr:pika.channel: DEBUG: Adding passed-in RPC response callback 2023-11-02T09:40:49.442 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Added: {'callback': >, 'one_shot': True, 'only': None, 'arguments': None, 'calls': 1} 2023-11-02T09:40:49.443 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.remove_writer(20) 2023-11-02T09:40:49.443 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: remove_writer(20) updated handler Rd 2023-11-02T09:40:49.443 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned off writability watcher: 2023-11-02T09:40:49.443 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Processing 1:Queue.BindOk 2023-11-02T09:40:49.444 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Processing use of oneshot callback 2023-11-02T09:40:49.444 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: 0 registered uses left 2023-11-02T09:40:49.444 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Removing callback #0: {'callback': params=>>>, 'one_shot': True, 'only': None, 'arguments': None, 'calls': 0} 2023-11-02T09:40:49.444 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Processing use of oneshot callback 2023-11-02T09:40:49.444 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: 0 registered uses left 2023-11-02T09:40:49.445 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Removing callback #0: {'callback': >, 'one_shot': True, 'only': None, 'arguments': None, 'calls': 0} 2023-11-02T09:40:49.445 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Calling params=>>> for "1:Queue.BindOk" 2023-11-02T09:40:49.445 INFO:teuthology.orchestra.run.smithi156.stderr:pika.channel: DEBUG: 0 blocked frames 2023-11-02T09:40:49.445 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Calling > for "1:Queue.BindOk" 2023-11-02T09:40:49.445 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Recv would block on 2023-11-02T09:40:49.446 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.set_writer(20, >) 2023-11-02T09:40:49.446 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: set_writer(20, _) updated handler RdWr 2023-11-02T09:40:49.446 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned on writability watcher: 2023-11-02T09:40:49.446 INFO:teuthology.orchestra.run.smithi156.stderr:pika.channel: DEBUG: Entering blocking state on frame ; acceptable_replies=[(, {'consumer_tag': 'ctag1.83f3ebec462444dcbbcd3f7dcff78dd8'})] 2023-11-02T09:40:49.446 INFO:teuthology.orchestra.run.smithi156.stderr:pika.channel: DEBUG: Adding on_synchronous_complete callback 2023-11-02T09:40:49.449 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Added: {'callback': params=>>>, 'one_shot': True, 'only': None, 'arguments': {'consumer_tag': 'ctag1.83f3ebec462444dcbbcd3f7dcff78dd8'}, 'calls': 1} 2023-11-02T09:40:49.449 INFO:teuthology.orchestra.run.smithi156.stderr:pika.channel: DEBUG: Adding passed-in RPC response callback 2023-11-02T09:40:49.450 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Added: {'callback': params=>>>, 'one_shot': True, 'only': None, 'arguments': {'consumer_tag': 'ctag1.83f3ebec462444dcbbcd3f7dcff78dd8'}, 'calls': 1} 2023-11-02T09:40:49.450 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.remove_writer(20) 2023-11-02T09:40:49.451 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: remove_writer(20) updated handler Rd 2023-11-02T09:40:49.451 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned off writability watcher: 2023-11-02T09:40:49.452 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Processing 1:Basic.ConsumeOk 2023-11-02T09:40:49.452 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Processing use of oneshot callback 2023-11-02T09:40:49.452 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: 0 registered uses left 2023-11-02T09:40:49.453 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Comparing {'consumer_tag': 'ctag1.83f3ebec462444dcbbcd3f7dcff78dd8'} to {'consumer_tag': 'ctag1.83f3ebec462444dcbbcd3f7dcff78dd8'} 2023-11-02T09:40:49.453 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Removing callback #1: {'callback': params=>>>, 'one_shot': True, 'only': None, 'arguments': {'consumer_tag': 'ctag1.83f3ebec462444dcbbcd3f7dcff78dd8'}, 'calls': 0} 2023-11-02T09:40:49.453 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Processing use of oneshot callback 2023-11-02T09:40:49.453 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: 0 registered uses left 2023-11-02T09:40:49.453 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Comparing {'consumer_tag': 'ctag1.83f3ebec462444dcbbcd3f7dcff78dd8'} to {'consumer_tag': 'ctag1.83f3ebec462444dcbbcd3f7dcff78dd8'} 2023-11-02T09:40:49.454 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Removing callback #1: {'callback': params=>>>, 'one_shot': True, 'only': None, 'arguments': {'consumer_tag': 'ctag1.83f3ebec462444dcbbcd3f7dcff78dd8'}, 'calls': 0} 2023-11-02T09:40:49.454 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Calling > for "1:Basic.ConsumeOk" 2023-11-02T09:40:49.455 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Calling params=>>> for "1:Basic.ConsumeOk" 2023-11-02T09:40:49.456 INFO:teuthology.orchestra.run.smithi156.stderr:pika.channel: DEBUG: 0 blocked frames 2023-11-02T09:40:49.456 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Calling params=>>> for "1:Basic.ConsumeOk" 2023-11-02T09:40:49.456 INFO:teuthology.orchestra.run.smithi156.stderr:pika.channel: DEBUG: Discarding frame "])> 2023-11-02T09:40:49.456 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Recv would block on 2023-11-02T09:40:49.456 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP receiver started 2023-11-02T09:40:49.457 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.hooks: DEBUG: Event choose-service-name: calling handler 2023-11-02T09:40:49.457 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.hooks: DEBUG: Event creating-client-class.sns: calling handler 2023-11-02T09:40:49.457 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.regions: DEBUG: Creating a regex based endpoint for sns, default 2023-11-02T09:40:49.457 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.endpoint: DEBUG: Setting sns timeout as (60, 60) 2023-11-02T09:40:49.457 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.client: DEBUG: Registering retry handlers for service: sns 2023-11-02T09:40:49.458 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.hooks: DEBUG: Event before-parameter-build.sns.CreateTopic: calling handler 2023-11-02T09:40:49.458 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.regions: DEBUG: Calling endpoint provider with parameters: {'Region': 'default', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi156.front.sepia.ceph.com:80'} 2023-11-02T09:40:49.458 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.regions: DEBUG: Endpoint provider result: http://smithi156.front.sepia.ceph.com:80 2023-11-02T09:40:49.458 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.hooks: DEBUG: Event before-call.sns.CreateTopic: calling handler 2023-11-02T09:40:49.459 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.hooks: DEBUG: Event before-call.sns.CreateTopic: calling handler 2023-11-02T09:40:49.459 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.endpoint: DEBUG: Making request for OperationModel(name=CreateTopic) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.28.76 md/Botocore#1.31.76 ua/2.0 os/linux#5.14.0-378.el9.x86_64 md/arch#x86_64 lang/python#3.9.17 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.76'}, 'body': {'Action': 'CreateTopic', 'Version': '2010-03-31', 'Name': 'uicwqr-12_topic', 'Attributes.entry.1.key': 'push-endpoint', 'Attributes.entry.1.value': 'amqp://localhost', 'Attributes.entry.2.key': 'OpaqueData', 'Attributes.entry.2.value': 'ucxLntwRZkjUUicrmyZIXBkCasKQItvBVqIaEdKuCDjykjmwvSPHHhfHKudGdcbMwCLSDdRVATwVvfdOVoeAvOmBwitGCIwnxGyxvriPlHbDkZRQUECEtMnBiQGQZNCgIjQtoTssixbtgsMkrHRINQfiIenBmslVVnHVJHvyQrALRhhuJvfXCeFGMhbsgWeTFCOajLtaWBwkVXvnXJhGeVfhBzJvsevqSruvSMVGTareKFdGEGaZWYvjbBENkPlNEwUPqbnHttaJUqtXyvJCJoJzdxPyeHXqISLdIsmGOPZfmVXzOjlWdbClvckHtBiFbTFYYVqMVJAAatpcCxQXeQPqUqBofayPlevFlDCtfHxtpmDGGwdaMdeIVtDKqcAGkQkjBMskbRWDwdVpkjWeIdgeeWcbJEudTQWzwSDHYBdNeFbzEuIgcvAYOhTgHjpcnbUQVkDsuCjNtSCFCvfwFrNOyaAkAPXcPDXLRVAXMZjMuFWOZPIUNpbkRuixuJZUaeojWDTqkzNAXzgFZvToHbJaftEmViTasbyFMqAhiYPBbmszphHhhIUMgJPEJZEoLVUWwpgVsRcNcmpfUCIGUKsjGBTQquSLbJqTTuelganjHcvSaRpQJvIVAJyHBnxbeoyvanAOLzQgfgMXKxcusFTjqbkRxDPlRkopIKfMNOgugqaeIvTXgBrCBpUfkdzQdSndFmZKNxteMEnFwXPFgTMZfuFLUbAqXLAUmhAJuFbwzxEgvPMYOCQOWoRTTRseojTZWnbyqIrnNHDafZOsgalviPShfOxrnRQcYZjSyeiUDnUJvSmlPdfriDCumKebqjxgNVvabqIpAJwoSXtLuJgKXyobNZidXizmGJRgcCgIPpppmXbqaXMvecsDVWwyWIvpHyxjgfHWfPxMJwjHxkxlyAvJgKAdZFVHmgEuCfolLFeHJFWlKlXhSgsKDDMoJxKjkwmNoNimMBeghGmQpctKcvObHLpqkOPZVzzCdxXfyIlQpDCpVaimveiyrHIjVAvnIJlceIGtzBXSqZEpVwYQrpesLmnuWtvmwBrvReVqfungYLkTyirWGQIwSoXAszpxvgzuucFeXGlFgpnHJkEdbWwuNkxupIQsIRJWSMjwwdPFXKfbETaAkrTnHQASYmhIoJoNRvpxiQPxREDBbWmYfrwsaoZVKSjjnJCpSMhXummLhfdwLvFOpJJePYxwopxQGVTaPPUSjqnBjuPyOIqLaGiqKqFuOFbJZUOKadLhFJPUQVZAWALgmwZrHRBSHmdrdNcEVvlpJLXGVFMetRtYcXJFzekYoHsqneCjVbmFnHcRIHHowylirESDzZeyrKlIFccQYUlfVgpxQaZIyvpPQVFVnUEqDHJJKNIcuDhaOkOZJEOvxvtcnupJyTrWCYLlhigzRbkkwMnRGNVWUqzymdzcHmYwOiaLhxSIViAhDuDFtZBjRdICwQcnItrnHMNdRTaZNCkOaklgacQHfweUaQtvLeCGIJQMNEBlGHbjnUnYDcBvOnswZOJOBzdRgKXyRFTzIgqJOuMYjDfyJkRYmhehZqzjGxnDdquZvFIOEuhhrEzdllaRogHxGQycnlCpmAnwNYwpiIoKvVNIVutOmtdVrrvoliKUlHIElqViynIdGWtnjXTDbpCxbhQIMJbUhiclypaoMShZvCMxgEHAZoGvNgtWFucdoFlaSerHPKEAWPNaxqtPkuAHLwpuifTSTbqvIiPKbokNaJEGaODEiogAecchhvKELvHJgHKiclZTosguFGqkokrlkAfpVqMPZMFsJbAnRPBXPTwWjIqIWZvVZlUIhCbRunRohOULlxxbjKicGRhIjhdpvaUKCpKNcOrKNuildswUydZqLOwetIRyUHFjdsBxVGpJqSdRoVOEaebqCyjPFByjrjMllyrxrWVJwEqfirlFNlUyCLhTVcyCLoMhcVBtOQWycfeAyaSfAbmeRxXuOwJSsPSPjceofZQeqsGciALtxeqQwmMsyReoVzqzZolVOvGgRfmuuFxzMAmJPvGPzvwkmxgX', 'Attributes.entry.3.key': 'amqp-exchange', 'Attributes.entry.3.value': 'ex1', 'Attributes.entry.4.key': 'amqp-ack-level', 'Attributes.entry.4.value': 'broker', 'Attributes.entry.5.key': 'persistent', 'Attributes.entry.5.value': 'true'}, 'url': 'http://smithi156.front.sepia.ceph.com:80/', 'context': {'client_region': 'default', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2023-11-02T09:40:49.459 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.hooks: DEBUG: Event request-created.sns.CreateTopic: calling handler > 2023-11-02T09:40:49.460 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.hooks: DEBUG: Event choose-signer.sns.CreateTopic: calling handler 2023-11-02T09:40:49.460 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.auth: DEBUG: Calculating signature using v4 auth. 2023-11-02T09:40:49.460 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.auth: DEBUG: CanonicalRequest: 2023-11-02T09:40:49.460 INFO:teuthology.orchestra.run.smithi156.stderr:POST 2023-11-02T09:40:49.460 INFO:teuthology.orchestra.run.smithi156.stderr:/ 2023-11-02T09:40:49.461 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:49.462 INFO:teuthology.orchestra.run.smithi156.stderr:content-type:application/x-www-form-urlencoded; charset=utf-8 2023-11-02T09:40:49.462 INFO:teuthology.orchestra.run.smithi156.stderr:host:smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.462 INFO:teuthology.orchestra.run.smithi156.stderr:x-amz-date:20231102T093259Z 2023-11-02T09:40:49.463 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:49.463 INFO:teuthology.orchestra.run.smithi156.stderr:content-type;host;x-amz-date 2023-11-02T09:40:49.464 INFO:teuthology.orchestra.run.smithi156.stderr:0eabf47320926356067d651d96fc1fd827ec4f7704a864e2a186fedde8c7d3a4 2023-11-02T09:40:49.464 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.auth: DEBUG: StringToSign: 2023-11-02T09:40:49.464 INFO:teuthology.orchestra.run.smithi156.stderr:AWS4-HMAC-SHA256 2023-11-02T09:40:49.464 INFO:teuthology.orchestra.run.smithi156.stderr:20231102T093259Z 2023-11-02T09:40:49.464 INFO:teuthology.orchestra.run.smithi156.stderr:20231102/default/sns/aws4_request 2023-11-02T09:40:49.465 INFO:teuthology.orchestra.run.smithi156.stderr:f39967d8491a1f54965cecac4da5b78fec7e208e7386f53f7b5b1a19ff270cef 2023-11-02T09:40:49.465 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.auth: DEBUG: Signature: 2023-11-02T09:40:49.465 INFO:teuthology.orchestra.run.smithi156.stderr:b9cdfa539eb0abd223b24873c8122cf9a2d7a2c8b0e3a2dbd824ab8e74e843a7 2023-11-02T09:40:49.465 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.hooks: DEBUG: Event request-created.sns.CreateTopic: calling handler 2023-11-02T09:40:49.465 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.endpoint: DEBUG: Sending http request: 2023-11-02T09:40:49.466 INFO:teuthology.orchestra.run.smithi156.stderr:urllib3.connectionpool: DEBUG: Starting new HTTP connection (1): smithi156.front.sepia.ceph.com:80 2023-11-02T09:40:49.466 INFO:teuthology.orchestra.run.smithi156.stderr:urllib3.connectionpool: DEBUG: http://smithi156.front.sepia.ceph.com:80 "POST / HTTP/1.1" 200 311 2023-11-02T09:40:49.466 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.parsers: DEBUG: Response headers: {'x-amz-request-id': 'tx00000fecc4f7ab3bec20c-0065436ccb-117b-default', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (reef)', 'Content-Length': '311', 'Date': 'Thu, 02 Nov 2023 09:32:59 GMT', 'Connection': 'Keep-Alive'} 2023-11-02T09:40:49.466 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.parsers: DEBUG: Response body: 2023-11-02T09:40:49.467 INFO:teuthology.orchestra.run.smithi156.stderr:b'arn:aws:sns:default::uicwqr-12_topic8100026f-34ce-4e78-9bac-c57f344b7c64.4475.18360137169302897164' 2023-11-02T09:40:49.467 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.hooks: DEBUG: Event needs-retry.sns.CreateTopic: calling handler 2023-11-02T09:40:49.467 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.retryhandler: DEBUG: No retry needed. 2023-11-02T09:40:49.467 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.hooks: DEBUG: Event choose-service-name: calling handler 2023-11-02T09:40:49.467 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.hooks: DEBUG: Event creating-client-class.s3: calling handler 2023-11-02T09:40:49.467 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.hooks: DEBUG: Event creating-client-class.s3: calling handler ._handler at 0x7f0477f87ee0> 2023-11-02T09:40:49.468 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.hooks: DEBUG: Event creating-client-class.s3: calling handler 2023-11-02T09:40:49.468 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.endpoint: DEBUG: Setting s3 timeout as (60, 60) 2023-11-02T09:40:49.468 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.client: DEBUG: Registering retry handlers for service: s3 2023-11-02T09:40:49.468 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.utils: DEBUG: Registering S3 region redirector handler 2023-11-02T09:40:49.468 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.hooks: DEBUG: Event before-parameter-build.s3.PutBucketNotificationConfiguration: calling handler 2023-11-02T09:40:49.469 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.hooks: DEBUG: Event before-parameter-build.s3.PutBucketNotificationConfiguration: calling handler 2023-11-02T09:40:49.469 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.hooks: DEBUG: Event before-parameter-build.s3.PutBucketNotificationConfiguration: calling handler > 2023-11-02T09:40:49.469 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.hooks: DEBUG: Event before-parameter-build.s3.PutBucketNotificationConfiguration: calling handler 2023-11-02T09:40:49.470 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.hooks: DEBUG: Event before-endpoint-resolution.s3: calling handler 2023-11-02T09:40:49.470 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.hooks: DEBUG: Event before-endpoint-resolution.s3: calling handler > 2023-11-02T09:40:49.470 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.regions: DEBUG: Calling endpoint provider with parameters: {'Bucket': 'uicwqr-12', 'Region': 'us-east-1', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://smithi156.front.sepia.ceph.com:80', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': True, 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True} 2023-11-02T09:40:49.470 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.regions: DEBUG: Endpoint provider result: http://smithi156.front.sepia.ceph.com:80/uicwqr-12 2023-11-02T09:40:49.471 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.regions: DEBUG: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None" 2023-11-02T09:40:49.471 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.regions: DEBUG: Selected auth type "v4" as "v4" with signing context params: {'region': 'us-east-1', 'signing_name': 's3', 'disableDoubleEncoding': True} 2023-11-02T09:40:49.472 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.hooks: DEBUG: Event before-call.s3.PutBucketNotificationConfiguration: calling handler 2023-11-02T09:40:49.472 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.hooks: DEBUG: Event before-call.s3.PutBucketNotificationConfiguration: calling handler 2023-11-02T09:40:49.472 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.hooks: DEBUG: Event before-call.s3.PutBucketNotificationConfiguration: calling handler 2023-11-02T09:40:49.472 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.endpoint: DEBUG: Making request for OperationModel(name=PutBucketNotificationConfiguration) with params: {'url_path': '?notification', 'query_string': {}, 'method': 'PUT', 'headers': {'User-Agent': 'Boto3/1.28.76 md/Botocore#1.31.76 ua/2.0 os/linux#5.14.0-378.el9.x86_64 md/arch#x86_64 lang/python#3.9.17 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.76'}, 'body': b'uicwqr-12_notifarn:aws:sns:default::uicwqr-12_topic', 'auth_path': '/uicwqr-12/', 'url': 'http://smithi156.front.sepia.ceph.com:80/uicwqr-12?notification', 'context': {'client_region': 'us-east-1', 'client_config': , 'has_streaming_input': False, 'auth_type': 'v4', 's3_redirect': {'redirected': False, 'bucket': 'uicwqr-12', 'params': {'Bucket': 'uicwqr-12', 'NotificationConfiguration': {'TopicConfigurations': [{'Id': 'uicwqr-12_notif', 'TopicArn': 'arn:aws:sns:default::uicwqr-12_topic', 'Events': []}]}}}, 'signing': {'region': 'us-east-1', 'signing_name': 's3', 'disableDoubleEncoding': True}}} 2023-11-02T09:40:49.473 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.hooks: DEBUG: Event request-created.s3.PutBucketNotificationConfiguration: calling handler > 2023-11-02T09:40:49.473 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.hooks: DEBUG: Event choose-signer.s3.PutBucketNotificationConfiguration: calling handler > 2023-11-02T09:40:49.473 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.hooks: DEBUG: Event choose-signer.s3.PutBucketNotificationConfiguration: calling handler 2023-11-02T09:40:49.473 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.hooks: DEBUG: Event before-sign.s3.PutBucketNotificationConfiguration: calling handler 2023-11-02T09:40:49.473 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.auth: DEBUG: Calculating signature using v4 auth. 2023-11-02T09:40:49.474 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.auth: DEBUG: CanonicalRequest: 2023-11-02T09:40:49.474 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.474 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12 2023-11-02T09:40:49.474 INFO:teuthology.orchestra.run.smithi156.stderr:notification= 2023-11-02T09:40:49.474 INFO:teuthology.orchestra.run.smithi156.stderr:host:smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.475 INFO:teuthology.orchestra.run.smithi156.stderr:x-amz-content-sha256:75e7d1ff7e56875fb3a724031062ec40cfc28684b72dc78c50e1e025bff471c0 2023-11-02T09:40:49.475 INFO:teuthology.orchestra.run.smithi156.stderr:x-amz-date:20231102T093259Z 2023-11-02T09:40:49.475 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:49.475 INFO:teuthology.orchestra.run.smithi156.stderr:host;x-amz-content-sha256;x-amz-date 2023-11-02T09:40:49.476 INFO:teuthology.orchestra.run.smithi156.stderr:75e7d1ff7e56875fb3a724031062ec40cfc28684b72dc78c50e1e025bff471c0 2023-11-02T09:40:49.476 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.auth: DEBUG: StringToSign: 2023-11-02T09:40:49.476 INFO:teuthology.orchestra.run.smithi156.stderr:AWS4-HMAC-SHA256 2023-11-02T09:40:49.476 INFO:teuthology.orchestra.run.smithi156.stderr:20231102T093259Z 2023-11-02T09:40:49.476 INFO:teuthology.orchestra.run.smithi156.stderr:20231102/us-east-1/s3/aws4_request 2023-11-02T09:40:49.477 INFO:teuthology.orchestra.run.smithi156.stderr:e5f05258d172898d1c85618a903220b9c56d4e9751cc5a0c205360795d2bb484 2023-11-02T09:40:49.477 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.auth: DEBUG: Signature: 2023-11-02T09:40:49.477 INFO:teuthology.orchestra.run.smithi156.stderr:01bdb09b105604cff3bfbcab0bf4551223269fbf50d614a3392f78ccb69ce257 2023-11-02T09:40:49.477 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.hooks: DEBUG: Event request-created.s3.PutBucketNotificationConfiguration: calling handler 2023-11-02T09:40:49.477 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.endpoint: DEBUG: Sending http request: 2023-11-02T09:40:49.478 INFO:teuthology.orchestra.run.smithi156.stderr:urllib3.connectionpool: DEBUG: Starting new HTTP connection (1): smithi156.front.sepia.ceph.com:80 2023-11-02T09:40:49.478 INFO:teuthology.orchestra.run.smithi156.stderr:urllib3.connectionpool: DEBUG: http://smithi156.front.sepia.ceph.com:80 "PUT /uicwqr-12?notification HTTP/1.1" 200 0 2023-11-02T09:40:49.478 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.parsers: DEBUG: Response headers: {'x-amz-request-id': 'tx00000eefb1a47130bb4ca-0065436ccb-117b-default', 'Server': 'Ceph Object Gateway (reef)', 'Content-Length': '0', 'Date': 'Thu, 02 Nov 2023 09:32:59 GMT', 'Connection': 'Keep-Alive'} 2023-11-02T09:40:49.478 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.parsers: DEBUG: Response body: 2023-11-02T09:40:49.479 INFO:teuthology.orchestra.run.smithi156.stderr:b'' 2023-11-02T09:40:49.479 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.hooks: DEBUG: Event needs-retry.s3.PutBucketNotificationConfiguration: calling handler 2023-11-02T09:40:49.479 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.retryhandler: DEBUG: No retry needed. 2023-11-02T09:40:49.479 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.hooks: DEBUG: Event needs-retry.s3.PutBucketNotificationConfiguration: calling handler > 2023-11-02T09:40:49.479 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/vikrxQVaAIpbdktKdDBPRVQoKSryMeLpIKYwMeQereCmLrwifRFEFKlryKjHLRO 2023-11-02T09:40:49.480 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/vikrxQVaAIpbdktKdDBPRVQoKSryMeLpIKYwMeQereCmLrwifRFEFKlryKjHLRO 2023-11-02T09:40:49.480 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.480 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/vikrxQVaAIpbdktKdDBPRVQoKSryMeLpIKYwMeQereCmLrwifRFEFKlryKjHLRO 2023-11-02T09:40:49.480 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.481 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'YhILe4zRbfn1PKk4PlDfjA==', 'Content-Length': '3011002', 'Expect': '100-Continue'} 2023-11-02T09:40:49.481 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.481 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.488 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.489 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.489 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.489 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.489 INFO:teuthology.orchestra.run.smithi156.stderr:YhILe4zRbfn1PKk4PlDfjA== 2023-11-02T09:40:49.490 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.490 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:59 GMT 2023-11-02T09:40:49.490 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/vikrxQVaAIpbdktKdDBPRVQoKSryMeLpIKYwMeQereCmLrwifRFEFKlryKjHLRO 2023-11-02T09:40:49.490 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.490 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:5L9MIc7QlpuyUSOJi+mLgfKYfXY= 2023-11-02T09:40:49.491 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'YhILe4zRbfn1PKk4PlDfjA==', 'Content-Length': '3011002', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:32:59 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:5L9MIc7QlpuyUSOJi+mLgfKYfXY='} 2023-11-02T09:40:49.491 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/KCYqtxTveIhtBZjMdINalXgbqeAahGpiJSlEjZkjuhgfMTHyrcOVvydrTlAauOb 2023-11-02T09:40:49.491 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/KCYqtxTveIhtBZjMdINalXgbqeAahGpiJSlEjZkjuhgfMTHyrcOVvydrTlAauOb 2023-11-02T09:40:49.491 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.491 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/KCYqtxTveIhtBZjMdINalXgbqeAahGpiJSlEjZkjuhgfMTHyrcOVvydrTlAauOb 2023-11-02T09:40:49.492 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.492 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'QpAIXoMYhhoOCcm0BrXbaQ==', 'Content-Length': '3009412', 'Expect': '100-Continue'} 2023-11-02T09:40:49.492 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.492 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.493 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.493 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:49.495 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.495 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.495 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.495 INFO:teuthology.orchestra.run.smithi156.stderr:QpAIXoMYhhoOCcm0BrXbaQ== 2023-11-02T09:40:49.495 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.496 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:59 GMT 2023-11-02T09:40:49.496 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/KCYqtxTveIhtBZjMdINalXgbqeAahGpiJSlEjZkjuhgfMTHyrcOVvydrTlAauOb 2023-11-02T09:40:49.496 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.496 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:sm2/u4oyBQz5MXGe5Qq6jbg7sWg= 2023-11-02T09:40:49.497 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'QpAIXoMYhhoOCcm0BrXbaQ==', 'Content-Length': '3009412', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:32:59 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:sm2/u4oyBQz5MXGe5Qq6jbg7sWg='} 2023-11-02T09:40:49.497 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/UkCXCfRLmuiNsfYavyQKfjzIQJcnJHphlEvYsvneMONgWfzulOXqsAELOGBuiSG 2023-11-02T09:40:49.497 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/UkCXCfRLmuiNsfYavyQKfjzIQJcnJHphlEvYsvneMONgWfzulOXqsAELOGBuiSG 2023-11-02T09:40:49.497 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.497 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/UkCXCfRLmuiNsfYavyQKfjzIQJcnJHphlEvYsvneMONgWfzulOXqsAELOGBuiSG 2023-11-02T09:40:49.498 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.498 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'wC16bx1hwst0uuwrsNhD4g==', 'Content-Length': '3013166', 'Expect': '100-Continue'} 2023-11-02T09:40:49.498 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.498 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.499 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.499 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:49.499 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.499 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.499 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.500 INFO:teuthology.orchestra.run.smithi156.stderr:wC16bx1hwst0uuwrsNhD4g== 2023-11-02T09:40:49.500 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.500 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:59 GMT 2023-11-02T09:40:49.500 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/UkCXCfRLmuiNsfYavyQKfjzIQJcnJHphlEvYsvneMONgWfzulOXqsAELOGBuiSG 2023-11-02T09:40:49.500 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.501 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:MYBKs/Lwx7nrGB7sRTGOeuT/52Y= 2023-11-02T09:40:49.501 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'wC16bx1hwst0uuwrsNhD4g==', 'Content-Length': '3013166', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:32:59 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:MYBKs/Lwx7nrGB7sRTGOeuT/52Y='} 2023-11-02T09:40:49.501 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/xfVwBaSreNsrsBTAyHbaonNgXRJUIbnNeBJBwnWNpqHkrZzpWnKlJvhoigQjkbX 2023-11-02T09:40:49.501 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/xfVwBaSreNsrsBTAyHbaonNgXRJUIbnNeBJBwnWNpqHkrZzpWnKlJvhoigQjkbX 2023-11-02T09:40:49.501 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.502 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/xfVwBaSreNsrsBTAyHbaonNgXRJUIbnNeBJBwnWNpqHkrZzpWnKlJvhoigQjkbX 2023-11-02T09:40:49.502 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.502 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'Ly3I43tmi+gs/mcEKLJhyw==', 'Content-Length': '3009084', 'Expect': '100-Continue'} 2023-11-02T09:40:49.502 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.502 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.503 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.503 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:49.503 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.504 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.504 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.504 INFO:teuthology.orchestra.run.smithi156.stderr:Ly3I43tmi+gs/mcEKLJhyw== 2023-11-02T09:40:49.504 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.505 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:59 GMT 2023-11-02T09:40:49.508 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/xfVwBaSreNsrsBTAyHbaonNgXRJUIbnNeBJBwnWNpqHkrZzpWnKlJvhoigQjkbX 2023-11-02T09:40:49.508 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.508 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:lVgtcKh4MO9lcIAAqTg0z7ME5O8= 2023-11-02T09:40:49.509 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'Ly3I43tmi+gs/mcEKLJhyw==', 'Content-Length': '3009084', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:32:59 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:lVgtcKh4MO9lcIAAqTg0z7ME5O8='} 2023-11-02T09:40:49.509 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"62120b7b8cd16df9f53ca9383e50df8c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000fc12950ddfa914be-0065436ccb-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:59 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:49.509 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/xFdaqMfespXAmxLwFIulZGwENriRPcKExLNlLPirTSPVdhNNObhVafyBKOWbTYv 2023-11-02T09:40:49.509 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/xFdaqMfespXAmxLwFIulZGwENriRPcKExLNlLPirTSPVdhNNObhVafyBKOWbTYv 2023-11-02T09:40:49.509 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.510 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/xFdaqMfespXAmxLwFIulZGwENriRPcKExLNlLPirTSPVdhNNObhVafyBKOWbTYv 2023-11-02T09:40:49.510 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.510 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'nl04DqnXjloy5INZfl8sdg==', 'Content-Length': '3010756', 'Expect': '100-Continue'} 2023-11-02T09:40:49.510 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.510 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.511 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.511 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.511 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.511 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.512 INFO:teuthology.orchestra.run.smithi156.stderr:nl04DqnXjloy5INZfl8sdg== 2023-11-02T09:40:49.512 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.512 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:59 GMT 2023-11-02T09:40:49.512 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/xFdaqMfespXAmxLwFIulZGwENriRPcKExLNlLPirTSPVdhNNObhVafyBKOWbTYv 2023-11-02T09:40:49.512 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.513 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:xLtclkiQyEEk7XoOmxS0wGyMJ5A= 2023-11-02T09:40:49.513 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'nl04DqnXjloy5INZfl8sdg==', 'Content-Length': '3010756', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:32:59 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:xLtclkiQyEEk7XoOmxS0wGyMJ5A='} 2023-11-02T09:40:49.513 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/AacoLFvitKmMGfsgGYKquSWPKpmbfVOcFhIzXryFgbCUCPdXzkbsNRaKaefkGCo 2023-11-02T09:40:49.513 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/AacoLFvitKmMGfsgGYKquSWPKpmbfVOcFhIzXryFgbCUCPdXzkbsNRaKaefkGCo 2023-11-02T09:40:49.514 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.514 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/AacoLFvitKmMGfsgGYKquSWPKpmbfVOcFhIzXryFgbCUCPdXzkbsNRaKaefkGCo 2023-11-02T09:40:49.514 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.514 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'W2LwSsc7jmXTQd+neat92Q==', 'Content-Length': '3008266', 'Expect': '100-Continue'} 2023-11-02T09:40:49.515 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.515 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.515 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.515 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:49.515 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.516 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.516 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.516 INFO:teuthology.orchestra.run.smithi156.stderr:W2LwSsc7jmXTQd+neat92Q== 2023-11-02T09:40:49.516 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.516 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:59 GMT 2023-11-02T09:40:49.517 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/AacoLFvitKmMGfsgGYKquSWPKpmbfVOcFhIzXryFgbCUCPdXzkbsNRaKaefkGCo 2023-11-02T09:40:49.517 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.517 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:h4HZXg8sZ+MbRXsYapzQLFkeIsQ= 2023-11-02T09:40:49.517 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'W2LwSsc7jmXTQd+neat92Q==', 'Content-Length': '3008266', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:32:59 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:h4HZXg8sZ+MbRXsYapzQLFkeIsQ='} 2023-11-02T09:40:49.517 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/TYTxrWwnCOvXhXAkxnJKPISJtFhbZMatvGhgJEXPrBMxPMDvPZwilPwRNUVTfFH 2023-11-02T09:40:49.519 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/TYTxrWwnCOvXhXAkxnJKPISJtFhbZMatvGhgJEXPrBMxPMDvPZwilPwRNUVTfFH 2023-11-02T09:40:49.521 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.521 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/TYTxrWwnCOvXhXAkxnJKPISJtFhbZMatvGhgJEXPrBMxPMDvPZwilPwRNUVTfFH 2023-11-02T09:40:49.522 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.522 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '9wjn4Ybem+aSvj1V6/PHWA==', 'Content-Length': '3013432', 'Expect': '100-Continue'} 2023-11-02T09:40:49.522 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.522 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.523 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.523 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:49.523 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.523 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.523 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.523 INFO:teuthology.orchestra.run.smithi156.stderr:9wjn4Ybem+aSvj1V6/PHWA== 2023-11-02T09:40:49.524 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.524 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:59 GMT 2023-11-02T09:40:49.524 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/TYTxrWwnCOvXhXAkxnJKPISJtFhbZMatvGhgJEXPrBMxPMDvPZwilPwRNUVTfFH 2023-11-02T09:40:49.524 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.524 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:Xb5YCmXFrGuQD0WhRmAlOnRZhAg= 2023-11-02T09:40:49.525 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '9wjn4Ybem+aSvj1V6/PHWA==', 'Content-Length': '3013432', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:32:59 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:Xb5YCmXFrGuQD0WhRmAlOnRZhAg='} 2023-11-02T09:40:49.525 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"4290085e8318861a0e09c9b406b5db69"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000006083d3b15b706f67-0065436ccb-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:59 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:49.525 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/jTAdINOpEwhOSOammtPiFonHihZtYNDeTlkVhEtlNgbjgwxtLqVoXJqMLtTEwGA 2023-11-02T09:40:49.526 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/jTAdINOpEwhOSOammtPiFonHihZtYNDeTlkVhEtlNgbjgwxtLqVoXJqMLtTEwGA 2023-11-02T09:40:49.526 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.526 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/jTAdINOpEwhOSOammtPiFonHihZtYNDeTlkVhEtlNgbjgwxtLqVoXJqMLtTEwGA 2023-11-02T09:40:49.526 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.526 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'IyRzTXXDfQTNRWBfju/XBQ==', 'Content-Length': '3009513', 'Expect': '100-Continue'} 2023-11-02T09:40:49.528 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.528 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.528 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.528 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.529 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.529 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.529 INFO:teuthology.orchestra.run.smithi156.stderr:IyRzTXXDfQTNRWBfju/XBQ== 2023-11-02T09:40:49.530 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.530 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:59 GMT 2023-11-02T09:40:49.530 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/jTAdINOpEwhOSOammtPiFonHihZtYNDeTlkVhEtlNgbjgwxtLqVoXJqMLtTEwGA 2023-11-02T09:40:49.530 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.530 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:gL+tl95ByjBRp+pXIYU1xDLNq/Y= 2023-11-02T09:40:49.531 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'IyRzTXXDfQTNRWBfju/XBQ==', 'Content-Length': '3009513', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:32:59 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:gL+tl95ByjBRp+pXIYU1xDLNq/Y='} 2023-11-02T09:40:49.531 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/fDCgaYXslDAryRpjARPLBqUkHoTMTTDzldUhqlQmcZyyrliWRMpNJJoIeJqKLgU 2023-11-02T09:40:49.531 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/fDCgaYXslDAryRpjARPLBqUkHoTMTTDzldUhqlQmcZyyrliWRMpNJJoIeJqKLgU 2023-11-02T09:40:49.531 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.532 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/fDCgaYXslDAryRpjARPLBqUkHoTMTTDzldUhqlQmcZyyrliWRMpNJJoIeJqKLgU 2023-11-02T09:40:49.532 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.532 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'WFhwzkvxnWXxJtMfvzHh7Q==', 'Content-Length': '3010284', 'Expect': '100-Continue'} 2023-11-02T09:40:49.532 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.532 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.533 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.533 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:49.533 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.533 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.534 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.534 INFO:teuthology.orchestra.run.smithi156.stderr:WFhwzkvxnWXxJtMfvzHh7Q== 2023-11-02T09:40:49.534 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.534 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:59 GMT 2023-11-02T09:40:49.534 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/fDCgaYXslDAryRpjARPLBqUkHoTMTTDzldUhqlQmcZyyrliWRMpNJJoIeJqKLgU 2023-11-02T09:40:49.535 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.535 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:VPNYBnGn8O5lqpiBsghaF06YsLM= 2023-11-02T09:40:49.535 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'WFhwzkvxnWXxJtMfvzHh7Q==', 'Content-Length': '3010284', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:32:59 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:VPNYBnGn8O5lqpiBsghaF06YsLM='} 2023-11-02T09:40:49.535 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/NKsUqidvimJobVuytsMjepVBigXaceLdyZCKHaYthPdrmXBuYzGsGKWpAOCTgbK 2023-11-02T09:40:49.535 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/NKsUqidvimJobVuytsMjepVBigXaceLdyZCKHaYthPdrmXBuYzGsGKWpAOCTgbK 2023-11-02T09:40:49.536 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.536 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/NKsUqidvimJobVuytsMjepVBigXaceLdyZCKHaYthPdrmXBuYzGsGKWpAOCTgbK 2023-11-02T09:40:49.536 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.536 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'YdKwOfWAh9FHT08HfHVGVg==', 'Content-Length': '3013032', 'Expect': '100-Continue'} 2023-11-02T09:40:49.536 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.537 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.537 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.537 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:49.537 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.537 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.538 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.538 INFO:teuthology.orchestra.run.smithi156.stderr:YdKwOfWAh9FHT08HfHVGVg== 2023-11-02T09:40:49.538 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.539 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:59 GMT 2023-11-02T09:40:49.539 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/NKsUqidvimJobVuytsMjepVBigXaceLdyZCKHaYthPdrmXBuYzGsGKWpAOCTgbK 2023-11-02T09:40:49.539 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.540 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:w1TWFX3DeHU0wsvVfZmvRLu5I40= 2023-11-02T09:40:49.540 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'YdKwOfWAh9FHT08HfHVGVg==', 'Content-Length': '3013032', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:32:59 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:w1TWFX3DeHU0wsvVfZmvRLu5I40='} 2023-11-02T09:40:49.540 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"c02d7a6f1d61c2cb74baec2bb0d843e2"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000008e79d25985de81f-0065436ccb-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:59 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:49.540 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/DgIIdIoJSubgufOmfmtzVjMBAwfEiJVMVMXXSmqbAHbKYCqiAcmvEcfKMrziTNI 2023-11-02T09:40:49.541 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/DgIIdIoJSubgufOmfmtzVjMBAwfEiJVMVMXXSmqbAHbKYCqiAcmvEcfKMrziTNI 2023-11-02T09:40:49.541 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.541 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/DgIIdIoJSubgufOmfmtzVjMBAwfEiJVMVMXXSmqbAHbKYCqiAcmvEcfKMrziTNI 2023-11-02T09:40:49.541 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.541 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'te2PZd/64nffxERdIGe/4A==', 'Content-Length': '3013027', 'Expect': '100-Continue'} 2023-11-02T09:40:49.542 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.542 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.542 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.542 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.543 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.543 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.543 INFO:teuthology.orchestra.run.smithi156.stderr:te2PZd/64nffxERdIGe/4A== 2023-11-02T09:40:49.543 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.543 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:59 GMT 2023-11-02T09:40:49.544 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/DgIIdIoJSubgufOmfmtzVjMBAwfEiJVMVMXXSmqbAHbKYCqiAcmvEcfKMrziTNI 2023-11-02T09:40:49.544 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.544 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:NmDPaA+zgSIoS0rH0/k1oY8yFD8= 2023-11-02T09:40:49.544 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'te2PZd/64nffxERdIGe/4A==', 'Content-Length': '3013027', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:32:59 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:NmDPaA+zgSIoS0rH0/k1oY8yFD8='} 2023-11-02T09:40:49.545 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/ZgmYycbKaNoYVrKOYzeXBkxKTZlsVREroGwgwHUYERpSdBiXcELuvdvfLbHjnbA 2023-11-02T09:40:49.545 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/ZgmYycbKaNoYVrKOYzeXBkxKTZlsVREroGwgwHUYERpSdBiXcELuvdvfLbHjnbA 2023-11-02T09:40:49.545 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.545 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/ZgmYycbKaNoYVrKOYzeXBkxKTZlsVREroGwgwHUYERpSdBiXcELuvdvfLbHjnbA 2023-11-02T09:40:49.547 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.547 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '7fRA0Uv4Gfb/JQk9OhZ2sA==', 'Content-Length': '3010611', 'Expect': '100-Continue'} 2023-11-02T09:40:49.547 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.547 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.548 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.548 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:49.549 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.549 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.549 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.549 INFO:teuthology.orchestra.run.smithi156.stderr:7fRA0Uv4Gfb/JQk9OhZ2sA== 2023-11-02T09:40:49.549 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.550 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:59 GMT 2023-11-02T09:40:49.550 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/ZgmYycbKaNoYVrKOYzeXBkxKTZlsVREroGwgwHUYERpSdBiXcELuvdvfLbHjnbA 2023-11-02T09:40:49.550 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.550 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:OgN8fKMjno3PZMJOUO6uvxVOSjA= 2023-11-02T09:40:49.551 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '7fRA0Uv4Gfb/JQk9OhZ2sA==', 'Content-Length': '3010611', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:32:59 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:OgN8fKMjno3PZMJOUO6uvxVOSjA='} 2023-11-02T09:40:49.551 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/TXmkCXUgSdWYwaTEPgwpvjSsAkaAEyyRBHPJrhoApGsjOrxJdxwtyfZExcCkFgh 2023-11-02T09:40:49.551 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/TXmkCXUgSdWYwaTEPgwpvjSsAkaAEyyRBHPJrhoApGsjOrxJdxwtyfZExcCkFgh 2023-11-02T09:40:49.551 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.551 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/TXmkCXUgSdWYwaTEPgwpvjSsAkaAEyyRBHPJrhoApGsjOrxJdxwtyfZExcCkFgh 2023-11-02T09:40:49.552 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.552 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '5vF2JzWf6EtNVKMHokNGuQ==', 'Content-Length': '3010256', 'Expect': '100-Continue'} 2023-11-02T09:40:49.552 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.552 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.552 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.553 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:49.553 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.553 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.553 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.553 INFO:teuthology.orchestra.run.smithi156.stderr:5vF2JzWf6EtNVKMHokNGuQ== 2023-11-02T09:40:49.554 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.554 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:59 GMT 2023-11-02T09:40:49.554 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/TXmkCXUgSdWYwaTEPgwpvjSsAkaAEyyRBHPJrhoApGsjOrxJdxwtyfZExcCkFgh 2023-11-02T09:40:49.554 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.554 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:3n3zEwhntsfWjjW4zXQOY3pZXLY= 2023-11-02T09:40:49.554 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '5vF2JzWf6EtNVKMHokNGuQ==', 'Content-Length': '3010256', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:32:59 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:3n3zEwhntsfWjjW4zXQOY3pZXLY='} 2023-11-02T09:40:49.555 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"2f2dc8e37b668be82cfe670428b261cb"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000003eece0bd677b781-0065436ccb-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:59 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:49.555 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/rgaBOyLbdjZeciKVDkOMjQhMBWOoWyutSTNOnwcMrXQkmLUBOdbmsDYWmzFBOgV 2023-11-02T09:40:49.556 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/rgaBOyLbdjZeciKVDkOMjQhMBWOoWyutSTNOnwcMrXQkmLUBOdbmsDYWmzFBOgV 2023-11-02T09:40:49.556 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.556 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/rgaBOyLbdjZeciKVDkOMjQhMBWOoWyutSTNOnwcMrXQkmLUBOdbmsDYWmzFBOgV 2023-11-02T09:40:49.556 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.556 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'RMk4YzYBQu7boYI3E+xtNA==', 'Content-Length': '3010468', 'Expect': '100-Continue'} 2023-11-02T09:40:49.557 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.557 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.557 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.557 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.557 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.558 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.558 INFO:teuthology.orchestra.run.smithi156.stderr:RMk4YzYBQu7boYI3E+xtNA== 2023-11-02T09:40:49.558 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.558 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:59 GMT 2023-11-02T09:40:49.559 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/rgaBOyLbdjZeciKVDkOMjQhMBWOoWyutSTNOnwcMrXQkmLUBOdbmsDYWmzFBOgV 2023-11-02T09:40:49.559 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.559 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:sw490MKdIPLxltoDCrnZsrwDHPk= 2023-11-02T09:40:49.560 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'RMk4YzYBQu7boYI3E+xtNA==', 'Content-Length': '3010468', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:32:59 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:sw490MKdIPLxltoDCrnZsrwDHPk='} 2023-11-02T09:40:49.560 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"9e5d380ea9d78e5a32e483597e5f2c76"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005042bccf59ea1b67-0065436ccb-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:59 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:49.560 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/xzgHRdcaqAKzpIHwSPYYHxoIGhRCcbWaXzCftJFVAMRXMycOnrRRtNjMnwpFEiF 2023-11-02T09:40:49.560 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/xzgHRdcaqAKzpIHwSPYYHxoIGhRCcbWaXzCftJFVAMRXMycOnrRRtNjMnwpFEiF 2023-11-02T09:40:49.560 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.561 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/xzgHRdcaqAKzpIHwSPYYHxoIGhRCcbWaXzCftJFVAMRXMycOnrRRtNjMnwpFEiF 2023-11-02T09:40:49.561 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.561 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rfsivMjTpLH282WYeNzqPw==', 'Content-Length': '3010364', 'Expect': '100-Continue'} 2023-11-02T09:40:49.561 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.561 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.562 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.562 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.562 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.562 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.562 INFO:teuthology.orchestra.run.smithi156.stderr:rfsivMjTpLH282WYeNzqPw== 2023-11-02T09:40:49.563 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.563 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:59 GMT 2023-11-02T09:40:49.563 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/xzgHRdcaqAKzpIHwSPYYHxoIGhRCcbWaXzCftJFVAMRXMycOnrRRtNjMnwpFEiF 2023-11-02T09:40:49.563 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.563 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:NMHl7FAUL+QxdDBeDPSShPanRMo= 2023-11-02T09:40:49.564 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rfsivMjTpLH282WYeNzqPw==', 'Content-Length': '3010364', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:32:59 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:NMHl7FAUL+QxdDBeDPSShPanRMo='} 2023-11-02T09:40:49.564 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/pWYIqhklDbdKDyygDcbvOoLXBBRWAONkLWsxOrjrWsaMSXOUXhTdZJmLAGuXsHi 2023-11-02T09:40:49.564 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/pWYIqhklDbdKDyygDcbvOoLXBBRWAONkLWsxOrjrWsaMSXOUXhTdZJmLAGuXsHi 2023-11-02T09:40:49.564 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.564 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/pWYIqhklDbdKDyygDcbvOoLXBBRWAONkLWsxOrjrWsaMSXOUXhTdZJmLAGuXsHi 2023-11-02T09:40:49.565 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.565 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 't/sWTu+0SdK4Ps1mRBi7pQ==', 'Content-Length': '3013135', 'Expect': '100-Continue'} 2023-11-02T09:40:49.566 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.566 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.566 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.566 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:49.567 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.567 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.567 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.567 INFO:teuthology.orchestra.run.smithi156.stderr:t/sWTu+0SdK4Ps1mRBi7pQ== 2023-11-02T09:40:49.574 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.574 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:59 GMT 2023-11-02T09:40:49.575 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/pWYIqhklDbdKDyygDcbvOoLXBBRWAONkLWsxOrjrWsaMSXOUXhTdZJmLAGuXsHi 2023-11-02T09:40:49.575 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.575 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:WE4e5ktMu8EftSGyg4Ud50upFBs= 2023-11-02T09:40:49.575 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 't/sWTu+0SdK4Ps1mRBi7pQ==', 'Content-Length': '3013135', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:32:59 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:WE4e5ktMu8EftSGyg4Ud50upFBs='} 2023-11-02T09:40:49.576 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/DbQeQmPyjwZFrxTeGCMLYfPxsmkYNzqYRGljKEGfoAdOtLOkigJhbMwecCgEVab 2023-11-02T09:40:49.576 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/DbQeQmPyjwZFrxTeGCMLYfPxsmkYNzqYRGljKEGfoAdOtLOkigJhbMwecCgEVab 2023-11-02T09:40:49.576 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.577 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/DbQeQmPyjwZFrxTeGCMLYfPxsmkYNzqYRGljKEGfoAdOtLOkigJhbMwecCgEVab 2023-11-02T09:40:49.577 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.577 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'ezihjQ4zeRVNhMG0O9E1SA==', 'Content-Length': '3015879', 'Expect': '100-Continue'} 2023-11-02T09:40:49.577 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.577 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.578 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.578 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:49.578 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.578 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.578 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.579 INFO:teuthology.orchestra.run.smithi156.stderr:ezihjQ4zeRVNhMG0O9E1SA== 2023-11-02T09:40:49.579 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.579 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:59 GMT 2023-11-02T09:40:49.579 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/DbQeQmPyjwZFrxTeGCMLYfPxsmkYNzqYRGljKEGfoAdOtLOkigJhbMwecCgEVab 2023-11-02T09:40:49.579 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.580 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:8nczP8TGpg+OJ2g7u1Njxp0inII= 2023-11-02T09:40:49.580 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'ezihjQ4zeRVNhMG0O9E1SA==', 'Content-Length': '3015879', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:32:59 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:8nczP8TGpg+OJ2g7u1Njxp0inII='} 2023-11-02T09:40:49.580 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/VgEjcHmbdPNJkeIvkkGZjpPPDHsUNXLXVYwOXsrwLsCGXkgSaiCKdlqPenVFJzQ 2023-11-02T09:40:49.580 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/VgEjcHmbdPNJkeIvkkGZjpPPDHsUNXLXVYwOXsrwLsCGXkgSaiCKdlqPenVFJzQ 2023-11-02T09:40:49.580 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.581 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/VgEjcHmbdPNJkeIvkkGZjpPPDHsUNXLXVYwOXsrwLsCGXkgSaiCKdlqPenVFJzQ 2023-11-02T09:40:49.581 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.581 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'KdiUAHghPQfUgOZueUPX6A==', 'Content-Length': '3010365', 'Expect': '100-Continue'} 2023-11-02T09:40:49.582 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.582 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.582 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.582 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:49.582 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.583 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.583 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.583 INFO:teuthology.orchestra.run.smithi156.stderr:KdiUAHghPQfUgOZueUPX6A== 2023-11-02T09:40:49.583 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.583 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:59 GMT 2023-11-02T09:40:49.584 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/VgEjcHmbdPNJkeIvkkGZjpPPDHsUNXLXVYwOXsrwLsCGXkgSaiCKdlqPenVFJzQ 2023-11-02T09:40:49.584 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.584 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:t3DjXtVlKI127/wlQNdzE9bj00M= 2023-11-02T09:40:49.584 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'KdiUAHghPQfUgOZueUPX6A==', 'Content-Length': '3010365', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:32:59 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:t3DjXtVlKI127/wlQNdzE9bj00M='} 2023-11-02T09:40:49.584 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/rRuTRePERZZOhnCEPJuWTMkfNXkBETBBObokoeqHyMxXgniwXzwJSXPZfQnWKvJ 2023-11-02T09:40:49.585 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/rRuTRePERZZOhnCEPJuWTMkfNXkBETBBObokoeqHyMxXgniwXzwJSXPZfQnWKvJ 2023-11-02T09:40:49.585 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.585 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/rRuTRePERZZOhnCEPJuWTMkfNXkBETBBObokoeqHyMxXgniwXzwJSXPZfQnWKvJ 2023-11-02T09:40:49.585 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.585 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'A/2bWHK004l6ljHSnY/FNA==', 'Content-Length': '3011965', 'Expect': '100-Continue'} 2023-11-02T09:40:49.586 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.586 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.586 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.587 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:49.587 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.587 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.587 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.588 INFO:teuthology.orchestra.run.smithi156.stderr:A/2bWHK004l6ljHSnY/FNA== 2023-11-02T09:40:49.588 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.588 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:59 GMT 2023-11-02T09:40:49.588 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/rRuTRePERZZOhnCEPJuWTMkfNXkBETBBObokoeqHyMxXgniwXzwJSXPZfQnWKvJ 2023-11-02T09:40:49.588 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.589 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:qsYbExisFRGipHh0KJE71E6QBdk= 2023-11-02T09:40:49.589 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'A/2bWHK004l6ljHSnY/FNA==', 'Content-Length': '3011965', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:32:59 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:qsYbExisFRGipHh0KJE71E6QBdk='} 2023-11-02T09:40:49.589 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"5b62f04ac73b8e65d341dfa779ab7dd9"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000332302b83283a8ef-0065436ccb-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:59 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:49.589 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/ZZXNhRuOXLDpVxQMUrpVicAjPpvGwoDTUoQaDnRMiRmaexYyGwQcHkqiUaxzzgX 2023-11-02T09:40:49.590 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/ZZXNhRuOXLDpVxQMUrpVicAjPpvGwoDTUoQaDnRMiRmaexYyGwQcHkqiUaxzzgX 2023-11-02T09:40:49.590 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.590 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/ZZXNhRuOXLDpVxQMUrpVicAjPpvGwoDTUoQaDnRMiRmaexYyGwQcHkqiUaxzzgX 2023-11-02T09:40:49.590 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.590 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'i7cIKFfPEUNwZYjc0M+kFg==', 'Content-Length': '3009485', 'Expect': '100-Continue'} 2023-11-02T09:40:49.591 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.591 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.592 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.592 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.592 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.592 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.592 INFO:teuthology.orchestra.run.smithi156.stderr:i7cIKFfPEUNwZYjc0M+kFg== 2023-11-02T09:40:49.593 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.593 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:59 GMT 2023-11-02T09:40:49.593 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/ZZXNhRuOXLDpVxQMUrpVicAjPpvGwoDTUoQaDnRMiRmaexYyGwQcHkqiUaxzzgX 2023-11-02T09:40:49.593 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.593 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:wsbvaQSu4tcUlqW6ZSAShlvTvZA= 2023-11-02T09:40:49.594 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'i7cIKFfPEUNwZYjc0M+kFg==', 'Content-Length': '3009485', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:32:59 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:wsbvaQSu4tcUlqW6ZSAShlvTvZA='} 2023-11-02T09:40:49.594 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"f708e7e186de9be692be3d55ebf3c758"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000376b08664a3d9d45-0065436ccb-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:59 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:49.594 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/yPRZwWwYgmHJCyTKaiWIVCWTgRznnuNrQKmRxgLuqOIghEDHKObgRlgdptkYQCt 2023-11-02T09:40:49.594 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/yPRZwWwYgmHJCyTKaiWIVCWTgRznnuNrQKmRxgLuqOIghEDHKObgRlgdptkYQCt 2023-11-02T09:40:49.594 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.595 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/yPRZwWwYgmHJCyTKaiWIVCWTgRznnuNrQKmRxgLuqOIghEDHKObgRlgdptkYQCt 2023-11-02T09:40:49.595 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.595 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'PaYnDzESBi+HJx0Hol9DqA==', 'Content-Length': '3008628', 'Expect': '100-Continue'} 2023-11-02T09:40:49.595 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.595 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.596 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.596 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.596 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.596 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.597 INFO:teuthology.orchestra.run.smithi156.stderr:PaYnDzESBi+HJx0Hol9DqA== 2023-11-02T09:40:49.597 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.597 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:59 GMT 2023-11-02T09:40:49.597 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/yPRZwWwYgmHJCyTKaiWIVCWTgRznnuNrQKmRxgLuqOIghEDHKObgRlgdptkYQCt 2023-11-02T09:40:49.598 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.598 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:i5g2zy7TcMOI0apC67d6SHVyUjI= 2023-11-02T09:40:49.598 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'PaYnDzESBi+HJx0Hol9DqA==', 'Content-Length': '3008628', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:32:59 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:i5g2zy7TcMOI0apC67d6SHVyUjI='} 2023-11-02T09:40:49.598 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/QkZZgdznHGqPPyZUjtNDtweSStZaoDZWIyuRduhqQhvuFnZCMhysRDkzxOpVsqj 2023-11-02T09:40:49.598 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/QkZZgdznHGqPPyZUjtNDtweSStZaoDZWIyuRduhqQhvuFnZCMhysRDkzxOpVsqj 2023-11-02T09:40:49.599 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.599 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/QkZZgdznHGqPPyZUjtNDtweSStZaoDZWIyuRduhqQhvuFnZCMhysRDkzxOpVsqj 2023-11-02T09:40:49.599 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.599 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'DZepGz4yZ17rNHpSjCy9Lg==', 'Content-Length': '3009027', 'Expect': '100-Continue'} 2023-11-02T09:40:49.599 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.600 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.600 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.600 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:49.600 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.600 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.601 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.601 INFO:teuthology.orchestra.run.smithi156.stderr:DZepGz4yZ17rNHpSjCy9Lg== 2023-11-02T09:40:49.601 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.601 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:59 GMT 2023-11-02T09:40:49.601 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/QkZZgdznHGqPPyZUjtNDtweSStZaoDZWIyuRduhqQhvuFnZCMhysRDkzxOpVsqj 2023-11-02T09:40:49.602 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.602 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:a6GvpcXn6fXl3hZ9hSUmKUEasn0= 2023-11-02T09:40:49.602 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'DZepGz4yZ17rNHpSjCy9Lg==', 'Content-Length': '3009027', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:32:59 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:a6GvpcXn6fXl3hZ9hSUmKUEasn0='} 2023-11-02T09:40:49.603 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"2324734d75c37d04cd45605f8eefd705"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ec18352a2237a072-0065436ccb-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:59 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:49.603 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/ZLbFLMxnpExscbVFrxpYsrkSeOvbDVpqTJfvHQKxQRxVctBlwZOIpLNKDpNPonW 2023-11-02T09:40:49.603 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/ZLbFLMxnpExscbVFrxpYsrkSeOvbDVpqTJfvHQKxQRxVctBlwZOIpLNKDpNPonW 2023-11-02T09:40:49.603 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.604 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/ZLbFLMxnpExscbVFrxpYsrkSeOvbDVpqTJfvHQKxQRxVctBlwZOIpLNKDpNPonW 2023-11-02T09:40:49.604 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.604 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'JWwdRdL7v0tXb/UJDjCaVQ==', 'Content-Length': '3010573', 'Expect': '100-Continue'} 2023-11-02T09:40:49.604 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.604 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.604 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.605 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.605 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.605 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.605 INFO:teuthology.orchestra.run.smithi156.stderr:JWwdRdL7v0tXb/UJDjCaVQ== 2023-11-02T09:40:49.605 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.606 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:59 GMT 2023-11-02T09:40:49.606 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/ZLbFLMxnpExscbVFrxpYsrkSeOvbDVpqTJfvHQKxQRxVctBlwZOIpLNKDpNPonW 2023-11-02T09:40:49.606 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.606 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:U82hQtSUpKOuSI28yKb6Z4PejWU= 2023-11-02T09:40:49.606 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'JWwdRdL7v0tXb/UJDjCaVQ==', 'Content-Length': '3010573', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:32:59 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:U82hQtSUpKOuSI28yKb6Z4PejWU='} 2023-11-02T09:40:49.607 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/LiBIiejpMSLONHOvbytcURidcSWuoEvKXxQfgbaHjjVdlzvMNmcURJyJpbLgIyr 2023-11-02T09:40:49.607 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/LiBIiejpMSLONHOvbytcURidcSWuoEvKXxQfgbaHjjVdlzvMNmcURJyJpbLgIyr 2023-11-02T09:40:49.607 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.608 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/LiBIiejpMSLONHOvbytcURidcSWuoEvKXxQfgbaHjjVdlzvMNmcURJyJpbLgIyr 2023-11-02T09:40:49.608 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.608 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'j37NMimIfkaevSb8cp6jXg==', 'Content-Length': '3009378', 'Expect': '100-Continue'} 2023-11-02T09:40:49.608 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.608 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.609 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.609 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:49.609 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.609 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.609 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.610 INFO:teuthology.orchestra.run.smithi156.stderr:j37NMimIfkaevSb8cp6jXg== 2023-11-02T09:40:49.610 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.610 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:59 GMT 2023-11-02T09:40:49.610 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/LiBIiejpMSLONHOvbytcURidcSWuoEvKXxQfgbaHjjVdlzvMNmcURJyJpbLgIyr 2023-11-02T09:40:49.610 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.611 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:76AnRNMCCdJY3C5/0MzfD3j6JHo= 2023-11-02T09:40:49.611 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'j37NMimIfkaevSb8cp6jXg==', 'Content-Length': '3009378', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:32:59 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:76AnRNMCCdJY3C5/0MzfD3j6JHo='} 2023-11-02T09:40:49.611 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/jpLTGzDLlsNcjBCJNAJEgzGqOvjQATgBzOOpgqyVzOjGNiouMZBKeBfYUWLfYuE 2023-11-02T09:40:49.611 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/jpLTGzDLlsNcjBCJNAJEgzGqOvjQATgBzOOpgqyVzOjGNiouMZBKeBfYUWLfYuE 2023-11-02T09:40:49.611 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.612 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/jpLTGzDLlsNcjBCJNAJEgzGqOvjQATgBzOOpgqyVzOjGNiouMZBKeBfYUWLfYuE 2023-11-02T09:40:49.612 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.613 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rRT6ZaBWZ3Sbm9+ofd6zKw==', 'Content-Length': '3009667', 'Expect': '100-Continue'} 2023-11-02T09:40:49.613 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.613 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.613 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.613 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:49.614 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.614 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.614 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.614 INFO:teuthology.orchestra.run.smithi156.stderr:rRT6ZaBWZ3Sbm9+ofd6zKw== 2023-11-02T09:40:49.614 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.615 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:59 GMT 2023-11-02T09:40:49.615 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/jpLTGzDLlsNcjBCJNAJEgzGqOvjQATgBzOOpgqyVzOjGNiouMZBKeBfYUWLfYuE 2023-11-02T09:40:49.615 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.615 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:0am75cug2NXltBSfd7K2wHkc7OI= 2023-11-02T09:40:49.615 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rRT6ZaBWZ3Sbm9+ofd6zKw==', 'Content-Length': '3009667', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:32:59 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:0am75cug2NXltBSfd7K2wHkc7OI='} 2023-11-02T09:40:49.616 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/igoRJCbaspLHqMTsEvyOpUwcmqHeilRymuIdSzfelOsZdNHHIoDiXjMHxSjVjMR 2023-11-02T09:40:49.616 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/igoRJCbaspLHqMTsEvyOpUwcmqHeilRymuIdSzfelOsZdNHHIoDiXjMHxSjVjMR 2023-11-02T09:40:49.616 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.616 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/igoRJCbaspLHqMTsEvyOpUwcmqHeilRymuIdSzfelOsZdNHHIoDiXjMHxSjVjMR 2023-11-02T09:40:49.616 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.617 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'Fm/qqXvvJ7QLisFOriDg0Q==', 'Content-Length': '3010190', 'Expect': '100-Continue'} 2023-11-02T09:40:49.617 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.617 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.618 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.618 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:49.618 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.618 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.618 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.619 INFO:teuthology.orchestra.run.smithi156.stderr:Fm/qqXvvJ7QLisFOriDg0Q== 2023-11-02T09:40:49.619 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.619 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:59 GMT 2023-11-02T09:40:49.619 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/igoRJCbaspLHqMTsEvyOpUwcmqHeilRymuIdSzfelOsZdNHHIoDiXjMHxSjVjMR 2023-11-02T09:40:49.620 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.620 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:ziHaqnTiY3cH2NY59L25do9qOzI= 2023-11-02T09:40:49.620 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'Fm/qqXvvJ7QLisFOriDg0Q==', 'Content-Length': '3010190', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:32:59 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:ziHaqnTiY3cH2NY59L25do9qOzI='} 2023-11-02T09:40:49.620 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/FjOGbRutqdFrVkVGlUzburahoRAOmpbIJIlOOmKRUespbGkKUaSnZYXOsGtptRX 2023-11-02T09:40:49.620 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/FjOGbRutqdFrVkVGlUzburahoRAOmpbIJIlOOmKRUespbGkKUaSnZYXOsGtptRX 2023-11-02T09:40:49.621 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.621 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/FjOGbRutqdFrVkVGlUzburahoRAOmpbIJIlOOmKRUespbGkKUaSnZYXOsGtptRX 2023-11-02T09:40:49.621 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.621 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'v05FAz97G5d+eqDC6ParPA==', 'Content-Length': '3012095', 'Expect': '100-Continue'} 2023-11-02T09:40:49.621 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.622 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.622 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.622 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:49.622 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.623 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.623 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.623 INFO:teuthology.orchestra.run.smithi156.stderr:v05FAz97G5d+eqDC6ParPA== 2023-11-02T09:40:49.624 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.624 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:59 GMT 2023-11-02T09:40:49.624 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/FjOGbRutqdFrVkVGlUzburahoRAOmpbIJIlOOmKRUespbGkKUaSnZYXOsGtptRX 2023-11-02T09:40:49.624 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.624 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:NUnvFbGVcjE+sF/YUwARQFMY+jU= 2023-11-02T09:40:49.625 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'v05FAz97G5d+eqDC6ParPA==', 'Content-Length': '3012095', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:32:59 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:NUnvFbGVcjE+sF/YUwARQFMY+jU='} 2023-11-02T09:40:49.625 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"585870ce4bf19d65f126d31fbf31e1ed"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b29e45609f4333cc-0065436ccb-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:59 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:49.625 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/xrvPUDfkpWpYqdKcZodxGrkaOHfhGhqWdXuLoZIhcmiXEzfGDgrVVOUIhpkEQBX 2023-11-02T09:40:49.625 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/xrvPUDfkpWpYqdKcZodxGrkaOHfhGhqWdXuLoZIhcmiXEzfGDgrVVOUIhpkEQBX 2023-11-02T09:40:49.625 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.625 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/xrvPUDfkpWpYqdKcZodxGrkaOHfhGhqWdXuLoZIhcmiXEzfGDgrVVOUIhpkEQBX 2023-11-02T09:40:49.626 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.626 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'SLSLCGNsVZir4ORSIEtmkw==', 'Content-Length': '3011390', 'Expect': '100-Continue'} 2023-11-02T09:40:49.626 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.626 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.626 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.627 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.627 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.627 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.627 INFO:teuthology.orchestra.run.smithi156.stderr:SLSLCGNsVZir4ORSIEtmkw== 2023-11-02T09:40:49.627 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.628 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:59 GMT 2023-11-02T09:40:49.628 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/xrvPUDfkpWpYqdKcZodxGrkaOHfhGhqWdXuLoZIhcmiXEzfGDgrVVOUIhpkEQBX 2023-11-02T09:40:49.628 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.629 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:kCs8leFqwrXSilOItgKjW2PaPcg= 2023-11-02T09:40:49.629 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'SLSLCGNsVZir4ORSIEtmkw==', 'Content-Length': '3011390', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:32:59 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:kCs8leFqwrXSilOItgKjW2PaPcg='} 2023-11-02T09:40:49.629 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"61d2b039f58087d1474f4f077c754656"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000001a15dea8bb4689b-0065436ccb-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:59 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:49.629 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"b5ed8f65dffae277dfc4445d2067bfe0"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000bec953232bc003a6-0065436ccb-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:59 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:49.629 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/uITHufGJGhJFXcWopfFjEsintdhTdeWlCtTuGyYwOrbRPTNccVHZSIRYYUsBRkG 2023-11-02T09:40:49.630 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/uITHufGJGhJFXcWopfFjEsintdhTdeWlCtTuGyYwOrbRPTNccVHZSIRYYUsBRkG 2023-11-02T09:40:49.630 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.630 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/uITHufGJGhJFXcWopfFjEsintdhTdeWlCtTuGyYwOrbRPTNccVHZSIRYYUsBRkG 2023-11-02T09:40:49.630 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.630 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'QxoEzzXlnwahBPIrFMCjqQ==', 'Content-Length': '3009674', 'Expect': '100-Continue'} 2023-11-02T09:40:49.631 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.631 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.631 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.631 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.631 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.632 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.632 INFO:teuthology.orchestra.run.smithi156.stderr:QxoEzzXlnwahBPIrFMCjqQ== 2023-11-02T09:40:49.632 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.632 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:59 GMT 2023-11-02T09:40:49.632 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/uITHufGJGhJFXcWopfFjEsintdhTdeWlCtTuGyYwOrbRPTNccVHZSIRYYUsBRkG 2023-11-02T09:40:49.633 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.633 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:jIztnGUo20Tc2Nh9VuWmrUC+uFw= 2023-11-02T09:40:49.634 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'QxoEzzXlnwahBPIrFMCjqQ==', 'Content-Length': '3009674', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:32:59 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:jIztnGUo20Tc2Nh9VuWmrUC+uFw='} 2023-11-02T09:40:49.634 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/raONenAHmhPGddjQfLjzphRgdmjRsZJzLLahVjZqvmWKbcbECmMhgielhuWBWWf 2023-11-02T09:40:49.634 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/raONenAHmhPGddjQfLjzphRgdmjRsZJzLLahVjZqvmWKbcbECmMhgielhuWBWWf 2023-11-02T09:40:49.634 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.634 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/raONenAHmhPGddjQfLjzphRgdmjRsZJzLLahVjZqvmWKbcbECmMhgielhuWBWWf 2023-11-02T09:40:49.635 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.635 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'tp3hebdJf+GDd0nKy1H99Q==', 'Content-Length': '3010213', 'Expect': '100-Continue'} 2023-11-02T09:40:49.635 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.635 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.635 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.636 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.636 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.636 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.636 INFO:teuthology.orchestra.run.smithi156.stderr:tp3hebdJf+GDd0nKy1H99Q== 2023-11-02T09:40:49.637 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.637 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:59 GMT 2023-11-02T09:40:49.637 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/raONenAHmhPGddjQfLjzphRgdmjRsZJzLLahVjZqvmWKbcbECmMhgielhuWBWWf 2023-11-02T09:40:49.637 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.637 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:3jw2feav17qDyqbQI2sjwGzqcqk= 2023-11-02T09:40:49.638 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'tp3hebdJf+GDd0nKy1H99Q==', 'Content-Length': '3010213', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:32:59 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:3jw2feav17qDyqbQI2sjwGzqcqk='} 2023-11-02T09:40:49.638 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/JYEGVDyGvGsrCLdiiZpqbegpVeqpqxosZBhislDZJjIjvzNrufYWMVYuOWVEsCW 2023-11-02T09:40:49.638 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/JYEGVDyGvGsrCLdiiZpqbegpVeqpqxosZBhislDZJjIjvzNrufYWMVYuOWVEsCW 2023-11-02T09:40:49.639 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.639 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/JYEGVDyGvGsrCLdiiZpqbegpVeqpqxosZBhislDZJjIjvzNrufYWMVYuOWVEsCW 2023-11-02T09:40:49.639 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.639 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '83n2d9KDaweRgFxIJ5zxyw==', 'Content-Length': '3011459', 'Expect': '100-Continue'} 2023-11-02T09:40:49.639 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.640 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.640 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.640 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:49.640 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.640 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.641 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.641 INFO:teuthology.orchestra.run.smithi156.stderr:83n2d9KDaweRgFxIJ5zxyw== 2023-11-02T09:40:49.641 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.641 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:59 GMT 2023-11-02T09:40:49.641 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/JYEGVDyGvGsrCLdiiZpqbegpVeqpqxosZBhislDZJjIjvzNrufYWMVYuOWVEsCW 2023-11-02T09:40:49.642 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.642 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:SjRGFzK/G0yCfPh2Rg1/PD5sIrI= 2023-11-02T09:40:49.642 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '83n2d9KDaweRgFxIJ5zxyw==', 'Content-Length': '3011459', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:32:59 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:SjRGFzK/G0yCfPh2Rg1/PD5sIrI='} 2023-11-02T09:40:49.642 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/xSoMSXRzoTKobwguYNvcSTHRUYgcHxBttUmkNzMRPHqmicLbMUXEUAYfnCJUeXK 2023-11-02T09:40:49.642 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/xSoMSXRzoTKobwguYNvcSTHRUYgcHxBttUmkNzMRPHqmicLbMUXEUAYfnCJUeXK 2023-11-02T09:40:49.643 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.643 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/xSoMSXRzoTKobwguYNvcSTHRUYgcHxBttUmkNzMRPHqmicLbMUXEUAYfnCJUeXK 2023-11-02T09:40:49.643 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.643 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '9XiONLiAnsPdYPC5GdcNZQ==', 'Content-Length': '3012311', 'Expect': '100-Continue'} 2023-11-02T09:40:49.643 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.644 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.644 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.644 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:49.645 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.645 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.645 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.645 INFO:teuthology.orchestra.run.smithi156.stderr:9XiONLiAnsPdYPC5GdcNZQ== 2023-11-02T09:40:49.645 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.646 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:59 GMT 2023-11-02T09:40:49.646 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/xSoMSXRzoTKobwguYNvcSTHRUYgcHxBttUmkNzMRPHqmicLbMUXEUAYfnCJUeXK 2023-11-02T09:40:49.646 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.646 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:l0SZlfjdvCIa/s9iwJlyxIFtGPM= 2023-11-02T09:40:49.646 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '9XiONLiAnsPdYPC5GdcNZQ==', 'Content-Length': '3012311', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:32:59 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:l0SZlfjdvCIa/s9iwJlyxIFtGPM='} 2023-11-02T09:40:49.647 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/eGUsvoBtYJSqxUeCvhsqBzylTgymgvykZCGhaGcEyDzbdOQEcKXiVLmzXTuNcoF 2023-11-02T09:40:49.647 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/eGUsvoBtYJSqxUeCvhsqBzylTgymgvykZCGhaGcEyDzbdOQEcKXiVLmzXTuNcoF 2023-11-02T09:40:49.647 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.647 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/eGUsvoBtYJSqxUeCvhsqBzylTgymgvykZCGhaGcEyDzbdOQEcKXiVLmzXTuNcoF 2023-11-02T09:40:49.647 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.648 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '16yXh6S4j5/DTrx599LHmw==', 'Content-Length': '3011426', 'Expect': '100-Continue'} 2023-11-02T09:40:49.648 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.648 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.649 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.649 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:49.649 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.649 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.649 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.650 INFO:teuthology.orchestra.run.smithi156.stderr:16yXh6S4j5/DTrx599LHmw== 2023-11-02T09:40:49.650 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.650 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:59 GMT 2023-11-02T09:40:49.650 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/eGUsvoBtYJSqxUeCvhsqBzylTgymgvykZCGhaGcEyDzbdOQEcKXiVLmzXTuNcoF 2023-11-02T09:40:49.650 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.651 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:dHJ8EI4RYw3w5DL37kBD8Cwc5SU= 2023-11-02T09:40:49.651 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '16yXh6S4j5/DTrx599LHmw==', 'Content-Length': '3011426', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:32:59 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:dHJ8EI4RYw3w5DL37kBD8Cwc5SU='} 2023-11-02T09:40:49.651 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/XrzbJzDCtzeeobgzMMdwaQoIhdDYzlWtLyAswGgwxMHBELYXUtEqRtqQJAXCmxs 2023-11-02T09:40:49.651 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/XrzbJzDCtzeeobgzMMdwaQoIhdDYzlWtLyAswGgwxMHBELYXUtEqRtqQJAXCmxs 2023-11-02T09:40:49.651 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.652 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/XrzbJzDCtzeeobgzMMdwaQoIhdDYzlWtLyAswGgwxMHBELYXUtEqRtqQJAXCmxs 2023-11-02T09:40:49.652 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.652 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'pK1Ph6HJYH+HHTel0FXKuQ==', 'Content-Length': '3009900', 'Expect': '100-Continue'} 2023-11-02T09:40:49.652 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.652 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.653 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.653 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:49.653 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.653 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.653 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.654 INFO:teuthology.orchestra.run.smithi156.stderr:pK1Ph6HJYH+HHTel0FXKuQ== 2023-11-02T09:40:49.654 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.654 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:59 GMT 2023-11-02T09:40:49.655 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/XrzbJzDCtzeeobgzMMdwaQoIhdDYzlWtLyAswGgwxMHBELYXUtEqRtqQJAXCmxs 2023-11-02T09:40:49.655 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.655 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:2eQeDvYZJPc7H2t83moqD47aga4= 2023-11-02T09:40:49.655 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'pK1Ph6HJYH+HHTel0FXKuQ==', 'Content-Length': '3009900', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:32:59 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:2eQeDvYZJPc7H2t83moqD47aga4='} 2023-11-02T09:40:49.655 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/FxNtqhYqTbYIzcDlgvYoBxKstVpiPdwYaAZOAmsQrcFvIYuniwHLDevdWiWrdRt 2023-11-02T09:40:49.656 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/FxNtqhYqTbYIzcDlgvYoBxKstVpiPdwYaAZOAmsQrcFvIYuniwHLDevdWiWrdRt 2023-11-02T09:40:49.656 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.656 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/FxNtqhYqTbYIzcDlgvYoBxKstVpiPdwYaAZOAmsQrcFvIYuniwHLDevdWiWrdRt 2023-11-02T09:40:49.656 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.657 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'i3bQ9eb/UkC0iV2mholdXA==', 'Content-Length': '3009088', 'Expect': '100-Continue'} 2023-11-02T09:40:49.657 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.657 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.657 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.657 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:49.657 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.658 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.658 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.658 INFO:teuthology.orchestra.run.smithi156.stderr:i3bQ9eb/UkC0iV2mholdXA== 2023-11-02T09:40:49.658 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.658 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:59 GMT 2023-11-02T09:40:49.659 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/FxNtqhYqTbYIzcDlgvYoBxKstVpiPdwYaAZOAmsQrcFvIYuniwHLDevdWiWrdRt 2023-11-02T09:40:49.659 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.659 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:JeINcLLon4J/Eco+SWynwxqRvHo= 2023-11-02T09:40:49.660 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'i3bQ9eb/UkC0iV2mholdXA==', 'Content-Length': '3009088', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:32:59 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:JeINcLLon4J/Eco+SWynwxqRvHo='} 2023-11-02T09:40:49.660 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"e6f17627359fe84b4d54a307a24346b9"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000c21fee5bf437108e-0065436ccb-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:59 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:49.660 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/gfYlBLfeNFEHDHNaWuIdGvcARYfXYYNyijhjcmKdpiRLYzpNhTAHGTeowrFOBjX 2023-11-02T09:40:49.660 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/gfYlBLfeNFEHDHNaWuIdGvcARYfXYYNyijhjcmKdpiRLYzpNhTAHGTeowrFOBjX 2023-11-02T09:40:49.660 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.661 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/gfYlBLfeNFEHDHNaWuIdGvcARYfXYYNyijhjcmKdpiRLYzpNhTAHGTeowrFOBjX 2023-11-02T09:40:49.661 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.661 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '2O5QtVp1UiV0iSHkpAxqXQ==', 'Content-Length': '3009576', 'Expect': '100-Continue'} 2023-11-02T09:40:49.661 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.662 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.662 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.662 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.662 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.662 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.663 INFO:teuthology.orchestra.run.smithi156.stderr:2O5QtVp1UiV0iSHkpAxqXQ== 2023-11-02T09:40:49.663 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.663 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:59 GMT 2023-11-02T09:40:49.663 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/gfYlBLfeNFEHDHNaWuIdGvcARYfXYYNyijhjcmKdpiRLYzpNhTAHGTeowrFOBjX 2023-11-02T09:40:49.663 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.664 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:yn3K0AMWoobUpw3n1GD+vxH2MMI= 2023-11-02T09:40:49.664 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '2O5QtVp1UiV0iSHkpAxqXQ==', 'Content-Length': '3009576', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:32:59 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:yn3K0AMWoobUpw3n1GD+vxH2MMI='} 2023-11-02T09:40:49.664 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"edf440d14bf819f6ff25093d3a1676b0"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b1d8e186e41c09a3-0065436ccb-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:59 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:49.664 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/sikHwcyiBDccoWVddHbDBONwNSoFpfqRvtqagASKqjbfPXjCKhgopJneFOkXYAT 2023-11-02T09:40:49.665 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/sikHwcyiBDccoWVddHbDBONwNSoFpfqRvtqagASKqjbfPXjCKhgopJneFOkXYAT 2023-11-02T09:40:49.665 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.666 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/sikHwcyiBDccoWVddHbDBONwNSoFpfqRvtqagASKqjbfPXjCKhgopJneFOkXYAT 2023-11-02T09:40:49.666 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.666 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'Iy6LXQBKhlqVyA7/gcXc8Q==', 'Content-Length': '3011248', 'Expect': '100-Continue'} 2023-11-02T09:40:49.666 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.666 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.667 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.667 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.667 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.667 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.667 INFO:teuthology.orchestra.run.smithi156.stderr:Iy6LXQBKhlqVyA7/gcXc8Q== 2023-11-02T09:40:49.668 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.668 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:59 GMT 2023-11-02T09:40:49.668 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/sikHwcyiBDccoWVddHbDBONwNSoFpfqRvtqagASKqjbfPXjCKhgopJneFOkXYAT 2023-11-02T09:40:49.668 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.668 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:g1OfSsKvjL2Nz4hxATYBiC8N3aw= 2023-11-02T09:40:49.668 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'Iy6LXQBKhlqVyA7/gcXc8Q==', 'Content-Length': '3011248', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:32:59 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:g1OfSsKvjL2Nz4hxATYBiC8N3aw='} 2023-11-02T09:40:49.669 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/TASmPpZFXbPDmCKnzHpfdmygUWJVBEFJSJejcgHNegiYaqLdFubQnHUayQfAcrp 2023-11-02T09:40:49.670 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/TASmPpZFXbPDmCKnzHpfdmygUWJVBEFJSJejcgHNegiYaqLdFubQnHUayQfAcrp 2023-11-02T09:40:49.670 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.670 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/TASmPpZFXbPDmCKnzHpfdmygUWJVBEFJSJejcgHNegiYaqLdFubQnHUayQfAcrp 2023-11-02T09:40:49.670 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.670 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'OXoZsAiVF0yW4fk5CeYAFg==', 'Content-Length': '3009993', 'Expect': '100-Continue'} 2023-11-02T09:40:49.671 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.671 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.671 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.671 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:49.672 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.672 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.672 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.672 INFO:teuthology.orchestra.run.smithi156.stderr:OXoZsAiVF0yW4fk5CeYAFg== 2023-11-02T09:40:49.672 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.673 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:33:00 GMT 2023-11-02T09:40:49.673 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/TASmPpZFXbPDmCKnzHpfdmygUWJVBEFJSJejcgHNegiYaqLdFubQnHUayQfAcrp 2023-11-02T09:40:49.673 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.673 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:kjVt2e2KmB9O+NnlDS9BRhVc/F0= 2023-11-02T09:40:49.673 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'OXoZsAiVF0yW4fk5CeYAFg==', 'Content-Length': '3009993', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:33:00 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:kjVt2e2KmB9O+NnlDS9BRhVc/F0='} 2023-11-02T09:40:49.674 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"44c93863360142eedba1823713ec6d34"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000008754c1ecfdbeabdd-0065436ccb-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:00 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:49.674 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"adfb22bcc8d3a4b1f6f3659878dcea3f"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e7422729b32d4dd7-0065436ccb-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:00 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:49.674 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/zbXzdwbupSGawLCQbwIusQLlKNIpjfLmEUDUZJZWPTletUeYUUqXidbgIddlpnY 2023-11-02T09:40:49.674 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/zbXzdwbupSGawLCQbwIusQLlKNIpjfLmEUDUZJZWPTletUeYUUqXidbgIddlpnY 2023-11-02T09:40:49.674 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.675 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/zbXzdwbupSGawLCQbwIusQLlKNIpjfLmEUDUZJZWPTletUeYUUqXidbgIddlpnY 2023-11-02T09:40:49.675 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.676 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '2hcLXq40pkDOOXZHTHLNaQ==', 'Content-Length': '3011194', 'Expect': '100-Continue'} 2023-11-02T09:40:49.676 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.676 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.676 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.676 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.677 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.677 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.677 INFO:teuthology.orchestra.run.smithi156.stderr:2hcLXq40pkDOOXZHTHLNaQ== 2023-11-02T09:40:49.677 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.677 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:33:00 GMT 2023-11-02T09:40:49.678 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/zbXzdwbupSGawLCQbwIusQLlKNIpjfLmEUDUZJZWPTletUeYUUqXidbgIddlpnY 2023-11-02T09:40:49.678 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.678 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:6Z2yGdW4ydHiqN4/gEM+FztYdXM= 2023-11-02T09:40:49.678 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '2hcLXq40pkDOOXZHTHLNaQ==', 'Content-Length': '3011194', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:33:00 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:6Z2yGdW4ydHiqN4/gEM+FztYdXM='} 2023-11-02T09:40:49.678 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/yZIXejurGsyfVuMSYvPCMwxYHdLoGCaMmsQlEMHqtiLnkomAKsTUQATZuyExNYl 2023-11-02T09:40:49.679 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/yZIXejurGsyfVuMSYvPCMwxYHdLoGCaMmsQlEMHqtiLnkomAKsTUQATZuyExNYl 2023-11-02T09:40:49.679 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.679 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/yZIXejurGsyfVuMSYvPCMwxYHdLoGCaMmsQlEMHqtiLnkomAKsTUQATZuyExNYl 2023-11-02T09:40:49.679 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.679 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'xSn3Vjw2sPgeYmT2WXPonQ==', 'Content-Length': '3009969', 'Expect': '100-Continue'} 2023-11-02T09:40:49.680 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.680 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.680 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.681 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.681 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.681 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.681 INFO:teuthology.orchestra.run.smithi156.stderr:xSn3Vjw2sPgeYmT2WXPonQ== 2023-11-02T09:40:49.681 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.682 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:33:00 GMT 2023-11-02T09:40:49.682 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/yZIXejurGsyfVuMSYvPCMwxYHdLoGCaMmsQlEMHqtiLnkomAKsTUQATZuyExNYl 2023-11-02T09:40:49.683 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.683 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:keMp4t838iyFaiGf+VieqjEFvl0= 2023-11-02T09:40:49.683 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'xSn3Vjw2sPgeYmT2WXPonQ==', 'Content-Length': '3009969', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:33:00 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:keMp4t838iyFaiGf+VieqjEFvl0='} 2023-11-02T09:40:49.683 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"b7fb164eefb449d2b83ecd664418bba5"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a7fe5456b4af5e02-0065436ccb-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:00 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:49.684 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/GbIAVLMUtwhDbyrratyksNYFMoiCtVmdNLlMFSgZuFCAsUmtfejslvGoDzyLdof 2023-11-02T09:40:49.684 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/GbIAVLMUtwhDbyrratyksNYFMoiCtVmdNLlMFSgZuFCAsUmtfejslvGoDzyLdof 2023-11-02T09:40:49.684 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.684 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/GbIAVLMUtwhDbyrratyksNYFMoiCtVmdNLlMFSgZuFCAsUmtfejslvGoDzyLdof 2023-11-02T09:40:49.684 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.685 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'JRImqWMO6MbWttLvbG2p4w==', 'Content-Length': '3012912', 'Expect': '100-Continue'} 2023-11-02T09:40:49.685 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.685 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.686 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.686 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.686 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.686 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.687 INFO:teuthology.orchestra.run.smithi156.stderr:JRImqWMO6MbWttLvbG2p4w== 2023-11-02T09:40:49.687 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.687 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:33:00 GMT 2023-11-02T09:40:49.688 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/GbIAVLMUtwhDbyrratyksNYFMoiCtVmdNLlMFSgZuFCAsUmtfejslvGoDzyLdof 2023-11-02T09:40:49.688 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.688 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:rVxnqvLPzNJ7EyqTWERxA7GVMmw= 2023-11-02T09:40:49.688 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'JRImqWMO6MbWttLvbG2p4w==', 'Content-Length': '3012912', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:33:00 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:rVxnqvLPzNJ7EyqTWERxA7GVMmw='} 2023-11-02T09:40:49.688 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/ymkZlWlfrYEPQXakwEHofloDaBxeRfMQPkZIsRMGPezHvSZWMcRDjuRGvRNQkus 2023-11-02T09:40:49.689 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/ymkZlWlfrYEPQXakwEHofloDaBxeRfMQPkZIsRMGPezHvSZWMcRDjuRGvRNQkus 2023-11-02T09:40:49.689 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.689 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/ymkZlWlfrYEPQXakwEHofloDaBxeRfMQPkZIsRMGPezHvSZWMcRDjuRGvRNQkus 2023-11-02T09:40:49.689 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.689 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'iTWUxMSx1sf/BjKvXIjIkg==', 'Content-Length': '3013026', 'Expect': '100-Continue'} 2023-11-02T09:40:49.690 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.690 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.690 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.691 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:49.691 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.691 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.691 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.691 INFO:teuthology.orchestra.run.smithi156.stderr:iTWUxMSx1sf/BjKvXIjIkg== 2023-11-02T09:40:49.692 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.692 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:33:00 GMT 2023-11-02T09:40:49.692 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/ymkZlWlfrYEPQXakwEHofloDaBxeRfMQPkZIsRMGPezHvSZWMcRDjuRGvRNQkus 2023-11-02T09:40:49.692 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.692 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:O6pw3sBQH7rcrrRWwil/giVR93M= 2023-11-02T09:40:49.693 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'iTWUxMSx1sf/BjKvXIjIkg==', 'Content-Length': '3013026', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:33:00 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:O6pw3sBQH7rcrrRWwil/giVR93M='} 2023-11-02T09:40:49.693 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/szCzkxMfrgRnuExhHjNuojBcrviOkSaHpsjlTBXQIaCMuSFaGSQTAbutUBVHVbj 2023-11-02T09:40:49.693 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/szCzkxMfrgRnuExhHjNuojBcrviOkSaHpsjlTBXQIaCMuSFaGSQTAbutUBVHVbj 2023-11-02T09:40:49.693 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.693 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/szCzkxMfrgRnuExhHjNuojBcrviOkSaHpsjlTBXQIaCMuSFaGSQTAbutUBVHVbj 2023-11-02T09:40:49.693 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.694 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '6hN7kki2w8gvOp8/4QrcXA==', 'Content-Length': '3009677', 'Expect': '100-Continue'} 2023-11-02T09:40:49.694 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.694 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.694 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.694 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:49.695 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.695 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.695 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.695 INFO:teuthology.orchestra.run.smithi156.stderr:6hN7kki2w8gvOp8/4QrcXA== 2023-11-02T09:40:49.695 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.696 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:33:00 GMT 2023-11-02T09:40:49.696 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/szCzkxMfrgRnuExhHjNuojBcrviOkSaHpsjlTBXQIaCMuSFaGSQTAbutUBVHVbj 2023-11-02T09:40:49.697 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.697 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:du/+sxD+B5uYw+sCXAn/N7fmldE= 2023-11-02T09:40:49.697 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '6hN7kki2w8gvOp8/4QrcXA==', 'Content-Length': '3009677', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:33:00 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:du/+sxD+B5uYw+sCXAn/N7fmldE='} 2023-11-02T09:40:49.697 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"03fd9b5872b4d3897a9631d29d8fc534"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000f260b7620dcff314-0065436ccb-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:00 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:49.697 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/BcxUFksNuEPPVClDnbesoFtACRzULuwmfUjSyJrJGQhyfMLHHtGSvTbRLqIMKoU 2023-11-02T09:40:49.698 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/BcxUFksNuEPPVClDnbesoFtACRzULuwmfUjSyJrJGQhyfMLHHtGSvTbRLqIMKoU 2023-11-02T09:40:49.698 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.698 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/BcxUFksNuEPPVClDnbesoFtACRzULuwmfUjSyJrJGQhyfMLHHtGSvTbRLqIMKoU 2023-11-02T09:40:49.698 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.698 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '2VGiNRM1eY9F57Czs65GnQ==', 'Content-Length': '3010571', 'Expect': '100-Continue'} 2023-11-02T09:40:49.699 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.699 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.699 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.699 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.699 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.700 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.700 INFO:teuthology.orchestra.run.smithi156.stderr:2VGiNRM1eY9F57Czs65GnQ== 2023-11-02T09:40:49.700 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.700 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:33:00 GMT 2023-11-02T09:40:49.701 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/BcxUFksNuEPPVClDnbesoFtACRzULuwmfUjSyJrJGQhyfMLHHtGSvTbRLqIMKoU 2023-11-02T09:40:49.701 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.701 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:mGPgaOFW2anlJXu/g7NxLgUjoig= 2023-11-02T09:40:49.701 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '2VGiNRM1eY9F57Czs65GnQ==', 'Content-Length': '3010571', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:33:00 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:mGPgaOFW2anlJXu/g7NxLgUjoig='} 2023-11-02T09:40:49.702 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"7b38a18d0e3379154d84c1b43bd13548"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005a8e13a66121451c-0065436ccb-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:00 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:49.702 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"29d8940078213d07d480e66e7943d7e8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000007502ee5e52d50315-0065436ccb-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:00 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:49.702 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/rdIQUzGOHcJDXUFazvkyjDlPXdGkWSQGuaBlJHayLRtESSCjKVLZllJFycJcCev 2023-11-02T09:40:49.702 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/rdIQUzGOHcJDXUFazvkyjDlPXdGkWSQGuaBlJHayLRtESSCjKVLZllJFycJcCev 2023-11-02T09:40:49.702 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.703 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/rdIQUzGOHcJDXUFazvkyjDlPXdGkWSQGuaBlJHayLRtESSCjKVLZllJFycJcCev 2023-11-02T09:40:49.703 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.703 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'cD6eqpRh4Ausoke8u8ro5w==', 'Content-Length': '3011131', 'Expect': '100-Continue'} 2023-11-02T09:40:49.703 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.703 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.704 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.704 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.704 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.704 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.704 INFO:teuthology.orchestra.run.smithi156.stderr:cD6eqpRh4Ausoke8u8ro5w== 2023-11-02T09:40:49.705 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.705 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:33:00 GMT 2023-11-02T09:40:49.705 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/rdIQUzGOHcJDXUFazvkyjDlPXdGkWSQGuaBlJHayLRtESSCjKVLZllJFycJcCev 2023-11-02T09:40:49.705 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.705 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:nkok5VKuG+UlTEAsXLwYLLJEy0Y= 2023-11-02T09:40:49.705 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'cD6eqpRh4Ausoke8u8ro5w==', 'Content-Length': '3011131', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:33:00 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:nkok5VKuG+UlTEAsXLwYLLJEy0Y='} 2023-11-02T09:40:49.706 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/fomPWVUCeHwnsDZmipyIVzYRYwkXUAkvVzweAHDMcOHAZMTgqNFbfBabgsjRhuo 2023-11-02T09:40:49.706 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/fomPWVUCeHwnsDZmipyIVzYRYwkXUAkvVzweAHDMcOHAZMTgqNFbfBabgsjRhuo 2023-11-02T09:40:49.706 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.707 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/fomPWVUCeHwnsDZmipyIVzYRYwkXUAkvVzweAHDMcOHAZMTgqNFbfBabgsjRhuo 2023-11-02T09:40:49.707 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.707 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lSL99YHYDp1VHUwy6K1vlQ==', 'Content-Length': '3012324', 'Expect': '100-Continue'} 2023-11-02T09:40:49.707 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.708 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.708 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.708 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.708 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.708 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.709 INFO:teuthology.orchestra.run.smithi156.stderr:lSL99YHYDp1VHUwy6K1vlQ== 2023-11-02T09:40:49.709 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.709 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:33:00 GMT 2023-11-02T09:40:49.709 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/fomPWVUCeHwnsDZmipyIVzYRYwkXUAkvVzweAHDMcOHAZMTgqNFbfBabgsjRhuo 2023-11-02T09:40:49.709 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.710 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:Kt3hxGepGShUhpfLxxcQqAy1pBY= 2023-11-02T09:40:49.710 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lSL99YHYDp1VHUwy6K1vlQ==', 'Content-Length': '3012324', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:33:00 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:Kt3hxGepGShUhpfLxxcQqAy1pBY='} 2023-11-02T09:40:49.710 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/iYAONpDETZTupGGDhbNiDJofkuNbUUKMPrImDeAZOSEItbTTWQJqUOfnlGstCHv 2023-11-02T09:40:49.710 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/iYAONpDETZTupGGDhbNiDJofkuNbUUKMPrImDeAZOSEItbTTWQJqUOfnlGstCHv 2023-11-02T09:40:49.711 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.711 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/iYAONpDETZTupGGDhbNiDJofkuNbUUKMPrImDeAZOSEItbTTWQJqUOfnlGstCHv 2023-11-02T09:40:49.711 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.712 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'jGZDgO4xL93PmtN2dmwp3A==', 'Content-Length': '3008811', 'Expect': '100-Continue'} 2023-11-02T09:40:49.712 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.712 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.712 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.712 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:49.713 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.713 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.713 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.713 INFO:teuthology.orchestra.run.smithi156.stderr:jGZDgO4xL93PmtN2dmwp3A== 2023-11-02T09:40:49.713 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.714 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:33:00 GMT 2023-11-02T09:40:49.714 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/iYAONpDETZTupGGDhbNiDJofkuNbUUKMPrImDeAZOSEItbTTWQJqUOfnlGstCHv 2023-11-02T09:40:49.714 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.714 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:mpTBnEY8qzpCjZS9+m4tSubDiWY= 2023-11-02T09:40:49.714 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'jGZDgO4xL93PmtN2dmwp3A==', 'Content-Length': '3008811', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:33:00 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:mpTBnEY8qzpCjZS9+m4tSubDiWY='} 2023-11-02T09:40:49.715 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/wNPlPwyyFoiiVeikfstAENIUWBsJCzJrLNjHWGmMHMHDtaXkGBnZKfYAGlLigVr 2023-11-02T09:40:49.715 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/wNPlPwyyFoiiVeikfstAENIUWBsJCzJrLNjHWGmMHMHDtaXkGBnZKfYAGlLigVr 2023-11-02T09:40:49.715 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.715 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/wNPlPwyyFoiiVeikfstAENIUWBsJCzJrLNjHWGmMHMHDtaXkGBnZKfYAGlLigVr 2023-11-02T09:40:49.715 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.716 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'VSdZlLTAIW8x4oSRdTaQUQ==', 'Content-Length': '3009982', 'Expect': '100-Continue'} 2023-11-02T09:40:49.716 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.716 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.716 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.716 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:49.717 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.717 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.718 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.718 INFO:teuthology.orchestra.run.smithi156.stderr:VSdZlLTAIW8x4oSRdTaQUQ== 2023-11-02T09:40:49.718 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.718 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:33:00 GMT 2023-11-02T09:40:49.718 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/wNPlPwyyFoiiVeikfstAENIUWBsJCzJrLNjHWGmMHMHDtaXkGBnZKfYAGlLigVr 2023-11-02T09:40:49.719 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.719 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:b/ktQmf1rVFDK6RR2GDowhj5TcI= 2023-11-02T09:40:49.719 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'VSdZlLTAIW8x4oSRdTaQUQ==', 'Content-Length': '3009982', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:33:00 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:b/ktQmf1rVFDK6RR2GDowhj5TcI='} 2023-11-02T09:40:49.719 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/LRKGSKWMmwNwHCzLvFNhymSxheTCQpKWMXzPfgMRfUUKEhKxBrsrEGWkCUVsDja 2023-11-02T09:40:49.719 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/LRKGSKWMmwNwHCzLvFNhymSxheTCQpKWMXzPfgMRfUUKEhKxBrsrEGWkCUVsDja 2023-11-02T09:40:49.720 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.720 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/LRKGSKWMmwNwHCzLvFNhymSxheTCQpKWMXzPfgMRfUUKEhKxBrsrEGWkCUVsDja 2023-11-02T09:40:49.720 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.720 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qu9yGhoe1cx3WP6dTwXyEw==', 'Content-Length': '3010578', 'Expect': '100-Continue'} 2023-11-02T09:40:49.720 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.721 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.721 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.721 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:49.722 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.722 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.722 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.723 INFO:teuthology.orchestra.run.smithi156.stderr:qu9yGhoe1cx3WP6dTwXyEw== 2023-11-02T09:40:49.723 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.725 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:33:00 GMT 2023-11-02T09:40:49.725 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/LRKGSKWMmwNwHCzLvFNhymSxheTCQpKWMXzPfgMRfUUKEhKxBrsrEGWkCUVsDja 2023-11-02T09:40:49.726 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.726 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:xDqcIECYDRMhY0rov7Vq/JGKez4= 2023-11-02T09:40:49.726 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qu9yGhoe1cx3WP6dTwXyEw==', 'Content-Length': '3010578', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:33:00 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:xDqcIECYDRMhY0rov7Vq/JGKez4='} 2023-11-02T09:40:49.726 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/CPZEBggtXkapQWxTNmhfGBCprVqoKODhLrGkXanmoxTlDSbGtBGuDtoGUtmPVsV 2023-11-02T09:40:49.726 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/CPZEBggtXkapQWxTNmhfGBCprVqoKODhLrGkXanmoxTlDSbGtBGuDtoGUtmPVsV 2023-11-02T09:40:49.727 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.727 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/CPZEBggtXkapQWxTNmhfGBCprVqoKODhLrGkXanmoxTlDSbGtBGuDtoGUtmPVsV 2023-11-02T09:40:49.727 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.727 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'VYJ1ecmwKNw4G65ac8bxTg==', 'Content-Length': '3010065', 'Expect': '100-Continue'} 2023-11-02T09:40:49.727 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.728 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.728 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.728 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:49.728 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.732 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.732 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.733 INFO:teuthology.orchestra.run.smithi156.stderr:VYJ1ecmwKNw4G65ac8bxTg== 2023-11-02T09:40:49.733 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.733 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:33:00 GMT 2023-11-02T09:40:49.733 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/CPZEBggtXkapQWxTNmhfGBCprVqoKODhLrGkXanmoxTlDSbGtBGuDtoGUtmPVsV 2023-11-02T09:40:49.733 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.734 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:UAFxEHYFaCFL2zxfoSOYdnkhzDs= 2023-11-02T09:40:49.734 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'VYJ1ecmwKNw4G65ac8bxTg==', 'Content-Length': '3010065', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:33:00 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:UAFxEHYFaCFL2zxfoSOYdnkhzDs='} 2023-11-02T09:40:49.734 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"3da6270f3112062f87271d07a25f43a8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000463aa67550234b73-0065436ccb-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:00 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:49.734 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"8bb7082857cf1143706588dcd0cfa416"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000008b0fa912b60db107-0065436ccb-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:00 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:49.734 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/lfCnkdRfXppGCrIDPClvmLxrSXSydgETrBkBsadDqyotPNVuxaOPitMUWGAPxTa 2023-11-02T09:40:49.735 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/lfCnkdRfXppGCrIDPClvmLxrSXSydgETrBkBsadDqyotPNVuxaOPitMUWGAPxTa 2023-11-02T09:40:49.735 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.735 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/lfCnkdRfXppGCrIDPClvmLxrSXSydgETrBkBsadDqyotPNVuxaOPitMUWGAPxTa 2023-11-02T09:40:49.735 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.735 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'SioMEGhftqvaFF3EoqvWVw==', 'Content-Length': '3010613', 'Expect': '100-Continue'} 2023-11-02T09:40:49.736 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.736 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.736 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.736 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.736 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.737 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.737 INFO:teuthology.orchestra.run.smithi156.stderr:SioMEGhftqvaFF3EoqvWVw== 2023-11-02T09:40:49.737 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.737 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:33:00 GMT 2023-11-02T09:40:49.737 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/lfCnkdRfXppGCrIDPClvmLxrSXSydgETrBkBsadDqyotPNVuxaOPitMUWGAPxTa 2023-11-02T09:40:49.737 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.738 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:gcXPgC2ZbHsBBHcL4NV/F99O7GI= 2023-11-02T09:40:49.738 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'SioMEGhftqvaFF3EoqvWVw==', 'Content-Length': '3010613', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:33:00 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:gcXPgC2ZbHsBBHcL4NV/F99O7GI='} 2023-11-02T09:40:49.738 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/WghSHzhtfJYssaPZsNaYwIotwvNlHqxvPcIaxVmExfsBrPsrqgJJaFDqfEvaBrv 2023-11-02T09:40:49.738 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/WghSHzhtfJYssaPZsNaYwIotwvNlHqxvPcIaxVmExfsBrPsrqgJJaFDqfEvaBrv 2023-11-02T09:40:49.742 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.743 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/WghSHzhtfJYssaPZsNaYwIotwvNlHqxvPcIaxVmExfsBrPsrqgJJaFDqfEvaBrv 2023-11-02T09:40:49.743 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.743 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'fg+p1s1tdzgEaOTashxMJA==', 'Content-Length': '3008794', 'Expect': '100-Continue'} 2023-11-02T09:40:49.744 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.744 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.744 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.744 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.744 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.745 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.747 INFO:teuthology.orchestra.run.smithi156.stderr:fg+p1s1tdzgEaOTashxMJA== 2023-11-02T09:40:49.751 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.751 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:33:00 GMT 2023-11-02T09:40:49.751 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/WghSHzhtfJYssaPZsNaYwIotwvNlHqxvPcIaxVmExfsBrPsrqgJJaFDqfEvaBrv 2023-11-02T09:40:49.752 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.753 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:0HN/niO7qgtqeeB5gBzzP//lso4= 2023-11-02T09:40:49.753 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'fg+p1s1tdzgEaOTashxMJA==', 'Content-Length': '3008794', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:33:00 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:0HN/niO7qgtqeeB5gBzzP//lso4='} 2023-11-02T09:40:49.753 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/ShdmgOOlAgmKbOFhbDVgQHReOSiSzjnDWuSRGSpWYbnRHngOUjubCGzpwvvRiQE 2023-11-02T09:40:49.753 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/ShdmgOOlAgmKbOFhbDVgQHReOSiSzjnDWuSRGSpWYbnRHngOUjubCGzpwvvRiQE 2023-11-02T09:40:49.753 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.754 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/ShdmgOOlAgmKbOFhbDVgQHReOSiSzjnDWuSRGSpWYbnRHngOUjubCGzpwvvRiQE 2023-11-02T09:40:49.754 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.754 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'PhG7NsPPTaWB6FlLSalnnw==', 'Content-Length': '3011345', 'Expect': '100-Continue'} 2023-11-02T09:40:49.754 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.755 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.755 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.755 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:49.756 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.756 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.756 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.756 INFO:teuthology.orchestra.run.smithi156.stderr:PhG7NsPPTaWB6FlLSalnnw== 2023-11-02T09:40:49.756 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.758 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:33:00 GMT 2023-11-02T09:40:49.758 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/ShdmgOOlAgmKbOFhbDVgQHReOSiSzjnDWuSRGSpWYbnRHngOUjubCGzpwvvRiQE 2023-11-02T09:40:49.759 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.759 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:Pc+IDkPipN2fN2Nt2Q01zWDScis= 2023-11-02T09:40:49.759 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'PhG7NsPPTaWB6FlLSalnnw==', 'Content-Length': '3011345', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:33:00 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:Pc+IDkPipN2fN2Nt2Q01zWDScis='} 2023-11-02T09:40:49.760 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/sSBszQIVqJYGafoBLZRZOIiBfZYuwPIHtgAlaVdTkofZQJiIactWKWvwByAhvkc 2023-11-02T09:40:49.760 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/sSBszQIVqJYGafoBLZRZOIiBfZYuwPIHtgAlaVdTkofZQJiIactWKWvwByAhvkc 2023-11-02T09:40:49.760 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.760 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/sSBszQIVqJYGafoBLZRZOIiBfZYuwPIHtgAlaVdTkofZQJiIactWKWvwByAhvkc 2023-11-02T09:40:49.761 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.761 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'IvXS/J5GxJlOX59/AQt9Fw==', 'Content-Length': '3011642', 'Expect': '100-Continue'} 2023-11-02T09:40:49.761 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.762 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.762 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.762 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:49.762 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.762 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.763 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.763 INFO:teuthology.orchestra.run.smithi156.stderr:IvXS/J5GxJlOX59/AQt9Fw== 2023-11-02T09:40:49.763 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.763 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:33:00 GMT 2023-11-02T09:40:49.763 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/sSBszQIVqJYGafoBLZRZOIiBfZYuwPIHtgAlaVdTkofZQJiIactWKWvwByAhvkc 2023-11-02T09:40:49.764 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.764 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:fpusd/xj0mS3sC8TYJE993J+QoI= 2023-11-02T09:40:49.766 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'IvXS/J5GxJlOX59/AQt9Fw==', 'Content-Length': '3011642', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:33:00 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:fpusd/xj0mS3sC8TYJE993J+QoI='} 2023-11-02T09:40:49.766 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"256c1d45d2fbbf4b576ff5090e309a55"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000007b6dda4c64780676-0065436ccb-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:00 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:49.766 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/GgMUPymCfgEleNhoMGyGQYCWGwRwxHkjmqsLmrDNAhOCwaRjgRpFFPkHapccuHU 2023-11-02T09:40:49.767 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/GgMUPymCfgEleNhoMGyGQYCWGwRwxHkjmqsLmrDNAhOCwaRjgRpFFPkHapccuHU 2023-11-02T09:40:49.770 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.770 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/GgMUPymCfgEleNhoMGyGQYCWGwRwxHkjmqsLmrDNAhOCwaRjgRpFFPkHapccuHU 2023-11-02T09:40:49.770 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.770 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'F4+yNsR61ayBkpi9dhfgBw==', 'Content-Length': '3010007', 'Expect': '100-Continue'} 2023-11-02T09:40:49.773 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.773 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.773 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.773 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.773 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.774 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.774 INFO:teuthology.orchestra.run.smithi156.stderr:F4+yNsR61ayBkpi9dhfgBw== 2023-11-02T09:40:49.774 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.775 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:33:00 GMT 2023-11-02T09:40:49.775 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/GgMUPymCfgEleNhoMGyGQYCWGwRwxHkjmqsLmrDNAhOCwaRjgRpFFPkHapccuHU 2023-11-02T09:40:49.775 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.775 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:itG5AoNrFLv4PPSt84R62u/1vb0= 2023-11-02T09:40:49.775 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'F4+yNsR61ayBkpi9dhfgBw==', 'Content-Length': '3010007', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:33:00 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:itG5AoNrFLv4PPSt84R62u/1vb0='} 2023-11-02T09:40:49.776 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"0d97a91b3e32675eeb347a528c2cbd2e"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000075b3e300932aa09e-0065436ccb-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:00 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:49.776 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/FNfSusXTnhgsiciiGSGJqmJRPGjTZRYaRdaVXefDeroTcmGMMZBYUXOvqtRFUby 2023-11-02T09:40:49.776 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/FNfSusXTnhgsiciiGSGJqmJRPGjTZRYaRdaVXefDeroTcmGMMZBYUXOvqtRFUby 2023-11-02T09:40:49.776 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.776 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/FNfSusXTnhgsiciiGSGJqmJRPGjTZRYaRdaVXefDeroTcmGMMZBYUXOvqtRFUby 2023-11-02T09:40:49.777 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.777 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'Jp8hH6+vCjiT+Xah+3rTiQ==', 'Content-Length': '3012528', 'Expect': '100-Continue'} 2023-11-02T09:40:49.777 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.777 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.778 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.779 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.779 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.779 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.780 INFO:teuthology.orchestra.run.smithi156.stderr:Jp8hH6+vCjiT+Xah+3rTiQ== 2023-11-02T09:40:49.780 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.780 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:33:00 GMT 2023-11-02T09:40:49.780 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/FNfSusXTnhgsiciiGSGJqmJRPGjTZRYaRdaVXefDeroTcmGMMZBYUXOvqtRFUby 2023-11-02T09:40:49.780 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.781 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:ltrlBYAoVaNUxD6qj2hRi4v4HVo= 2023-11-02T09:40:49.781 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'Jp8hH6+vCjiT+Xah+3rTiQ==', 'Content-Length': '3012528', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:33:00 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:ltrlBYAoVaNUxD6qj2hRi4v4HVo='} 2023-11-02T09:40:49.781 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/nfCvzhEHMelKLApFNWMNZUuFlZMVrXWWJFDLuwIJOAzzgxipIebxZrDzYMYObei 2023-11-02T09:40:49.781 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/nfCvzhEHMelKLApFNWMNZUuFlZMVrXWWJFDLuwIJOAzzgxipIebxZrDzYMYObei 2023-11-02T09:40:49.781 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.782 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/nfCvzhEHMelKLApFNWMNZUuFlZMVrXWWJFDLuwIJOAzzgxipIebxZrDzYMYObei 2023-11-02T09:40:49.782 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.782 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'SBlBvDk4bPBsBJtStI/hwA==', 'Content-Length': '3011099', 'Expect': '100-Continue'} 2023-11-02T09:40:49.782 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.782 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.783 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.783 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:49.784 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.787 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.787 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.787 INFO:teuthology.orchestra.run.smithi156.stderr:SBlBvDk4bPBsBJtStI/hwA== 2023-11-02T09:40:49.787 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.788 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:33:00 GMT 2023-11-02T09:40:49.788 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/nfCvzhEHMelKLApFNWMNZUuFlZMVrXWWJFDLuwIJOAzzgxipIebxZrDzYMYObei 2023-11-02T09:40:49.789 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.789 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:gZXCpBOZMaDO02+Vjf+JooIYO2I= 2023-11-02T09:40:49.789 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'SBlBvDk4bPBsBJtStI/hwA==', 'Content-Length': '3011099', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:33:00 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:gZXCpBOZMaDO02+Vjf+JooIYO2I='} 2023-11-02T09:40:49.790 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"ad14fa65a05667749b9bdfa87ddeb32b"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000053c4c3fee72d813b-0065436ccb-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:00 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:49.790 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/PQnghAlVSrLlhOwtCCWBenksJQYdYgeEHXVkARsLJDDWIOnsJcjkPnCAMENdKDW 2023-11-02T09:40:49.790 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/PQnghAlVSrLlhOwtCCWBenksJQYdYgeEHXVkARsLJDDWIOnsJcjkPnCAMENdKDW 2023-11-02T09:40:49.790 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.791 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/PQnghAlVSrLlhOwtCCWBenksJQYdYgeEHXVkARsLJDDWIOnsJcjkPnCAMENdKDW 2023-11-02T09:40:49.791 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.792 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '9q6hEkucVnwfEQeRfumcGg==', 'Content-Length': '3012758', 'Expect': '100-Continue'} 2023-11-02T09:40:49.792 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.792 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.792 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.792 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.793 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.793 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.795 INFO:teuthology.orchestra.run.smithi156.stderr:9q6hEkucVnwfEQeRfumcGg== 2023-11-02T09:40:49.796 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.796 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:33:00 GMT 2023-11-02T09:40:49.796 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/PQnghAlVSrLlhOwtCCWBenksJQYdYgeEHXVkARsLJDDWIOnsJcjkPnCAMENdKDW 2023-11-02T09:40:49.797 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.797 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:D+06BQCPsm1gTT2tbFUFaW2Py1o= 2023-11-02T09:40:49.797 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '9q6hEkucVnwfEQeRfumcGg==', 'Content-Length': '3012758', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:33:00 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:D+06BQCPsm1gTT2tbFUFaW2Py1o='} 2023-11-02T09:40:49.797 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/PlWcXTqsxqRANwbRbUQkVEBwIrUwCYcFiqTZqQvdfffHWycShPTlhDabmQvAlhX 2023-11-02T09:40:49.798 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/PlWcXTqsxqRANwbRbUQkVEBwIrUwCYcFiqTZqQvdfffHWycShPTlhDabmQvAlhX 2023-11-02T09:40:49.798 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.798 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/PlWcXTqsxqRANwbRbUQkVEBwIrUwCYcFiqTZqQvdfffHWycShPTlhDabmQvAlhX 2023-11-02T09:40:49.798 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.798 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '5OVRnJnFAlcfTbTZsiKWYw==', 'Content-Length': '3012133', 'Expect': '100-Continue'} 2023-11-02T09:40:49.799 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.799 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.799 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.800 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:49.800 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.800 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.800 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.801 INFO:teuthology.orchestra.run.smithi156.stderr:5OVRnJnFAlcfTbTZsiKWYw== 2023-11-02T09:40:49.802 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.803 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:33:00 GMT 2023-11-02T09:40:49.803 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/PlWcXTqsxqRANwbRbUQkVEBwIrUwCYcFiqTZqQvdfffHWycShPTlhDabmQvAlhX 2023-11-02T09:40:49.804 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.804 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:iVx6O3gNieloKZRaSxrQ16r/EEM= 2023-11-02T09:40:49.804 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '5OVRnJnFAlcfTbTZsiKWYw==', 'Content-Length': '3012133', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:33:00 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:iVx6O3gNieloKZRaSxrQ16r/EEM='} 2023-11-02T09:40:49.805 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"8f7ecd3229887e469ebd26fc729ea35e"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000086ce3a36ff694eb7-0065436ccb-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:00 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:49.805 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/GRgyUvgWIqtmMFjmLSKwzbsKDNkwebjLxdeioBnbcvazulWzBoxoVnPxfCqfYHm 2023-11-02T09:40:49.807 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/GRgyUvgWIqtmMFjmLSKwzbsKDNkwebjLxdeioBnbcvazulWzBoxoVnPxfCqfYHm 2023-11-02T09:40:49.808 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.808 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/GRgyUvgWIqtmMFjmLSKwzbsKDNkwebjLxdeioBnbcvazulWzBoxoVnPxfCqfYHm 2023-11-02T09:40:49.809 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.809 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'mioBFHSAmKh9jI96ouPvgQ==', 'Content-Length': '3010149', 'Expect': '100-Continue'} 2023-11-02T09:40:49.809 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.810 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.810 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.810 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.816 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.817 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.817 INFO:teuthology.orchestra.run.smithi156.stderr:mioBFHSAmKh9jI96ouPvgQ== 2023-11-02T09:40:49.817 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.817 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:33:00 GMT 2023-11-02T09:40:49.817 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/GRgyUvgWIqtmMFjmLSKwzbsKDNkwebjLxdeioBnbcvazulWzBoxoVnPxfCqfYHm 2023-11-02T09:40:49.818 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.818 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:gq/gN2fpKUaDgDLjUqNa7fAiWTA= 2023-11-02T09:40:49.818 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'mioBFHSAmKh9jI96ouPvgQ==', 'Content-Length': '3010149', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:33:00 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:gq/gN2fpKUaDgDLjUqNa7fAiWTA='} 2023-11-02T09:40:49.818 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/fsRgMzeGvLzCUqfoAovbEjtjdIPkvxGPwXSJRbFHBQeNLkAeeyuOhRdqGHSCizI 2023-11-02T09:40:49.818 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/fsRgMzeGvLzCUqfoAovbEjtjdIPkvxGPwXSJRbFHBQeNLkAeeyuOhRdqGHSCizI 2023-11-02T09:40:49.819 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.819 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/fsRgMzeGvLzCUqfoAovbEjtjdIPkvxGPwXSJRbFHBQeNLkAeeyuOhRdqGHSCizI 2023-11-02T09:40:49.819 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.819 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'dukVv4BbfL98UTuoxOcQSA==', 'Content-Length': '3010250', 'Expect': '100-Continue'} 2023-11-02T09:40:49.820 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.820 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.820 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.821 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:49.830 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.831 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.831 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.831 INFO:teuthology.orchestra.run.smithi156.stderr:dukVv4BbfL98UTuoxOcQSA== 2023-11-02T09:40:49.831 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.831 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:33:00 GMT 2023-11-02T09:40:49.832 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/fsRgMzeGvLzCUqfoAovbEjtjdIPkvxGPwXSJRbFHBQeNLkAeeyuOhRdqGHSCizI 2023-11-02T09:40:49.832 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.832 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:56ySNquBbl9l4JqLdbko+LPm7Gs= 2023-11-02T09:40:49.832 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'dukVv4BbfL98UTuoxOcQSA==', 'Content-Length': '3010250', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:33:00 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:56ySNquBbl9l4JqLdbko+LPm7Gs='} 2023-11-02T09:40:49.832 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/awGgsjBwkHICLIXurVnYXogRYPOIUTNfHNewICXoQxtImWaXkbyzFddbBzRmgMy 2023-11-02T09:40:49.833 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/awGgsjBwkHICLIXurVnYXogRYPOIUTNfHNewICXoQxtImWaXkbyzFddbBzRmgMy 2023-11-02T09:40:49.833 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.833 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/awGgsjBwkHICLIXurVnYXogRYPOIUTNfHNewICXoQxtImWaXkbyzFddbBzRmgMy 2023-11-02T09:40:49.833 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.833 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'noUMqiSJMJxaAILmKFUrmQ==', 'Content-Length': '3007318', 'Expect': '100-Continue'} 2023-11-02T09:40:49.834 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.834 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.834 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.834 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:49.834 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.834 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.835 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.835 INFO:teuthology.orchestra.run.smithi156.stderr:noUMqiSJMJxaAILmKFUrmQ== 2023-11-02T09:40:49.835 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.836 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:33:00 GMT 2023-11-02T09:40:49.836 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/awGgsjBwkHICLIXurVnYXogRYPOIUTNfHNewICXoQxtImWaXkbyzFddbBzRmgMy 2023-11-02T09:40:49.836 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.836 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:Il9PKdUSug6OC2hY6VeMNQnxZy4= 2023-11-02T09:40:49.836 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'noUMqiSJMJxaAILmKFUrmQ==', 'Content-Length': '3007318', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:33:00 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:Il9PKdUSug6OC2hY6VeMNQnxZy4='} 2023-11-02T09:40:49.837 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"166feaa97bef27b40b8ac14eae20e0d1"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000981320c2bf4da8e6-0065436ccb-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:00 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:49.837 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/XsvYNofwhvIbVYqzrfmmiEHUCLXeWPtwhMOHCtSedQOFMNAymrggAfsKwccfdUU 2023-11-02T09:40:49.837 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/XsvYNofwhvIbVYqzrfmmiEHUCLXeWPtwhMOHCtSedQOFMNAymrggAfsKwccfdUU 2023-11-02T09:40:49.837 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.837 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/XsvYNofwhvIbVYqzrfmmiEHUCLXeWPtwhMOHCtSedQOFMNAymrggAfsKwccfdUU 2023-11-02T09:40:49.838 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.838 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '0zfs9KjpSzcYDnZaUAV35Q==', 'Content-Length': '3008601', 'Expect': '100-Continue'} 2023-11-02T09:40:49.838 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.838 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.838 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.839 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.839 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.839 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.839 INFO:teuthology.orchestra.run.smithi156.stderr:0zfs9KjpSzcYDnZaUAV35Q== 2023-11-02T09:40:49.839 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.840 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:33:00 GMT 2023-11-02T09:40:49.840 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/XsvYNofwhvIbVYqzrfmmiEHUCLXeWPtwhMOHCtSedQOFMNAymrggAfsKwccfdUU 2023-11-02T09:40:49.840 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.840 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:jV9dcGckmaZ6PvQAV8IMZ1mq2tE= 2023-11-02T09:40:49.840 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '0zfs9KjpSzcYDnZaUAV35Q==', 'Content-Length': '3008601', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:33:00 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:jV9dcGckmaZ6PvQAV8IMZ1mq2tE='} 2023-11-02T09:40:49.841 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"48b48b08636c5598abe0e452204b6693"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000003d8e3915925384cc-0065436ccb-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:00 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:49.841 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/qbXpwhONNvaWVWjfhlIMkKCzicjLtfPLKoAgXqVCliztJjEWSngoozVtwQCNUPS 2023-11-02T09:40:49.841 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/qbXpwhONNvaWVWjfhlIMkKCzicjLtfPLKoAgXqVCliztJjEWSngoozVtwQCNUPS 2023-11-02T09:40:49.841 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.841 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/qbXpwhONNvaWVWjfhlIMkKCzicjLtfPLKoAgXqVCliztJjEWSngoozVtwQCNUPS 2023-11-02T09:40:49.841 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.842 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '2owM+8NpFPsIN108Ovk3Pw==', 'Content-Length': '3012802', 'Expect': '100-Continue'} 2023-11-02T09:40:49.842 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.842 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.842 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.842 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.843 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.843 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.843 INFO:teuthology.orchestra.run.smithi156.stderr:2owM+8NpFPsIN108Ovk3Pw== 2023-11-02T09:40:49.843 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.843 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:33:00 GMT 2023-11-02T09:40:49.844 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/qbXpwhONNvaWVWjfhlIMkKCzicjLtfPLKoAgXqVCliztJjEWSngoozVtwQCNUPS 2023-11-02T09:40:49.844 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.844 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:6he55qdMvmWlwRr1/JNgnkSWcZo= 2023-11-02T09:40:49.844 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '2owM+8NpFPsIN108Ovk3Pw==', 'Content-Length': '3012802', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:33:00 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:6he55qdMvmWlwRr1/JNgnkSWcZo='} 2023-11-02T09:40:49.844 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/VtVZOxvnXkagMsYaLXLwqwHUJkikAPDJqvlKMsRciPvqvkDqzkglhOPhNbvuYmB 2023-11-02T09:40:49.845 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/VtVZOxvnXkagMsYaLXLwqwHUJkikAPDJqvlKMsRciPvqvkDqzkglhOPhNbvuYmB 2023-11-02T09:40:49.845 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.845 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/VtVZOxvnXkagMsYaLXLwqwHUJkikAPDJqvlKMsRciPvqvkDqzkglhOPhNbvuYmB 2023-11-02T09:40:49.845 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.845 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'tPWwAwM1RBYXSUEo5O/qgQ==', 'Content-Length': '3010690', 'Expect': '100-Continue'} 2023-11-02T09:40:49.846 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.846 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.846 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.846 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:49.846 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.847 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.847 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.847 INFO:teuthology.orchestra.run.smithi156.stderr:tPWwAwM1RBYXSUEo5O/qgQ== 2023-11-02T09:40:49.847 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.847 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:33:00 GMT 2023-11-02T09:40:49.848 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/VtVZOxvnXkagMsYaLXLwqwHUJkikAPDJqvlKMsRciPvqvkDqzkglhOPhNbvuYmB 2023-11-02T09:40:49.848 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.848 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:nj5fbByGpYgIq+fS4RdHNlAE3Zg= 2023-11-02T09:40:49.848 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'tPWwAwM1RBYXSUEo5O/qgQ==', 'Content-Length': '3010690', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:33:00 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:nj5fbByGpYgIq+fS4RdHNlAE3Zg='} 2023-11-02T09:40:49.848 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/QOoPCLPmDKpMqRboMZDEhpimwrDqzFUngNWfCTOfdJlwbAYHwgzWudiSHiZzQdc 2023-11-02T09:40:49.849 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/QOoPCLPmDKpMqRboMZDEhpimwrDqzFUngNWfCTOfdJlwbAYHwgzWudiSHiZzQdc 2023-11-02T09:40:49.849 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.849 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/QOoPCLPmDKpMqRboMZDEhpimwrDqzFUngNWfCTOfdJlwbAYHwgzWudiSHiZzQdc 2023-11-02T09:40:49.849 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.849 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'ev38divTXGEMMb+6QQgdxA==', 'Content-Length': '3011087', 'Expect': '100-Continue'} 2023-11-02T09:40:49.849 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.850 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.851 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.851 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:49.851 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.851 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.851 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.852 INFO:teuthology.orchestra.run.smithi156.stderr:ev38divTXGEMMb+6QQgdxA== 2023-11-02T09:40:49.852 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.852 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:33:00 GMT 2023-11-02T09:40:49.852 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/QOoPCLPmDKpMqRboMZDEhpimwrDqzFUngNWfCTOfdJlwbAYHwgzWudiSHiZzQdc 2023-11-02T09:40:49.852 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.852 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:2Kq99/v1HYBQS89/yfy9CymfF0k= 2023-11-02T09:40:49.853 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'ev38divTXGEMMb+6QQgdxA==', 'Content-Length': '3011087', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:33:00 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:2Kq99/v1HYBQS89/yfy9CymfF0k='} 2023-11-02T09:40:49.853 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/WSoraTkDiNvpprXipyZougBbhnfccwVBUGQXSJqWLTnbAaLNyVHRrMPmgoBENah 2023-11-02T09:40:49.853 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/WSoraTkDiNvpprXipyZougBbhnfccwVBUGQXSJqWLTnbAaLNyVHRrMPmgoBENah 2023-11-02T09:40:49.853 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.853 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/WSoraTkDiNvpprXipyZougBbhnfccwVBUGQXSJqWLTnbAaLNyVHRrMPmgoBENah 2023-11-02T09:40:49.854 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.854 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'D8o1L5kn6ez2E1daqXsniQ==', 'Content-Length': '3008007', 'Expect': '100-Continue'} 2023-11-02T09:40:49.854 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.854 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.854 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.855 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:49.855 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.855 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.855 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.856 INFO:teuthology.orchestra.run.smithi156.stderr:D8o1L5kn6ez2E1daqXsniQ== 2023-11-02T09:40:49.856 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.856 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:33:00 GMT 2023-11-02T09:40:49.856 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/WSoraTkDiNvpprXipyZougBbhnfccwVBUGQXSJqWLTnbAaLNyVHRrMPmgoBENah 2023-11-02T09:40:49.856 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.857 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:GvOhI09mYTeQOkHGC8/TKOcJfuw= 2023-11-02T09:40:49.857 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'D8o1L5kn6ez2E1daqXsniQ==', 'Content-Length': '3008007', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:33:00 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:GvOhI09mYTeQOkHGC8/TKOcJfuw='} 2023-11-02T09:40:49.857 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/ZVlZhkBsxeXOXwpeWaUoUYxOEDoIFfdoJGDcQmWZnzIUSmCnVJvLFHxEYDdFZYQ 2023-11-02T09:40:49.857 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/ZVlZhkBsxeXOXwpeWaUoUYxOEDoIFfdoJGDcQmWZnzIUSmCnVJvLFHxEYDdFZYQ 2023-11-02T09:40:49.857 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.858 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/ZVlZhkBsxeXOXwpeWaUoUYxOEDoIFfdoJGDcQmWZnzIUSmCnVJvLFHxEYDdFZYQ 2023-11-02T09:40:49.858 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.858 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'BgeYLZzFkx5CiiKedJ5Jxg==', 'Content-Length': '3009738', 'Expect': '100-Continue'} 2023-11-02T09:40:49.858 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.858 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.859 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.859 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:49.859 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.859 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.859 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.860 INFO:teuthology.orchestra.run.smithi156.stderr:BgeYLZzFkx5CiiKedJ5Jxg== 2023-11-02T09:40:49.860 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.860 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:33:00 GMT 2023-11-02T09:40:49.860 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/ZVlZhkBsxeXOXwpeWaUoUYxOEDoIFfdoJGDcQmWZnzIUSmCnVJvLFHxEYDdFZYQ 2023-11-02T09:40:49.860 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.861 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:NtA5Yq0Ap1mVNjwYb3stBjPZFf4= 2023-11-02T09:40:49.861 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'BgeYLZzFkx5CiiKedJ5Jxg==', 'Content-Length': '3009738', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:33:00 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:NtA5Yq0Ap1mVNjwYb3stBjPZFf4='} 2023-11-02T09:40:49.861 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/AfDpFzFKrVGMTFSHRkQhqBxnmVPXNlvtGRyozfbXSBdQFWHeWtZkHyjGzYQrWGH 2023-11-02T09:40:49.861 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/AfDpFzFKrVGMTFSHRkQhqBxnmVPXNlvtGRyozfbXSBdQFWHeWtZkHyjGzYQrWGH 2023-11-02T09:40:49.861 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.862 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/AfDpFzFKrVGMTFSHRkQhqBxnmVPXNlvtGRyozfbXSBdQFWHeWtZkHyjGzYQrWGH 2023-11-02T09:40:49.862 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.862 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'vatVJbC0rLXyZKk2WJ+dFA==', 'Content-Length': '3009851', 'Expect': '100-Continue'} 2023-11-02T09:40:49.862 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.862 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.863 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.863 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:49.863 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.863 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.863 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.864 INFO:teuthology.orchestra.run.smithi156.stderr:vatVJbC0rLXyZKk2WJ+dFA== 2023-11-02T09:40:49.864 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.864 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:33:00 GMT 2023-11-02T09:40:49.864 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/AfDpFzFKrVGMTFSHRkQhqBxnmVPXNlvtGRyozfbXSBdQFWHeWtZkHyjGzYQrWGH 2023-11-02T09:40:49.864 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.864 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:OB45mXqPX56FxNHVVSIUykq5YeU= 2023-11-02T09:40:49.865 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'vatVJbC0rLXyZKk2WJ+dFA==', 'Content-Length': '3009851', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:33:00 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:OB45mXqPX56FxNHVVSIUykq5YeU='} 2023-11-02T09:40:49.865 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"f379f677d2836b0791805c48279cf1cb"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000749a5c8bb1fc2451-0065436ccb-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:00 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:49.865 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/imdsuxHGZsWCxauvBDsmRLbYvejLdBJRiyFiTSdduWWKvCVdIACDRCCgmVccVKM 2023-11-02T09:40:49.865 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/imdsuxHGZsWCxauvBDsmRLbYvejLdBJRiyFiTSdduWWKvCVdIACDRCCgmVccVKM 2023-11-02T09:40:49.865 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.866 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/imdsuxHGZsWCxauvBDsmRLbYvejLdBJRiyFiTSdduWWKvCVdIACDRCCgmVccVKM 2023-11-02T09:40:49.866 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.866 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '7iVJ6G0v/43xue+FETotGg==', 'Content-Length': '3009170', 'Expect': '100-Continue'} 2023-11-02T09:40:49.866 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.866 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.867 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.867 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.867 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.867 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.867 INFO:teuthology.orchestra.run.smithi156.stderr:7iVJ6G0v/43xue+FETotGg== 2023-11-02T09:40:49.868 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.868 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:33:00 GMT 2023-11-02T09:40:49.868 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/imdsuxHGZsWCxauvBDsmRLbYvejLdBJRiyFiTSdduWWKvCVdIACDRCCgmVccVKM 2023-11-02T09:40:49.868 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.868 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:OoVKYSNwSdjxwnvZ3kwXUXNTjmU= 2023-11-02T09:40:49.868 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '7iVJ6G0v/43xue+FETotGg==', 'Content-Length': '3009170', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:33:00 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:OoVKYSNwSdjxwnvZ3kwXUXNTjmU='} 2023-11-02T09:40:49.869 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"bf4e45033f7b1b977e7aa0c2e8f6ab3c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000f85c93edaa795db0-0065436ccb-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:00 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:49.869 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/LUtOjZHUTgvlIBMgxsMVosbzqiajlNjJfkoplInCElwjZnGxyrqzcVowHFPyhRK 2023-11-02T09:40:49.869 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/LUtOjZHUTgvlIBMgxsMVosbzqiajlNjJfkoplInCElwjZnGxyrqzcVowHFPyhRK 2023-11-02T09:40:49.869 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.869 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/LUtOjZHUTgvlIBMgxsMVosbzqiajlNjJfkoplInCElwjZnGxyrqzcVowHFPyhRK 2023-11-02T09:40:49.870 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.870 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '99ubGPpWYAz60YQShIWwYg==', 'Content-Length': '3011699', 'Expect': '100-Continue'} 2023-11-02T09:40:49.870 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.870 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.870 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.871 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.871 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.871 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.871 INFO:teuthology.orchestra.run.smithi156.stderr:99ubGPpWYAz60YQShIWwYg== 2023-11-02T09:40:49.871 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.872 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:33:00 GMT 2023-11-02T09:40:49.872 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/LUtOjZHUTgvlIBMgxsMVosbzqiajlNjJfkoplInCElwjZnGxyrqzcVowHFPyhRK 2023-11-02T09:40:49.872 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.872 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:pwFalR2mpIELcOi0kNJA6vkyXQM= 2023-11-02T09:40:49.872 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '99ubGPpWYAz60YQShIWwYg==', 'Content-Length': '3011699', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:33:00 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:pwFalR2mpIELcOi0kNJA6vkyXQM='} 2023-11-02T09:40:49.873 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"f5788e34b8809ec3dd60f0b919d70d65"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a2a00f09e9f8e93e-0065436ccb-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:00 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:49.873 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"431a04cf35e59f06a104f22b14c0a3a9"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000006e903a3b437ebfb4-0065436ccb-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:00 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:49.873 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"b69de179b7497fe1837749cacb51fdf5"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d6b8b3e215741210-0065436ccb-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:00 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:49.873 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/HAlxyqygKwdFcTevBpolxHRZzacLZHtQdqGdqJQkeFfEbDbmixvqOxuDCHFimtj 2023-11-02T09:40:49.874 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/HAlxyqygKwdFcTevBpolxHRZzacLZHtQdqGdqJQkeFfEbDbmixvqOxuDCHFimtj 2023-11-02T09:40:49.874 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.874 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/HAlxyqygKwdFcTevBpolxHRZzacLZHtQdqGdqJQkeFfEbDbmixvqOxuDCHFimtj 2023-11-02T09:40:49.874 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.874 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'JKa0TAytLU7EShT5xz0JXg==', 'Content-Length': '3010534', 'Expect': '100-Continue'} 2023-11-02T09:40:49.875 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.875 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.875 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.875 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.876 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.876 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.876 INFO:teuthology.orchestra.run.smithi156.stderr:JKa0TAytLU7EShT5xz0JXg== 2023-11-02T09:40:49.876 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.876 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:33:00 GMT 2023-11-02T09:40:49.877 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/HAlxyqygKwdFcTevBpolxHRZzacLZHtQdqGdqJQkeFfEbDbmixvqOxuDCHFimtj 2023-11-02T09:40:49.877 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.877 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:TktNAnwmQAHRh68jrFPBXepvR64= 2023-11-02T09:40:49.877 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'JKa0TAytLU7EShT5xz0JXg==', 'Content-Length': '3010534', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:33:00 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:TktNAnwmQAHRh68jrFPBXepvR64='} 2023-11-02T09:40:49.877 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/SOhOUuLyQJdDTyzuHgthDTQdIFalnlzKsaHvrvvJkCmiOfWiRjXssdZzRhoqlda 2023-11-02T09:40:49.878 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/SOhOUuLyQJdDTyzuHgthDTQdIFalnlzKsaHvrvvJkCmiOfWiRjXssdZzRhoqlda 2023-11-02T09:40:49.878 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.878 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/SOhOUuLyQJdDTyzuHgthDTQdIFalnlzKsaHvrvvJkCmiOfWiRjXssdZzRhoqlda 2023-11-02T09:40:49.878 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.878 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'wNVR8cpUdyrz5HeOJdnaXA==', 'Content-Length': '3011082', 'Expect': '100-Continue'} 2023-11-02T09:40:49.879 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.879 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.879 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.879 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.879 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.880 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.880 INFO:teuthology.orchestra.run.smithi156.stderr:wNVR8cpUdyrz5HeOJdnaXA== 2023-11-02T09:40:49.880 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.880 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:33:00 GMT 2023-11-02T09:40:49.880 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/SOhOUuLyQJdDTyzuHgthDTQdIFalnlzKsaHvrvvJkCmiOfWiRjXssdZzRhoqlda 2023-11-02T09:40:49.881 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.881 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:u62piKQCqZ0kiWB/MLsStFkbDow= 2023-11-02T09:40:49.881 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'wNVR8cpUdyrz5HeOJdnaXA==', 'Content-Length': '3011082', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:33:00 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:u62piKQCqZ0kiWB/MLsStFkbDow='} 2023-11-02T09:40:49.881 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/nmyTahmqoyXtXhVCjVbQzqQouFgcBjtJSJbCEwyfptFsZoGMDJYCSIMpbqScJiJ 2023-11-02T09:40:49.888 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/nmyTahmqoyXtXhVCjVbQzqQouFgcBjtJSJbCEwyfptFsZoGMDJYCSIMpbqScJiJ 2023-11-02T09:40:49.888 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.888 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/nmyTahmqoyXtXhVCjVbQzqQouFgcBjtJSJbCEwyfptFsZoGMDJYCSIMpbqScJiJ 2023-11-02T09:40:49.888 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.888 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'f9pkeWWM0VMHPkSdJ2rB5w==', 'Content-Length': '3007726', 'Expect': '100-Continue'} 2023-11-02T09:40:49.889 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.889 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.889 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.889 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.889 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.890 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.890 INFO:teuthology.orchestra.run.smithi156.stderr:f9pkeWWM0VMHPkSdJ2rB5w== 2023-11-02T09:40:49.890 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.890 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:33:00 GMT 2023-11-02T09:40:49.890 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/nmyTahmqoyXtXhVCjVbQzqQouFgcBjtJSJbCEwyfptFsZoGMDJYCSIMpbqScJiJ 2023-11-02T09:40:49.891 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.891 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:tI28viqNvvTc+JY283NqpfeOp8A= 2023-11-02T09:40:49.891 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'f9pkeWWM0VMHPkSdJ2rB5w==', 'Content-Length': '3007726', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:33:00 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:tI28viqNvvTc+JY283NqpfeOp8A='} 2023-11-02T09:40:49.891 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"d8ee50b55a755225748921e4a40c6a5d"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000c1fe5edabe149222-0065436ccb-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:00 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:49.892 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/AhHjGLRxYeugWBfXRQzQhDgPZgSATeIEUVCbVfwwOxVEABjOSZrnOXntHcxQkxc 2023-11-02T09:40:49.892 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/AhHjGLRxYeugWBfXRQzQhDgPZgSATeIEUVCbVfwwOxVEABjOSZrnOXntHcxQkxc 2023-11-02T09:40:49.892 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.892 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/AhHjGLRxYeugWBfXRQzQhDgPZgSATeIEUVCbVfwwOxVEABjOSZrnOXntHcxQkxc 2023-11-02T09:40:49.892 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.893 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'c0a4Gf//8rb3aUUlyEDFqw==', 'Content-Length': '3011409', 'Expect': '100-Continue'} 2023-11-02T09:40:49.893 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.893 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.893 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.893 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.894 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.894 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.894 INFO:teuthology.orchestra.run.smithi156.stderr:c0a4Gf//8rb3aUUlyEDFqw== 2023-11-02T09:40:49.894 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.894 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:33:00 GMT 2023-11-02T09:40:49.895 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/AhHjGLRxYeugWBfXRQzQhDgPZgSATeIEUVCbVfwwOxVEABjOSZrnOXntHcxQkxc 2023-11-02T09:40:49.895 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.895 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:ZmFuPoGMembLm/7Vf2NRCUMgyUs= 2023-11-02T09:40:49.895 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'c0a4Gf//8rb3aUUlyEDFqw==', 'Content-Length': '3011409', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:33:00 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:ZmFuPoGMembLm/7Vf2NRCUMgyUs='} 2023-11-02T09:40:49.895 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/rZkAquYbIHnVNinpLJeGpATpTmcFZUuEWJzBXGYDFvsWNtHmKpYmhOgqfUrJAzL 2023-11-02T09:40:49.896 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/rZkAquYbIHnVNinpLJeGpATpTmcFZUuEWJzBXGYDFvsWNtHmKpYmhOgqfUrJAzL 2023-11-02T09:40:49.896 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.896 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/rZkAquYbIHnVNinpLJeGpATpTmcFZUuEWJzBXGYDFvsWNtHmKpYmhOgqfUrJAzL 2023-11-02T09:40:49.896 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.896 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '7DI+flA1xKFksTbgkeaxzQ==', 'Content-Length': '3010709', 'Expect': '100-Continue'} 2023-11-02T09:40:49.897 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.897 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.897 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.897 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:49.897 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.897 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.898 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.898 INFO:teuthology.orchestra.run.smithi156.stderr:7DI+flA1xKFksTbgkeaxzQ== 2023-11-02T09:40:49.898 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.900 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:33:00 GMT 2023-11-02T09:40:49.901 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/rZkAquYbIHnVNinpLJeGpATpTmcFZUuEWJzBXGYDFvsWNtHmKpYmhOgqfUrJAzL 2023-11-02T09:40:49.901 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.901 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:gXC4LBCgraqIeq1U1F3c5dth7mk= 2023-11-02T09:40:49.901 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '7DI+flA1xKFksTbgkeaxzQ==', 'Content-Length': '3010709', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:33:00 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:gXC4LBCgraqIeq1U1F3c5dth7mk='} 2023-11-02T09:40:49.901 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/iNFeceZwKeOpEirODjbScshjfdQSGWWXltdjvXpkBQjmNxyOqihrxwObHXnPzBJ 2023-11-02T09:40:49.902 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/iNFeceZwKeOpEirODjbScshjfdQSGWWXltdjvXpkBQjmNxyOqihrxwObHXnPzBJ 2023-11-02T09:40:49.902 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.902 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/iNFeceZwKeOpEirODjbScshjfdQSGWWXltdjvXpkBQjmNxyOqihrxwObHXnPzBJ 2023-11-02T09:40:49.902 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.902 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'bg4qTgkE7t2uDl59Is666A==', 'Content-Length': '3013341', 'Expect': '100-Continue'} 2023-11-02T09:40:49.903 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.903 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.903 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.903 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:49.903 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.904 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.904 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.904 INFO:teuthology.orchestra.run.smithi156.stderr:bg4qTgkE7t2uDl59Is666A== 2023-11-02T09:40:49.904 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.904 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:33:00 GMT 2023-11-02T09:40:49.904 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/iNFeceZwKeOpEirODjbScshjfdQSGWWXltdjvXpkBQjmNxyOqihrxwObHXnPzBJ 2023-11-02T09:40:49.905 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.905 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:1mfPO/IGQo2IwRp9D/wG9qhs0Ks= 2023-11-02T09:40:49.905 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'bg4qTgkE7t2uDl59Is666A==', 'Content-Length': '3013341', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:33:00 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:1mfPO/IGQo2IwRp9D/wG9qhs0Ks='} 2023-11-02T09:40:49.905 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a4ad4f87a1c9607f871d37a5d055cab9"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000004ce076cd15ae93b5-0065436ccb-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:00 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:49.905 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/ilZImKfwmYQNceGszsPifWvWrwaTBctYYHAvGEIjPYoyuSYnqEcakHdHENVgVve 2023-11-02T09:40:49.906 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/ilZImKfwmYQNceGszsPifWvWrwaTBctYYHAvGEIjPYoyuSYnqEcakHdHENVgVve 2023-11-02T09:40:49.906 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.906 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/ilZImKfwmYQNceGszsPifWvWrwaTBctYYHAvGEIjPYoyuSYnqEcakHdHENVgVve 2023-11-02T09:40:49.906 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.906 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'HnHw1ardbXxnQztcW84BMA==', 'Content-Length': '3010037', 'Expect': '100-Continue'} 2023-11-02T09:40:49.907 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.907 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.907 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.907 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.907 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.908 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.908 INFO:teuthology.orchestra.run.smithi156.stderr:HnHw1ardbXxnQztcW84BMA== 2023-11-02T09:40:49.908 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.908 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:33:00 GMT 2023-11-02T09:40:49.908 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/ilZImKfwmYQNceGszsPifWvWrwaTBctYYHAvGEIjPYoyuSYnqEcakHdHENVgVve 2023-11-02T09:40:49.909 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.909 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:2l5tEqQAD/l45yvE/j6BAbWmPoU= 2023-11-02T09:40:49.909 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'HnHw1ardbXxnQztcW84BMA==', 'Content-Length': '3010037', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:33:00 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:2l5tEqQAD/l45yvE/j6BAbWmPoU='} 2023-11-02T09:40:49.909 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"232e8b5d004a865a95c80eff81c5dcf1"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000012a08f9e0be7b26d-0065436ccb-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:00 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:49.910 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"8b76d0f5e6ff5240b4895da686895d5c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e67923e01c63bd4a-0065436ccb-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:00 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:49.910 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/rLcxcQlznPCqrndZcMVYqyflszWYSjqdylrbizorWnKArUSPYSrGoFrhCiBloCG 2023-11-02T09:40:49.910 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/rLcxcQlznPCqrndZcMVYqyflszWYSjqdylrbizorWnKArUSPYSrGoFrhCiBloCG 2023-11-02T09:40:49.910 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.910 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/rLcxcQlznPCqrndZcMVYqyflszWYSjqdylrbizorWnKArUSPYSrGoFrhCiBloCG 2023-11-02T09:40:49.911 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.911 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'tOQvQcD8y1XDHUDQNmWvfg==', 'Content-Length': '3012668', 'Expect': '100-Continue'} 2023-11-02T09:40:49.911 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.911 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.911 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.912 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.912 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.912 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.913 INFO:teuthology.orchestra.run.smithi156.stderr:tOQvQcD8y1XDHUDQNmWvfg== 2023-11-02T09:40:49.913 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.915 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:33:00 GMT 2023-11-02T09:40:49.915 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/rLcxcQlznPCqrndZcMVYqyflszWYSjqdylrbizorWnKArUSPYSrGoFrhCiBloCG 2023-11-02T09:40:49.916 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.916 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:mAp5QOPrjibomBsU/iGXLNSSS84= 2023-11-02T09:40:49.916 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'tOQvQcD8y1XDHUDQNmWvfg==', 'Content-Length': '3012668', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:33:00 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:mAp5QOPrjibomBsU/iGXLNSSS84='} 2023-11-02T09:40:49.916 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/vjDhRjjdWKwgaBrtIbBXTaVnrjmxelUCoNWrGRaWMIwJYSIshUJvfpifdwAmqru 2023-11-02T09:40:49.916 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/vjDhRjjdWKwgaBrtIbBXTaVnrjmxelUCoNWrGRaWMIwJYSIshUJvfpifdwAmqru 2023-11-02T09:40:49.917 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.917 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/vjDhRjjdWKwgaBrtIbBXTaVnrjmxelUCoNWrGRaWMIwJYSIshUJvfpifdwAmqru 2023-11-02T09:40:49.917 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.917 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '+xk7zNRjsIUZduOjePYHYw==', 'Content-Length': '3011233', 'Expect': '100-Continue'} 2023-11-02T09:40:49.917 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.918 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.918 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.918 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.918 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.918 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.919 INFO:teuthology.orchestra.run.smithi156.stderr:+xk7zNRjsIUZduOjePYHYw== 2023-11-02T09:40:49.919 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.919 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:33:00 GMT 2023-11-02T09:40:49.919 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/vjDhRjjdWKwgaBrtIbBXTaVnrjmxelUCoNWrGRaWMIwJYSIshUJvfpifdwAmqru 2023-11-02T09:40:49.919 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.920 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:ljero07w/JEI96nGdWnyt84JTXQ= 2023-11-02T09:40:49.920 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '+xk7zNRjsIUZduOjePYHYw==', 'Content-Length': '3011233', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:33:00 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:ljero07w/JEI96nGdWnyt84JTXQ='} 2023-11-02T09:40:49.920 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/PXgAyjExMyiBoTXvSHmdMNnGfOCFuPgqwPlXSBTSRzgVWwCXymOuDpqqRdedGGC 2023-11-02T09:40:49.920 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/PXgAyjExMyiBoTXvSHmdMNnGfOCFuPgqwPlXSBTSRzgVWwCXymOuDpqqRdedGGC 2023-11-02T09:40:49.920 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.920 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/PXgAyjExMyiBoTXvSHmdMNnGfOCFuPgqwPlXSBTSRzgVWwCXymOuDpqqRdedGGC 2023-11-02T09:40:49.921 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.921 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '4YqwzS1O14LMgv7CubEXWg==', 'Content-Length': '3009840', 'Expect': '100-Continue'} 2023-11-02T09:40:49.921 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.921 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.921 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.922 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:49.922 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.922 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.922 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.922 INFO:teuthology.orchestra.run.smithi156.stderr:4YqwzS1O14LMgv7CubEXWg== 2023-11-02T09:40:49.923 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.923 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:33:00 GMT 2023-11-02T09:40:49.923 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/PXgAyjExMyiBoTXvSHmdMNnGfOCFuPgqwPlXSBTSRzgVWwCXymOuDpqqRdedGGC 2023-11-02T09:40:49.923 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.923 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:wl9Meeu3adRVe5gpRl5sqoDu4u4= 2023-11-02T09:40:49.924 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '4YqwzS1O14LMgv7CubEXWg==', 'Content-Length': '3009840', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:33:00 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:wl9Meeu3adRVe5gpRl5sqoDu4u4='} 2023-11-02T09:40:49.924 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"397a19b00895174c96e1f93909e60016"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000004af0acf9d2170015-0065436ccc-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:00 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:49.924 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"da170b5eae34a640ce3976474c72cd69"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000deb4a506d0afcb2-0065436ccc-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:00 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:49.924 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/qTzTViLpSuLTZlzbjamqapdqFWagSXuerrKHJRHKWAshddQLWNZiHuvEZpZwCzR 2023-11-02T09:40:49.924 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/qTzTViLpSuLTZlzbjamqapdqFWagSXuerrKHJRHKWAshddQLWNZiHuvEZpZwCzR 2023-11-02T09:40:49.924 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.925 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/qTzTViLpSuLTZlzbjamqapdqFWagSXuerrKHJRHKWAshddQLWNZiHuvEZpZwCzR 2023-11-02T09:40:49.925 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.925 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '/3uwgGcw1u19AK0uAiHe0Q==', 'Content-Length': '3008572', 'Expect': '100-Continue'} 2023-11-02T09:40:49.925 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.925 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.926 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.926 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.926 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.926 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.926 INFO:teuthology.orchestra.run.smithi156.stderr:/3uwgGcw1u19AK0uAiHe0Q== 2023-11-02T09:40:49.927 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.927 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:33:00 GMT 2023-11-02T09:40:49.927 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/qTzTViLpSuLTZlzbjamqapdqFWagSXuerrKHJRHKWAshddQLWNZiHuvEZpZwCzR 2023-11-02T09:40:49.927 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.927 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:eGrBA5F5FgU3kBIQHqbSgRUY39Y= 2023-11-02T09:40:49.929 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '/3uwgGcw1u19AK0uAiHe0Q==', 'Content-Length': '3008572', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:33:00 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:eGrBA5F5FgU3kBIQHqbSgRUY39Y='} 2023-11-02T09:40:49.929 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/YTgqDSlOyItdqTWHZVJWuFifAsKZWaNBHolGbCMDBdAJskTzeAsODTnMwJUiiJw 2023-11-02T09:40:49.929 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/YTgqDSlOyItdqTWHZVJWuFifAsKZWaNBHolGbCMDBdAJskTzeAsODTnMwJUiiJw 2023-11-02T09:40:49.930 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.930 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/YTgqDSlOyItdqTWHZVJWuFifAsKZWaNBHolGbCMDBdAJskTzeAsODTnMwJUiiJw 2023-11-02T09:40:49.930 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.930 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qC8WA31hy1aqDCsUvj1Yng==', 'Content-Length': '3010064', 'Expect': '100-Continue'} 2023-11-02T09:40:49.930 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.931 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.931 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.931 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.931 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.931 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.931 INFO:teuthology.orchestra.run.smithi156.stderr:qC8WA31hy1aqDCsUvj1Yng== 2023-11-02T09:40:49.932 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.932 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:33:00 GMT 2023-11-02T09:40:49.932 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/YTgqDSlOyItdqTWHZVJWuFifAsKZWaNBHolGbCMDBdAJskTzeAsODTnMwJUiiJw 2023-11-02T09:40:49.932 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.932 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:G9+S8TxgpwX+DB9Aw8ChVSvjCWE= 2023-11-02T09:40:49.933 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qC8WA31hy1aqDCsUvj1Yng==', 'Content-Length': '3010064', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:33:00 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:G9+S8TxgpwX+DB9Aw8ChVSvjCWE='} 2023-11-02T09:40:49.933 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/vIVQwQGaiQPAbcEGMidDyrmctYuKaiSYyWOjOMWLAssSawLSoAVBlYcfEPihPtn 2023-11-02T09:40:49.933 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/vIVQwQGaiQPAbcEGMidDyrmctYuKaiSYyWOjOMWLAssSawLSoAVBlYcfEPihPtn 2023-11-02T09:40:49.933 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.933 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/vIVQwQGaiQPAbcEGMidDyrmctYuKaiSYyWOjOMWLAssSawLSoAVBlYcfEPihPtn 2023-11-02T09:40:49.934 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.934 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '8X/ZQmmxJ4JGHeyCHXYEmA==', 'Content-Length': '3009721', 'Expect': '100-Continue'} 2023-11-02T09:40:49.934 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.934 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.934 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.935 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:49.935 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.935 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.935 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.935 INFO:teuthology.orchestra.run.smithi156.stderr:8X/ZQmmxJ4JGHeyCHXYEmA== 2023-11-02T09:40:49.935 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.936 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:33:00 GMT 2023-11-02T09:40:49.936 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/vIVQwQGaiQPAbcEGMidDyrmctYuKaiSYyWOjOMWLAssSawLSoAVBlYcfEPihPtn 2023-11-02T09:40:49.936 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.936 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:Hg6cGv2uVmOD5+W4R5XlcuFDxog= 2023-11-02T09:40:49.936 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '8X/ZQmmxJ4JGHeyCHXYEmA==', 'Content-Length': '3009721', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:33:00 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:Hg6cGv2uVmOD5+W4R5XlcuFDxog='} 2023-11-02T09:40:49.937 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/KQGkehgWyrpyNyigyoUDfGKdrxdVKhGeQbmqyphsECStwfQOPbNqDlLQReybYRM 2023-11-02T09:40:49.937 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/KQGkehgWyrpyNyigyoUDfGKdrxdVKhGeQbmqyphsECStwfQOPbNqDlLQReybYRM 2023-11-02T09:40:49.937 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.937 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/KQGkehgWyrpyNyigyoUDfGKdrxdVKhGeQbmqyphsECStwfQOPbNqDlLQReybYRM 2023-11-02T09:40:49.937 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.938 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '1DNI0u7GSlc63T3y2Rctjw==', 'Content-Length': '3011452', 'Expect': '100-Continue'} 2023-11-02T09:40:49.938 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.938 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.938 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.938 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:49.939 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.939 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.939 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.939 INFO:teuthology.orchestra.run.smithi156.stderr:1DNI0u7GSlc63T3y2Rctjw== 2023-11-02T09:40:49.939 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.940 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:33:00 GMT 2023-11-02T09:40:49.940 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/KQGkehgWyrpyNyigyoUDfGKdrxdVKhGeQbmqyphsECStwfQOPbNqDlLQReybYRM 2023-11-02T09:40:49.940 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.940 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:kdQVHmXBEkKmUcb68l1Jc5x4kYo= 2023-11-02T09:40:49.940 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '1DNI0u7GSlc63T3y2Rctjw==', 'Content-Length': '3011452', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:33:00 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:kdQVHmXBEkKmUcb68l1Jc5x4kYo='} 2023-11-02T09:40:49.940 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/ssqYmaCWUABlvyEivGcrqUUaJoDJwLxtXPhJnofJfTbEiTaUChSokSuNnlPQEdO 2023-11-02T09:40:49.941 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/ssqYmaCWUABlvyEivGcrqUUaJoDJwLxtXPhJnofJfTbEiTaUChSokSuNnlPQEdO 2023-11-02T09:40:49.941 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.941 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/ssqYmaCWUABlvyEivGcrqUUaJoDJwLxtXPhJnofJfTbEiTaUChSokSuNnlPQEdO 2023-11-02T09:40:49.941 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.941 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'LG1NYqusAIda4rA6QSI/VQ==', 'Content-Length': '3009805', 'Expect': '100-Continue'} 2023-11-02T09:40:49.942 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.942 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.942 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.942 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:49.942 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.943 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.943 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.943 INFO:teuthology.orchestra.run.smithi156.stderr:LG1NYqusAIda4rA6QSI/VQ== 2023-11-02T09:40:49.943 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.943 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:33:00 GMT 2023-11-02T09:40:49.944 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/ssqYmaCWUABlvyEivGcrqUUaJoDJwLxtXPhJnofJfTbEiTaUChSokSuNnlPQEdO 2023-11-02T09:40:49.944 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.944 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:HyqKIoTICXRtAu69mdfcgQKHd8Y= 2023-11-02T09:40:49.944 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'LG1NYqusAIda4rA6QSI/VQ==', 'Content-Length': '3009805', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:33:00 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:HyqKIoTICXRtAu69mdfcgQKHd8Y='} 2023-11-02T09:40:49.944 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/ZXuABupyvMWrIzvylyrHThjtZTBvYJbrTqufvGdHUKZhTZCsJGVCkGltENWGlJB 2023-11-02T09:40:49.944 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/ZXuABupyvMWrIzvylyrHThjtZTBvYJbrTqufvGdHUKZhTZCsJGVCkGltENWGlJB 2023-11-02T09:40:49.945 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.945 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/ZXuABupyvMWrIzvylyrHThjtZTBvYJbrTqufvGdHUKZhTZCsJGVCkGltENWGlJB 2023-11-02T09:40:49.945 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.945 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'J6V34pIBhCqNdcpkmbtYXA==', 'Content-Length': '3010658', 'Expect': '100-Continue'} 2023-11-02T09:40:49.945 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.946 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.946 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.946 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:49.946 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.946 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.947 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.947 INFO:teuthology.orchestra.run.smithi156.stderr:J6V34pIBhCqNdcpkmbtYXA== 2023-11-02T09:40:49.947 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.947 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:33:00 GMT 2023-11-02T09:40:49.948 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/ZXuABupyvMWrIzvylyrHThjtZTBvYJbrTqufvGdHUKZhTZCsJGVCkGltENWGlJB 2023-11-02T09:40:49.948 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.948 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:chjFz1Ynjo0WndUWbfXNKQrYPyQ= 2023-11-02T09:40:49.948 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'J6V34pIBhCqNdcpkmbtYXA==', 'Content-Length': '3010658', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:33:00 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:chjFz1Ynjo0WndUWbfXNKQrYPyQ='} 2023-11-02T09:40:49.948 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/aaFkoGnKMdxWAiqFHgbQwvSuQHNmJYgyOCJprCYSLGOZDIJqQagNrzayLRUCoqe 2023-11-02T09:40:49.949 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/aaFkoGnKMdxWAiqFHgbQwvSuQHNmJYgyOCJprCYSLGOZDIJqQagNrzayLRUCoqe 2023-11-02T09:40:49.949 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.949 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/aaFkoGnKMdxWAiqFHgbQwvSuQHNmJYgyOCJprCYSLGOZDIJqQagNrzayLRUCoqe 2023-11-02T09:40:49.949 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.949 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '6CcluKWaKoKUawk3l0tEqQ==', 'Content-Length': '3008335', 'Expect': '100-Continue'} 2023-11-02T09:40:49.950 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.950 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.950 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.950 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:49.951 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.951 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.951 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.951 INFO:teuthology.orchestra.run.smithi156.stderr:6CcluKWaKoKUawk3l0tEqQ== 2023-11-02T09:40:49.951 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.952 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:33:00 GMT 2023-11-02T09:40:49.952 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/aaFkoGnKMdxWAiqFHgbQwvSuQHNmJYgyOCJprCYSLGOZDIJqQagNrzayLRUCoqe 2023-11-02T09:40:49.952 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.952 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:+95gvhUjE1LX9wcadfqyUnLYaV0= 2023-11-02T09:40:49.952 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '6CcluKWaKoKUawk3l0tEqQ==', 'Content-Length': '3008335', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:33:00 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:+95gvhUjE1LX9wcadfqyUnLYaV0='} 2023-11-02T09:40:49.952 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/owITPjVyPiHAEWqRdzxHcGwjctCqYmTzlyZQpoQqMunSzCOdrbvKAuxiuEzSGCw 2023-11-02T09:40:49.953 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/owITPjVyPiHAEWqRdzxHcGwjctCqYmTzlyZQpoQqMunSzCOdrbvKAuxiuEzSGCw 2023-11-02T09:40:49.953 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.953 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/owITPjVyPiHAEWqRdzxHcGwjctCqYmTzlyZQpoQqMunSzCOdrbvKAuxiuEzSGCw 2023-11-02T09:40:49.953 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.953 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'Apyhf8/u7VlC4d26kvGeNQ==', 'Content-Length': '3012838', 'Expect': '100-Continue'} 2023-11-02T09:40:49.954 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.954 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.954 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.954 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:49.954 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.955 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.955 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.955 INFO:teuthology.orchestra.run.smithi156.stderr:Apyhf8/u7VlC4d26kvGeNQ== 2023-11-02T09:40:49.955 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.955 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:33:00 GMT 2023-11-02T09:40:49.956 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/owITPjVyPiHAEWqRdzxHcGwjctCqYmTzlyZQpoQqMunSzCOdrbvKAuxiuEzSGCw 2023-11-02T09:40:49.956 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.956 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:IksVhh6O+TLk6B/D3xQbS7eAjuQ= 2023-11-02T09:40:49.956 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'Apyhf8/u7VlC4d26kvGeNQ==', 'Content-Length': '3012838', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:33:00 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:IksVhh6O+TLk6B/D3xQbS7eAjuQ='} 2023-11-02T09:40:49.956 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/efKPBUoeqGwvFybmWUDBGzPOnNTPHmreuRpnUXdDZRRYjTBAmgtDbHcJkjxBbJD 2023-11-02T09:40:49.957 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/efKPBUoeqGwvFybmWUDBGzPOnNTPHmreuRpnUXdDZRRYjTBAmgtDbHcJkjxBbJD 2023-11-02T09:40:49.957 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.957 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/efKPBUoeqGwvFybmWUDBGzPOnNTPHmreuRpnUXdDZRRYjTBAmgtDbHcJkjxBbJD 2023-11-02T09:40:49.957 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.957 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '3u2KeO6KRrNidhfIaBLrVw==', 'Content-Length': '3011694', 'Expect': '100-Continue'} 2023-11-02T09:40:49.958 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.958 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.958 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.958 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:49.958 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.959 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.959 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.959 INFO:teuthology.orchestra.run.smithi156.stderr:3u2KeO6KRrNidhfIaBLrVw== 2023-11-02T09:40:49.959 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.960 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:33:00 GMT 2023-11-02T09:40:49.960 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/efKPBUoeqGwvFybmWUDBGzPOnNTPHmreuRpnUXdDZRRYjTBAmgtDbHcJkjxBbJD 2023-11-02T09:40:49.960 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.960 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:URIWU8d0A+tcEHPANXcTSeBr58Y= 2023-11-02T09:40:49.961 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '3u2KeO6KRrNidhfIaBLrVw==', 'Content-Length': '3011694', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:33:00 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:URIWU8d0A+tcEHPANXcTSeBr58Y='} 2023-11-02T09:40:49.961 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"251226a9630ee8c6d6b6d2ef6c6da9e3"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000edd9d709ba05cb5a-0065436ccc-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:00 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:49.961 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"ea137b9248b6c3c82f3a9f3fe10adc5c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000001b01d2dfbd6ff21a-0065436ccc-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:00 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:49.962 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/hHQWwgydGnIDIyaTpKhJvqgShoIPjdjsZnQMTokxjibNFIEqPyACklOgxMXaWMN 2023-11-02T09:40:49.962 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/hHQWwgydGnIDIyaTpKhJvqgShoIPjdjsZnQMTokxjibNFIEqPyACklOgxMXaWMN 2023-11-02T09:40:49.962 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.962 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/hHQWwgydGnIDIyaTpKhJvqgShoIPjdjsZnQMTokxjibNFIEqPyACklOgxMXaWMN 2023-11-02T09:40:49.963 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.963 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'gJR5RL3j+wHtDAGWPyyE9Q==', 'Content-Length': '3007555', 'Expect': '100-Continue'} 2023-11-02T09:40:49.963 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.963 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.964 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.964 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.964 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.964 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.964 INFO:teuthology.orchestra.run.smithi156.stderr:gJR5RL3j+wHtDAGWPyyE9Q== 2023-11-02T09:40:49.964 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.965 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:33:00 GMT 2023-11-02T09:40:49.965 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/hHQWwgydGnIDIyaTpKhJvqgShoIPjdjsZnQMTokxjibNFIEqPyACklOgxMXaWMN 2023-11-02T09:40:49.965 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.965 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:umfxdw++14vEIzq+FoauNITOCrw= 2023-11-02T09:40:49.965 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'gJR5RL3j+wHtDAGWPyyE9Q==', 'Content-Length': '3007555', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:33:00 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:umfxdw++14vEIzq+FoauNITOCrw='} 2023-11-02T09:40:49.966 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/giVmzTmUDsVilJeNriLXasJfaStEIHyUYJfYCkqoEWqFvOpIuqVQeYgkiBjnxuL 2023-11-02T09:40:49.966 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/giVmzTmUDsVilJeNriLXasJfaStEIHyUYJfYCkqoEWqFvOpIuqVQeYgkiBjnxuL 2023-11-02T09:40:49.966 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.966 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/giVmzTmUDsVilJeNriLXasJfaStEIHyUYJfYCkqoEWqFvOpIuqVQeYgkiBjnxuL 2023-11-02T09:40:49.966 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.967 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '3d0/VjEgUL1CKzv9LaWz8Q==', 'Content-Length': '3013605', 'Expect': '100-Continue'} 2023-11-02T09:40:49.967 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.967 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.967 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.967 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.968 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.968 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.968 INFO:teuthology.orchestra.run.smithi156.stderr:3d0/VjEgUL1CKzv9LaWz8Q== 2023-11-02T09:40:49.968 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.968 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:33:00 GMT 2023-11-02T09:40:49.969 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/giVmzTmUDsVilJeNriLXasJfaStEIHyUYJfYCkqoEWqFvOpIuqVQeYgkiBjnxuL 2023-11-02T09:40:49.969 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.969 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:WbuuhqQnDsVxMMzN5J7i32/meEE= 2023-11-02T09:40:49.969 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '3d0/VjEgUL1CKzv9LaWz8Q==', 'Content-Length': '3013605', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:33:00 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:WbuuhqQnDsVxMMzN5J7i32/meEE='} 2023-11-02T09:40:49.969 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/STvzXfqhrKwpNzUiMknmfQIqDOTEMnDmIdUlRpSzpeuqLvvKEFkhIstKXHSCIOd 2023-11-02T09:40:49.969 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/STvzXfqhrKwpNzUiMknmfQIqDOTEMnDmIdUlRpSzpeuqLvvKEFkhIstKXHSCIOd 2023-11-02T09:40:49.970 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.970 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/STvzXfqhrKwpNzUiMknmfQIqDOTEMnDmIdUlRpSzpeuqLvvKEFkhIstKXHSCIOd 2023-11-02T09:40:49.970 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.970 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '7Fl9ySTZU8qEPFY9izvtdQ==', 'Content-Length': '3013132', 'Expect': '100-Continue'} 2023-11-02T09:40:49.970 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.971 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.971 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.971 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:49.971 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.971 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.972 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.972 INFO:teuthology.orchestra.run.smithi156.stderr:7Fl9ySTZU8qEPFY9izvtdQ== 2023-11-02T09:40:49.972 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.972 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:33:00 GMT 2023-11-02T09:40:49.972 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/STvzXfqhrKwpNzUiMknmfQIqDOTEMnDmIdUlRpSzpeuqLvvKEFkhIstKXHSCIOd 2023-11-02T09:40:49.973 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.973 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:vptV2ToPS3EePOaLMQOgORdx/t4= 2023-11-02T09:40:49.973 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '7Fl9ySTZU8qEPFY9izvtdQ==', 'Content-Length': '3013132', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:33:00 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:vptV2ToPS3EePOaLMQOgORdx/t4='} 2023-11-02T09:40:49.973 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/LMUtUmdSESVxXNsEPwXgZBIozPThUqPzjzigrZdlrpQeDpFEVaFIBpUkhKnTlgd 2023-11-02T09:40:49.974 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/LMUtUmdSESVxXNsEPwXgZBIozPThUqPzjzigrZdlrpQeDpFEVaFIBpUkhKnTlgd 2023-11-02T09:40:49.979 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.979 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/LMUtUmdSESVxXNsEPwXgZBIozPThUqPzjzigrZdlrpQeDpFEVaFIBpUkhKnTlgd 2023-11-02T09:40:49.979 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.979 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'dOb4GjMCfpiQ2wjKNRTcBw==', 'Content-Length': '3009334', 'Expect': '100-Continue'} 2023-11-02T09:40:49.980 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.980 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.980 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.980 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:49.980 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.981 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.981 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.981 INFO:teuthology.orchestra.run.smithi156.stderr:dOb4GjMCfpiQ2wjKNRTcBw== 2023-11-02T09:40:49.981 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.981 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:33:00 GMT 2023-11-02T09:40:49.982 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/LMUtUmdSESVxXNsEPwXgZBIozPThUqPzjzigrZdlrpQeDpFEVaFIBpUkhKnTlgd 2023-11-02T09:40:49.982 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.982 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:NssKT0rb9352M56MTIzKhNj8nSQ= 2023-11-02T09:40:49.982 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'dOb4GjMCfpiQ2wjKNRTcBw==', 'Content-Length': '3009334', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:33:00 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:NssKT0rb9352M56MTIzKhNj8nSQ='} 2023-11-02T09:40:49.982 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"703e9eaa9461e00baca247bcbbcae8e7"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000026d22429c1405b9c-0065436ccc-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:00 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:49.983 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"c529f7563c36b0f81e6264f65973e89d"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000006156560e50ffb621-0065436ccc-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:00 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:49.983 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"d951a2351335798f45e7b0b3b3ae469d"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005d82ea9005e0e423-0065436ccc-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:00 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:49.983 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"893594c4c4b1d6c7ff0632af5c88c892"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000004e205c8524b4242d-0065436ccc-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:00 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:49.983 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/yVCXdOqkscQTYahWtzKvAcwywOGWDniKTwPkOGCPzHhPqqveEyLXfngkYpUevxk 2023-11-02T09:40:49.983 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/yVCXdOqkscQTYahWtzKvAcwywOGWDniKTwPkOGCPzHhPqqveEyLXfngkYpUevxk 2023-11-02T09:40:49.984 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.984 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/yVCXdOqkscQTYahWtzKvAcwywOGWDniKTwPkOGCPzHhPqqveEyLXfngkYpUevxk 2023-11-02T09:40:49.984 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.984 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'PD6KgJPbrvh1blGtL/vMwg==', 'Content-Length': '3008741', 'Expect': '100-Continue'} 2023-11-02T09:40:49.984 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.985 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.985 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.985 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.985 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.985 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.986 INFO:teuthology.orchestra.run.smithi156.stderr:PD6KgJPbrvh1blGtL/vMwg== 2023-11-02T09:40:49.986 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.986 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:33:00 GMT 2023-11-02T09:40:49.987 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/yVCXdOqkscQTYahWtzKvAcwywOGWDniKTwPkOGCPzHhPqqveEyLXfngkYpUevxk 2023-11-02T09:40:49.987 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.987 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:qzHI27YjWcTjV/587kLZel3FOp4= 2023-11-02T09:40:49.987 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'PD6KgJPbrvh1blGtL/vMwg==', 'Content-Length': '3008741', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:33:00 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:qzHI27YjWcTjV/587kLZel3FOp4='} 2023-11-02T09:40:49.987 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/CjaBkhwIRRpIXiqsQtjjluGXpipJkOtfLBmVNHwHMdoWTNqkaRYSAeveTBIIVDo 2023-11-02T09:40:49.988 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/CjaBkhwIRRpIXiqsQtjjluGXpipJkOtfLBmVNHwHMdoWTNqkaRYSAeveTBIIVDo 2023-11-02T09:40:49.988 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.988 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/CjaBkhwIRRpIXiqsQtjjluGXpipJkOtfLBmVNHwHMdoWTNqkaRYSAeveTBIIVDo 2023-11-02T09:40:49.988 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.988 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'QmDjSPWq5wwrMI0c8LbY7g==', 'Content-Length': '3009271', 'Expect': '100-Continue'} 2023-11-02T09:40:49.989 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.989 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.989 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.989 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.989 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.990 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.990 INFO:teuthology.orchestra.run.smithi156.stderr:QmDjSPWq5wwrMI0c8LbY7g== 2023-11-02T09:40:49.990 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.990 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:33:00 GMT 2023-11-02T09:40:49.990 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/CjaBkhwIRRpIXiqsQtjjluGXpipJkOtfLBmVNHwHMdoWTNqkaRYSAeveTBIIVDo 2023-11-02T09:40:49.990 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.991 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:8E9NjaGu9lhqyNXlq1KKB0PGtMc= 2023-11-02T09:40:49.991 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'QmDjSPWq5wwrMI0c8LbY7g==', 'Content-Length': '3009271', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:33:00 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:8E9NjaGu9lhqyNXlq1KKB0PGtMc='} 2023-11-02T09:40:49.991 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/hXIYTfYQKZAELMJqKFmZgtLTvQKiaDFxpNqMYIhhUEPSJXKVSPWIdIzICmhaPMH 2023-11-02T09:40:49.991 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/hXIYTfYQKZAELMJqKFmZgtLTvQKiaDFxpNqMYIhhUEPSJXKVSPWIdIzICmhaPMH 2023-11-02T09:40:49.991 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.992 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/hXIYTfYQKZAELMJqKFmZgtLTvQKiaDFxpNqMYIhhUEPSJXKVSPWIdIzICmhaPMH 2023-11-02T09:40:49.992 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.992 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'ejJ2E0crXcNtcAfd++lzVA==', 'Content-Length': '3011025', 'Expect': '100-Continue'} 2023-11-02T09:40:49.992 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.992 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.993 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.993 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.993 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.993 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.994 INFO:teuthology.orchestra.run.smithi156.stderr:ejJ2E0crXcNtcAfd++lzVA== 2023-11-02T09:40:49.994 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.994 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:33:00 GMT 2023-11-02T09:40:49.994 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/hXIYTfYQKZAELMJqKFmZgtLTvQKiaDFxpNqMYIhhUEPSJXKVSPWIdIzICmhaPMH 2023-11-02T09:40:49.994 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.995 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:ZpvbUeTdK2lZmQqHEpl3+O2B5Dc= 2023-11-02T09:40:49.995 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'ejJ2E0crXcNtcAfd++lzVA==', 'Content-Length': '3011025', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:33:00 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:ZpvbUeTdK2lZmQqHEpl3+O2B5Dc='} 2023-11-02T09:40:49.995 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/yzCCkeNIXgfLQvfSkhNMKiLYzIBmMCSXAIsDfcTrJaMbQmjNYhtxtokPRFjVpYN 2023-11-02T09:40:49.995 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/yzCCkeNIXgfLQvfSkhNMKiLYzIBmMCSXAIsDfcTrJaMbQmjNYhtxtokPRFjVpYN 2023-11-02T09:40:49.995 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:49.996 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/yzCCkeNIXgfLQvfSkhNMKiLYzIBmMCSXAIsDfcTrJaMbQmjNYhtxtokPRFjVpYN 2023-11-02T09:40:49.996 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:49.996 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'fFDoUY0uEeJmekcp68iooA==', 'Content-Length': '3008757', 'Expect': '100-Continue'} 2023-11-02T09:40:49.996 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:49.996 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:49.997 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:49.997 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:49.997 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:49.997 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:49.997 INFO:teuthology.orchestra.run.smithi156.stderr:fFDoUY0uEeJmekcp68iooA== 2023-11-02T09:40:49.997 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:49.998 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:33:00 GMT 2023-11-02T09:40:49.998 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/yzCCkeNIXgfLQvfSkhNMKiLYzIBmMCSXAIsDfcTrJaMbQmjNYhtxtokPRFjVpYN 2023-11-02T09:40:49.998 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:49.999 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:7Rx68qAfypG7yw+DKibqSwcrmTU= 2023-11-02T09:40:49.999 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'fFDoUY0uEeJmekcp68iooA==', 'Content-Length': '3008757', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:33:00 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:7Rx68qAfypG7yw+DKibqSwcrmTU='} 2023-11-02T09:40:49.999 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"9522fdf581d80e9d551d4c32e8ad6f95"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005b044806001947b0-0065436ccc-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:00 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:49.999 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/hmYfFGSdAgkTVNdFeHpwgGYDCsBEWAClIkuCqpvivQTMMAzxIPgAGiUurUJnnDf 2023-11-02T09:40:49.999 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/hmYfFGSdAgkTVNdFeHpwgGYDCsBEWAClIkuCqpvivQTMMAzxIPgAGiUurUJnnDf 2023-11-02T09:40:50.000 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.000 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/hmYfFGSdAgkTVNdFeHpwgGYDCsBEWAClIkuCqpvivQTMMAzxIPgAGiUurUJnnDf 2023-11-02T09:40:50.000 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.000 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'gHri4PJoq8VjELG5Qb39DQ==', 'Content-Length': '3009503', 'Expect': '100-Continue'} 2023-11-02T09:40:50.000 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.001 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.001 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.001 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.001 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.001 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.002 INFO:teuthology.orchestra.run.smithi156.stderr:gHri4PJoq8VjELG5Qb39DQ== 2023-11-02T09:40:50.002 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.002 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:33:00 GMT 2023-11-02T09:40:50.002 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/hmYfFGSdAgkTVNdFeHpwgGYDCsBEWAClIkuCqpvivQTMMAzxIPgAGiUurUJnnDf 2023-11-02T09:40:50.002 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.002 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:dm0Owrs2BzFVfcUc9wEYFI2vF4w= 2023-11-02T09:40:50.003 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'gHri4PJoq8VjELG5Qb39DQ==', 'Content-Length': '3009503', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:33:00 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:dm0Owrs2BzFVfcUc9wEYFI2vF4w='} 2023-11-02T09:40:50.003 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/mdGyeDhswXHcCaCnXxLFEwIFfvUGrdvTKbzAkhvmCIgtBbZgqfiOCzwimZGJXKW 2023-11-02T09:40:50.003 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/mdGyeDhswXHcCaCnXxLFEwIFfvUGrdvTKbzAkhvmCIgtBbZgqfiOCzwimZGJXKW 2023-11-02T09:40:50.003 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.003 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/mdGyeDhswXHcCaCnXxLFEwIFfvUGrdvTKbzAkhvmCIgtBbZgqfiOCzwimZGJXKW 2023-11-02T09:40:50.004 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.004 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'ayfkL48wo2+83zdrHahKIA==', 'Content-Length': '3011751', 'Expect': '100-Continue'} 2023-11-02T09:40:50.004 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.004 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.004 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.005 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:50.005 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.005 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.005 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.005 INFO:teuthology.orchestra.run.smithi156.stderr:ayfkL48wo2+83zdrHahKIA== 2023-11-02T09:40:50.005 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.006 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:33:00 GMT 2023-11-02T09:40:50.006 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/mdGyeDhswXHcCaCnXxLFEwIFfvUGrdvTKbzAkhvmCIgtBbZgqfiOCzwimZGJXKW 2023-11-02T09:40:50.006 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.006 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:8SN1H4O/UI8ZFPvfrRPOdfFZUw8= 2023-11-02T09:40:50.006 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'ayfkL48wo2+83zdrHahKIA==', 'Content-Length': '3011751', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:33:00 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:8SN1H4O/UI8ZFPvfrRPOdfFZUw8='} 2023-11-02T09:40:50.007 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"8c664380ee312fddcf9ad376766c29dc"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005c56678ae7f7747d-0065436ccc-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:00 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.007 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"55827579c9b028dc381bae5a73c6f14e"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000260dd6f314ff2592-0065436ccc-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:00 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.007 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"aaef721a1a1ed5cc7758fe9d4f05f213"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000776c947a155f1c01-0065436ccc-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:00 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.007 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"3e11bb36c3cf4da581e8594b49a9679f"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000001a1131795549d602-0065436ccc-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:00 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.008 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"4a2a0c10685fb6abda145dc4a2abd657"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005f8e3d1ee865f092-0065436ccc-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:00 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.008 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"55275994b4c0216f31e2849175369051"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000003047ac40a1dd80f6-0065436ccc-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:00 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.008 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"178fb236c47ad5ac819298bd7617e007"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000017f5c32eafebd2d0-0065436ccc-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:00 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.008 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"269f211fafaf0a3893f976a1fb7ad389"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000004fd11b389361204c-0065436ccc-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:00 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.009 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"7e0fa9d6cd6d77380468e4dab21c4c24"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000004850c26c3ad6c7fd-0065436ccc-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:00 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.009 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"f6aea1124b9c567c1f1107917ee99c1a"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000001b1125b41940a117-0065436ccc-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:00 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.009 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"481941bc39386cf06c049b52b48fe1c0"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000006ea97a9136b75aaa-0065436ccc-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:00 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.009 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"22f5d2fc9e46c4994e5f9f7f010b7d17"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000ba925d06d3eed61-0065436ccc-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:00 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.009 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"e4e5519c99c502571f4db4d9b2229663"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000009837d2eb9113e240-0065436ccc-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:00 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.010 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"76e915bf805b7cbf7c513ba8c4e71048"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000006d9a3b9d1b184b0c-0065436ccc-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:00 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.010 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"9e850caa2489309c5a0082e628552b99"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000352451fa72739bb7-0065436ccc-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:01 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.010 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"b4f5b0030335441617494128e4efea81"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000cb84ed6159e8e3ee-0065436ccc-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:01 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.011 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"9a2a0114748098a87d8c8f7aa2e3ef81"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e529d204a492bfff-0065436ccc-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:01 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.011 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"0fca352f9927e9ecf613575aa97b2789"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000009c5e2448dfca4409-0065436ccc-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:01 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.011 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"d337ecf4a8e94b37180e765a500577e5"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e0a64c6b8930d224-0065436ccc-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:01 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.011 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"7afdfc762bd35c610c31bfba41081dc4"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000006e6c36f94b6b4a21-0065436ccc-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:01 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.011 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"ee2549e86d2fff8df1b9ef85113a2d1a"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000002ea4f323e41bf17-0065436ccc-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:01 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.012 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"0607982d9cc5931e428a229e749e49c6"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a16f23ce8975b7f8-0065436ccc-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:01 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.012 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"bdab5525b0b4acb5f264a936589f9d14"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000480681e0265b8f0-0065436ccc-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:01 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.012 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"c0d551f1ca54772af3e4778e25d9da5c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ed903fcbfc5b9ac8-0065436ccc-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:01 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.012 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"ec323e7e5035c4a164b136e091e6b1cd"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000995c76f6259cef9b-0065436ccc-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:01 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.012 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"da8c0cfbc36914fb08375d3c3af9373f"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000d6002cc7f2fc3fb-0065436ccc-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:01 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.013 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"f7db9b18fa56600cfad184128485b062"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000e7ecd6113c0518e-0065436ccc-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:01 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.013 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"b4e42f41c0fccb55c31d40d03665af7e"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000001adc141761e6327e-0065436ccc-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:01 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.013 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"7fda6479658cd153073e449d276ac1e7"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000028e440089ec2dea-0065436ccc-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:01 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.013 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"24a6b44c0cad2d4ec44a14f9c73d095e"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000add694bd8e26b6c7-0065436ccc-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:01 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.013 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"e18ab0cd2d4ed782cc82fec2b9b1175a"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000248f431ce0c1a488-0065436ccc-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:01 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.014 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"029ca17fcfeeed5942e1ddba92f19e35"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000003495617ea412a34c-0065436ccc-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:01 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.014 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"fb193bccd463b0851976e3a378f60763"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000075a65c3a234a17af-0065436ccc-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:01 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.014 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"6e0e2a4e0904eeddae0e5e7d22cebae8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000009785915a25ffbaa0-0065436ccc-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:01 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.014 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a82f16037d61cb56aa0c2b14be3d589e"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005b38aaf5dddeb146-0065436ccc-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:01 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.014 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"ff7bb0806730d6ed7d00ad2e0221ded1"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000274be0552fbb032c-0065436ccc-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:01 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.015 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"f17fd94269b12782461dec821d760498"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b560291d22d8809d-0065436ccc-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:01 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.015 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"e82725b8a59a2a82946b0937974b44a9"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000050d18228122b710e-0065436ccc-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:01 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.015 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"ec597dc924d953ca843c563d8b3bed75"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000049146b8b12f088bc-0065436ccc-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:01 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.015 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"d43348d2eec64a573add3df2d9172d8f"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e21cf29eac88f762-0065436ccc-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:01 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.015 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"dddd3f56312050bd422b3bfd2da5b3f1"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ba977402f027de73-0065436ccc-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:01 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.016 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"74e6f81a33027e9890db08ca3514dc07"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000adb693e52477ae91-0065436ccc-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:01 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.016 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"deed8a78ee8a46b3627617c86812eb57"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000bf3746708f0900fe-0065436ccc-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:01 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.016 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"807ae2e0f268abc56310b1b941bdfd0d"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000273c58d6b8e81d0b-0065436ccc-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:01 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.016 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"80947944bde3fb01ed0c01963f2c84f5"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000dfa2f8ab0a5f19f5-0065436ccc-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:01 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.016 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"4260e348f5aae70c2b308d1cf0b6d8ee"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b5a7b88dd5eeca91-0065436ccc-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:01 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.017 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"27a577e29201842a8d75ca6499bb585c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000817c8815a7a4a713-0065436ccc-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:01 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.017 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"1e71f0d5aadd6d7c67433b5c5bce0130"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000c3089b8bc818b15d-0065436ccc-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:01 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.017 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"7346b819fffff2b6f7694525c840c5ab"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d7bc1e261fd196c2-0065436ccc-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:01 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.017 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"7a327613472b5dc36d7007ddfbe97354"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000003eedaeb0d119d602-0065436ccc-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:01 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.017 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"7c50e8518d2e11e2667a4729ebc8a8a0"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000002b131bdabac78c23-0065436ccc-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:01 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.018 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"3c3e8a8093dbaef8756e51ad2ffbccc2"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000684da6156270b5f2-0065436ccc-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:01 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.018 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"6b27e42f8f30a36fbcdf376b1da84a20"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000092c5215d4d105c5-0065436ccc-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:01 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.018 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"2c6d4d62abac00875ae2b03a41223f55"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e93230159720a80c-0065436ccc-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:33:01 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.018 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Received heartbeat frame 2023-11-02T09:40:50.019 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Recv would block on 2023-11-02T09:40:50.019 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Sending heartbeat frame 2023-11-02T09:40:50.019 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Sending heartbeat frame 2023-11-02T09:40:50.019 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.set_writer(19, >) 2023-11-02T09:40:50.019 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: set_writer(19, _) updated handler RdWr 2023-11-02T09:40:50.020 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned on writability watcher: 2023-11-02T09:40:50.020 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: call_later: added timeout with deadline=970.900262405 and callback=>; now=940.900262405; delay=30.0 2023-11-02T09:40:50.020 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.remove_writer(19) 2023-11-02T09:40:50.020 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: remove_writer(19) updated handler Rd 2023-11-02T09:40:50.020 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned off writability watcher: 2023-11-02T09:40:50.021 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Received heartbeat frame 2023-11-02T09:40:50.021 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Recv would block on 2023-11-02T09:40:50.021 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Sending heartbeat frame 2023-11-02T09:40:50.021 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Sending heartbeat frame 2023-11-02T09:40:50.021 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.set_writer(20, >) 2023-11-02T09:40:50.022 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: set_writer(20, _) updated handler RdWr 2023-11-02T09:40:50.022 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned on writability watcher: 2023-11-02T09:40:50.022 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: call_later: added timeout with deadline=993.353741385 and callback=>; now=963.353741385; delay=30.0 2023-11-02T09:40:50.022 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.remove_writer(20) 2023-11-02T09:40:50.022 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: remove_writer(20) updated handler Rd 2023-11-02T09:40:50.023 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned off writability watcher: 2023-11-02T09:40:50.023 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Received heartbeat frame 2023-11-02T09:40:50.023 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Recv would block on 2023-11-02T09:40:50.023 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Sending heartbeat frame 2023-11-02T09:40:50.023 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Sending heartbeat frame 2023-11-02T09:40:50.024 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.set_writer(19, >) 2023-11-02T09:40:50.024 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: set_writer(19, _) updated handler RdWr 2023-11-02T09:40:50.024 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned on writability watcher: 2023-11-02T09:40:50.024 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: call_later: added timeout with deadline=1000.901222768 and callback=>; now=970.901222768; delay=30.0 2023-11-02T09:40:50.024 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.remove_writer(19) 2023-11-02T09:40:50.024 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: remove_writer(19) updated handler Rd 2023-11-02T09:40:50.025 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned off writability watcher: 2023-11-02T09:40:50.025 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Received 3 heartbeat frames, sent 4, idle intervals 0 2023-11-02T09:40:50.025 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: call_later: added timeout with deadline=1045.9059900060001 and callback=>; now=980.905990006; delay=65 2023-11-02T09:40:50.025 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Received heartbeat frame 2023-11-02T09:40:50.025 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Recv would block on 2023-11-02T09:40:50.026 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Sending heartbeat frame 2023-11-02T09:40:50.026 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Sending heartbeat frame 2023-11-02T09:40:50.026 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.set_writer(20, >) 2023-11-02T09:40:50.026 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: set_writer(20, _) updated handler RdWr 2023-11-02T09:40:50.026 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned on writability watcher: 2023-11-02T09:40:50.027 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: call_later: added timeout with deadline=1023.354812379 and callback=>; now=993.354812379; delay=30.0 2023-11-02T09:40:50.027 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.remove_writer(20) 2023-11-02T09:40:50.027 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: remove_writer(20) updated handler Rd 2023-11-02T09:40:50.027 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned off writability watcher: 2023-11-02T09:40:50.027 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Received 2 heartbeat frames, sent 2, idle intervals 0 2023-11-02T09:40:50.028 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: call_later: added timeout with deadline=1063.3573562269999 and callback=>; now=998.357356227; delay=65 2023-11-02T09:40:50.028 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Received heartbeat frame 2023-11-02T09:40:50.028 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Recv would block on 2023-11-02T09:40:50.028 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Sending heartbeat frame 2023-11-02T09:40:50.028 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Sending heartbeat frame 2023-11-02T09:40:50.029 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.set_writer(19, >) 2023-11-02T09:40:50.029 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: set_writer(19, _) updated handler RdWr 2023-11-02T09:40:50.029 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned on writability watcher: 2023-11-02T09:40:50.029 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: call_later: added timeout with deadline=1030.902209943 and callback=>; now=1000.902209943; delay=30.0 2023-11-02T09:40:50.029 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.remove_writer(19) 2023-11-02T09:40:50.030 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: remove_writer(19) updated handler Rd 2023-11-02T09:40:50.030 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned off writability watcher: 2023-11-02T09:40:50.030 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: encountered timeout exception, reconnecting 2023-11-02T09:40:50.030 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:50.030 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.031 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.031 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.031 INFO:teuthology.orchestra.run.smithi156.stderr:16yXh6S4j5/DTrx599LHmw== 2023-11-02T09:40:50.031 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.031 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:59 GMT 2023-11-02T09:40:50.032 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/eGUsvoBtYJSqxUeCvhsqBzylTgymgvykZCGhaGcEyDzbdOQEcKXiVLmzXTuNcoF 2023-11-02T09:40:50.032 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.032 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:dHJ8EI4RYw3w5DL37kBD8Cwc5SU= 2023-11-02T09:40:50.032 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '16yXh6S4j5/DTrx599LHmw==', 'Content-Length': '3011426', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:32:59 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:dHJ8EI4RYw3w5DL37kBD8Cwc5SU='} 2023-11-02T09:40:50.032 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Received heartbeat frame 2023-11-02T09:40:50.033 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Recv would block on 2023-11-02T09:40:50.033 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Sending heartbeat frame 2023-11-02T09:40:50.033 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Sending heartbeat frame 2023-11-02T09:40:50.033 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.set_writer(20, >) 2023-11-02T09:40:50.034 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: set_writer(20, _) updated handler RdWr 2023-11-02T09:40:50.034 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned on writability watcher: 2023-11-02T09:40:50.034 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: call_later: added timeout with deadline=1053.355917283 and callback=>; now=1023.355917283; delay=30.0 2023-11-02T09:40:50.035 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.remove_writer(20) 2023-11-02T09:40:50.035 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: remove_writer(20) updated handler Rd 2023-11-02T09:40:50.035 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned off writability watcher: 2023-11-02T09:40:50.035 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Received heartbeat frame 2023-11-02T09:40:50.035 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Recv would block on 2023-11-02T09:40:50.036 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Sending heartbeat frame 2023-11-02T09:40:50.036 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Sending heartbeat frame 2023-11-02T09:40:50.036 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.set_writer(19, >) 2023-11-02T09:40:50.036 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: set_writer(19, _) updated handler RdWr 2023-11-02T09:40:50.036 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned on writability watcher: 2023-11-02T09:40:50.037 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: call_later: added timeout with deadline=1060.90311587 and callback=>; now=1030.90311587; delay=30.0 2023-11-02T09:40:50.037 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.remove_writer(19) 2023-11-02T09:40:50.037 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: remove_writer(19) updated handler Rd 2023-11-02T09:40:50.037 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned off writability watcher: 2023-11-02T09:40:50.037 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Received 5 heartbeat frames, sent 6, idle intervals 0 2023-11-02T09:40:50.037 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: call_later: added timeout with deadline=1110.911668535 and callback=>; now=1045.911668535; delay=65 2023-11-02T09:40:50.038 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Received heartbeat frame 2023-11-02T09:40:50.038 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Recv would block on 2023-11-02T09:40:50.038 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Sending heartbeat frame 2023-11-02T09:40:50.038 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Sending heartbeat frame 2023-11-02T09:40:50.038 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.set_writer(20, >) 2023-11-02T09:40:50.039 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: set_writer(20, _) updated handler RdWr 2023-11-02T09:40:50.039 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned on writability watcher: 2023-11-02T09:40:50.039 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: call_later: added timeout with deadline=1083.356934538 and callback=>; now=1053.356934538; delay=30.0 2023-11-02T09:40:50.039 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.remove_writer(20) 2023-11-02T09:40:50.039 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: remove_writer(20) updated handler Rd 2023-11-02T09:40:50.040 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned off writability watcher: 2023-11-02T09:40:50.040 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Received heartbeat frame 2023-11-02T09:40:50.040 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Recv would block on 2023-11-02T09:40:50.040 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Sending heartbeat frame 2023-11-02T09:40:50.040 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Sending heartbeat frame 2023-11-02T09:40:50.041 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.set_writer(19, >) 2023-11-02T09:40:50.041 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: set_writer(19, _) updated handler RdWr 2023-11-02T09:40:50.041 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned on writability watcher: 2023-11-02T09:40:50.041 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: call_later: added timeout with deadline=1090.90411143 and callback=>; now=1060.90411143; delay=30.0 2023-11-02T09:40:50.041 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.remove_writer(19) 2023-11-02T09:40:50.042 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: remove_writer(19) updated handler Rd 2023-11-02T09:40:50.042 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned off writability watcher: 2023-11-02T09:40:50.042 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Received 4 heartbeat frames, sent 4, idle intervals 0 2023-11-02T09:40:50.043 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: call_later: added timeout with deadline=1128.363478021 and callback=>; now=1063.363478021; delay=65 2023-11-02T09:40:50.043 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: encountered timeout exception, reconnecting 2023-11-02T09:40:50.043 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:50.043 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.043 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.044 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.044 INFO:teuthology.orchestra.run.smithi156.stderr:16yXh6S4j5/DTrx599LHmw== 2023-11-02T09:40:50.044 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.044 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:59 GMT 2023-11-02T09:40:50.044 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/eGUsvoBtYJSqxUeCvhsqBzylTgymgvykZCGhaGcEyDzbdOQEcKXiVLmzXTuNcoF 2023-11-02T09:40:50.044 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.045 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:dHJ8EI4RYw3w5DL37kBD8Cwc5SU= 2023-11-02T09:40:50.045 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '16yXh6S4j5/DTrx599LHmw==', 'Content-Length': '3011426', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:32:59 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:dHJ8EI4RYw3w5DL37kBD8Cwc5SU='} 2023-11-02T09:40:50.045 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Received heartbeat frame 2023-11-02T09:40:50.045 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Recv would block on 2023-11-02T09:40:50.045 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Sending heartbeat frame 2023-11-02T09:40:50.046 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Sending heartbeat frame 2023-11-02T09:40:50.046 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.set_writer(20, >) 2023-11-02T09:40:50.046 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: set_writer(20, _) updated handler RdWr 2023-11-02T09:40:50.046 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned on writability watcher: 2023-11-02T09:40:50.046 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: call_later: added timeout with deadline=1113.357787903 and callback=>; now=1083.357787903; delay=30.0 2023-11-02T09:40:50.047 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.remove_writer(20) 2023-11-02T09:40:50.047 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: remove_writer(20) updated handler Rd 2023-11-02T09:40:50.047 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned off writability watcher: 2023-11-02T09:40:50.047 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Received heartbeat frame 2023-11-02T09:40:50.047 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Recv would block on 2023-11-02T09:40:50.048 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Sending heartbeat frame 2023-11-02T09:40:50.048 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Sending heartbeat frame 2023-11-02T09:40:50.048 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.set_writer(19, >) 2023-11-02T09:40:50.048 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: set_writer(19, _) updated handler RdWr 2023-11-02T09:40:50.048 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned on writability watcher: 2023-11-02T09:40:50.048 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: call_later: added timeout with deadline=1120.905152406 and callback=>; now=1090.905152406; delay=30.0 2023-11-02T09:40:50.049 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.remove_writer(19) 2023-11-02T09:40:50.049 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: remove_writer(19) updated handler Rd 2023-11-02T09:40:50.049 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned off writability watcher: 2023-11-02T09:40:50.049 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Received 7 heartbeat frames, sent 8, idle intervals 0 2023-11-02T09:40:50.049 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: call_later: added timeout with deadline=1175.917219933 and callback=>; now=1110.917219933; delay=65 2023-11-02T09:40:50.050 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Received heartbeat frame 2023-11-02T09:40:50.050 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Recv would block on 2023-11-02T09:40:50.051 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Sending heartbeat frame 2023-11-02T09:40:50.051 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Sending heartbeat frame 2023-11-02T09:40:50.051 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.set_writer(20, >) 2023-11-02T09:40:50.051 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: set_writer(20, _) updated handler RdWr 2023-11-02T09:40:50.051 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned on writability watcher: 2023-11-02T09:40:50.052 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: call_later: added timeout with deadline=1143.358797539 and callback=>; now=1113.358797539; delay=30.0 2023-11-02T09:40:50.052 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.remove_writer(20) 2023-11-02T09:40:50.052 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: remove_writer(20) updated handler Rd 2023-11-02T09:40:50.052 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned off writability watcher: 2023-11-02T09:40:50.052 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Received heartbeat frame 2023-11-02T09:40:50.053 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Recv would block on 2023-11-02T09:40:50.053 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Sending heartbeat frame 2023-11-02T09:40:50.053 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Sending heartbeat frame 2023-11-02T09:40:50.053 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.set_writer(19, >) 2023-11-02T09:40:50.053 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: set_writer(19, _) updated handler RdWr 2023-11-02T09:40:50.054 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned on writability watcher: 2023-11-02T09:40:50.054 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: call_later: added timeout with deadline=1150.906136072 and callback=>; now=1120.906136072; delay=30.0 2023-11-02T09:40:50.054 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.remove_writer(19) 2023-11-02T09:40:50.054 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: remove_writer(19) updated handler Rd 2023-11-02T09:40:50.054 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned off writability watcher: 2023-11-02T09:40:50.055 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Received 6 heartbeat frames, sent 6, idle intervals 0 2023-11-02T09:40:50.055 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: call_later: added timeout with deadline=1193.369682553 and callback=>; now=1128.369682553; delay=65 2023-11-02T09:40:50.055 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Received heartbeat frame 2023-11-02T09:40:50.055 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Recv would block on 2023-11-02T09:40:50.055 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Sending heartbeat frame 2023-11-02T09:40:50.056 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Sending heartbeat frame 2023-11-02T09:40:50.056 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.set_writer(20, >) 2023-11-02T09:40:50.056 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: set_writer(20, _) updated handler RdWr 2023-11-02T09:40:50.056 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned on writability watcher: 2023-11-02T09:40:50.056 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: call_later: added timeout with deadline=1173.359925271 and callback=>; now=1143.359925271; delay=30.0 2023-11-02T09:40:50.057 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.remove_writer(20) 2023-11-02T09:40:50.057 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: remove_writer(20) updated handler Rd 2023-11-02T09:40:50.057 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned off writability watcher: 2023-11-02T09:40:50.057 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: encountered timeout exception, reconnecting 2023-11-02T09:40:50.058 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:50.058 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.058 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.058 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.058 INFO:teuthology.orchestra.run.smithi156.stderr:16yXh6S4j5/DTrx599LHmw== 2023-11-02T09:40:50.059 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.059 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:59 GMT 2023-11-02T09:40:50.059 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/eGUsvoBtYJSqxUeCvhsqBzylTgymgvykZCGhaGcEyDzbdOQEcKXiVLmzXTuNcoF 2023-11-02T09:40:50.059 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.059 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:dHJ8EI4RYw3w5DL37kBD8Cwc5SU= 2023-11-02T09:40:50.060 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '16yXh6S4j5/DTrx599LHmw==', 'Content-Length': '3011426', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:32:59 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:dHJ8EI4RYw3w5DL37kBD8Cwc5SU='} 2023-11-02T09:40:50.060 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Received heartbeat frame 2023-11-02T09:40:50.060 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Recv would block on 2023-11-02T09:40:50.060 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Sending heartbeat frame 2023-11-02T09:40:50.060 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Sending heartbeat frame 2023-11-02T09:40:50.061 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.set_writer(19, >) 2023-11-02T09:40:50.061 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: set_writer(19, _) updated handler RdWr 2023-11-02T09:40:50.061 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned on writability watcher: 2023-11-02T09:40:50.061 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: call_later: added timeout with deadline=1180.907052342 and callback=>; now=1150.907052342; delay=30.0 2023-11-02T09:40:50.061 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.remove_writer(19) 2023-11-02T09:40:50.062 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: remove_writer(19) updated handler Rd 2023-11-02T09:40:50.062 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned off writability watcher: 2023-11-02T09:40:50.062 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Received heartbeat frame 2023-11-02T09:40:50.062 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Recv would block on 2023-11-02T09:40:50.062 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Sending heartbeat frame 2023-11-02T09:40:50.063 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Sending heartbeat frame 2023-11-02T09:40:50.063 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.set_writer(20, >) 2023-11-02T09:40:50.063 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: set_writer(20, _) updated handler RdWr 2023-11-02T09:40:50.063 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned on writability watcher: 2023-11-02T09:40:50.063 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: call_later: added timeout with deadline=1203.360929839 and callback=>; now=1173.360929839; delay=30.0 2023-11-02T09:40:50.063 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.remove_writer(20) 2023-11-02T09:40:50.064 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: remove_writer(20) updated handler Rd 2023-11-02T09:40:50.064 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned off writability watcher: 2023-11-02T09:40:50.064 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Received 9 heartbeat frames, sent 10, idle intervals 0 2023-11-02T09:40:50.064 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: call_later: added timeout with deadline=1240.92282423 and callback=>; now=1175.92282423; delay=65 2023-11-02T09:40:50.064 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Received heartbeat frame 2023-11-02T09:40:50.065 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Recv would block on 2023-11-02T09:40:50.065 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Sending heartbeat frame 2023-11-02T09:40:50.065 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Sending heartbeat frame 2023-11-02T09:40:50.065 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.set_writer(19, >) 2023-11-02T09:40:50.065 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: set_writer(19, _) updated handler RdWr 2023-11-02T09:40:50.066 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned on writability watcher: 2023-11-02T09:40:50.066 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: call_later: added timeout with deadline=1210.90823765 and callback=>; now=1180.90823765; delay=30.0 2023-11-02T09:40:50.066 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.remove_writer(19) 2023-11-02T09:40:50.066 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: remove_writer(19) updated handler Rd 2023-11-02T09:40:50.066 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned off writability watcher: 2023-11-02T09:40:50.067 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Received 8 heartbeat frames, sent 8, idle intervals 0 2023-11-02T09:40:50.067 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: call_later: added timeout with deadline=1258.37603345 and callback=>; now=1193.37603345; delay=65 2023-11-02T09:40:50.067 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Received heartbeat frame 2023-11-02T09:40:50.067 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Recv would block on 2023-11-02T09:40:50.067 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Sending heartbeat frame 2023-11-02T09:40:50.068 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Sending heartbeat frame 2023-11-02T09:40:50.068 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.set_writer(20, >) 2023-11-02T09:40:50.068 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: set_writer(20, _) updated handler RdWr 2023-11-02T09:40:50.068 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned on writability watcher: 2023-11-02T09:40:50.068 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: call_later: added timeout with deadline=1233.361878222 and callback=>; now=1203.361878222; delay=30.0 2023-11-02T09:40:50.069 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.remove_writer(20) 2023-11-02T09:40:50.069 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: remove_writer(20) updated handler Rd 2023-11-02T09:40:50.069 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned off writability watcher: 2023-11-02T09:40:50.069 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Received heartbeat frame 2023-11-02T09:40:50.069 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Recv would block on 2023-11-02T09:40:50.070 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Sending heartbeat frame 2023-11-02T09:40:50.070 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Sending heartbeat frame 2023-11-02T09:40:50.070 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.set_writer(19, >) 2023-11-02T09:40:50.071 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: set_writer(19, _) updated handler RdWr 2023-11-02T09:40:50.071 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned on writability watcher: 2023-11-02T09:40:50.071 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: call_later: added timeout with deadline=1240.909192983 and callback=>; now=1210.909192983; delay=30.0 2023-11-02T09:40:50.071 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.remove_writer(19) 2023-11-02T09:40:50.071 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: remove_writer(19) updated handler Rd 2023-11-02T09:40:50.071 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned off writability watcher: 2023-11-02T09:40:50.072 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: encountered timeout exception, reconnecting 2023-11-02T09:40:50.072 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:50.072 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.072 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.072 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.073 INFO:teuthology.orchestra.run.smithi156.stderr:16yXh6S4j5/DTrx599LHmw== 2023-11-02T09:40:50.073 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.073 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:59 GMT 2023-11-02T09:40:50.073 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/eGUsvoBtYJSqxUeCvhsqBzylTgymgvykZCGhaGcEyDzbdOQEcKXiVLmzXTuNcoF 2023-11-02T09:40:50.073 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.074 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:dHJ8EI4RYw3w5DL37kBD8Cwc5SU= 2023-11-02T09:40:50.074 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '16yXh6S4j5/DTrx599LHmw==', 'Content-Length': '3011426', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:32:59 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:dHJ8EI4RYw3w5DL37kBD8Cwc5SU='} 2023-11-02T09:40:50.074 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Received heartbeat frame 2023-11-02T09:40:50.075 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Recv would block on 2023-11-02T09:40:50.075 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Sending heartbeat frame 2023-11-02T09:40:50.075 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Sending heartbeat frame 2023-11-02T09:40:50.075 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.set_writer(20, >) 2023-11-02T09:40:50.075 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: set_writer(20, _) updated handler RdWr 2023-11-02T09:40:50.076 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned on writability watcher: 2023-11-02T09:40:50.076 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: call_later: added timeout with deadline=1263.362975974 and callback=>; now=1233.362975974; delay=30.0 2023-11-02T09:40:50.076 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.remove_writer(20) 2023-11-02T09:40:50.076 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: remove_writer(20) updated handler Rd 2023-11-02T09:40:50.076 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned off writability watcher: 2023-11-02T09:40:50.077 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Received heartbeat frame 2023-11-02T09:40:50.077 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Recv would block on 2023-11-02T09:40:50.077 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Sending heartbeat frame 2023-11-02T09:40:50.077 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Sending heartbeat frame 2023-11-02T09:40:50.077 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.set_writer(19, >) 2023-11-02T09:40:50.077 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: set_writer(19, _) updated handler RdWr 2023-11-02T09:40:50.078 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned on writability watcher: 2023-11-02T09:40:50.078 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: call_later: added timeout with deadline=1270.910024523 and callback=>; now=1240.910024523; delay=30.0 2023-11-02T09:40:50.078 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.remove_writer(19) 2023-11-02T09:40:50.078 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: remove_writer(19) updated handler Rd 2023-11-02T09:40:50.079 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned off writability watcher: 2023-11-02T09:40:50.079 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Received 12 heartbeat frames, sent 13, idle intervals 0 2023-11-02T09:40:50.079 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: call_later: added timeout with deadline=1305.923568703 and callback=>; now=1240.923568703; delay=65 2023-11-02T09:40:50.079 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Received 10 heartbeat frames, sent 10, idle intervals 0 2023-11-02T09:40:50.080 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: call_later: added timeout with deadline=1323.381948324 and callback=>; now=1258.381948324; delay=65 2023-11-02T09:40:50.080 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Received heartbeat frame 2023-11-02T09:40:50.080 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Recv would block on 2023-11-02T09:40:50.080 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Sending heartbeat frame 2023-11-02T09:40:50.080 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Sending heartbeat frame 2023-11-02T09:40:50.081 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.set_writer(20, >) 2023-11-02T09:40:50.081 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: set_writer(20, _) updated handler RdWr 2023-11-02T09:40:50.081 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned on writability watcher: 2023-11-02T09:40:50.081 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: call_later: added timeout with deadline=1293.363795688 and callback=>; now=1263.363795688; delay=30.0 2023-11-02T09:40:50.081 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.remove_writer(20) 2023-11-02T09:40:50.082 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: remove_writer(20) updated handler Rd 2023-11-02T09:40:50.082 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned off writability watcher: 2023-11-02T09:40:50.082 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Received heartbeat frame 2023-11-02T09:40:50.082 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Recv would block on 2023-11-02T09:40:50.082 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Sending heartbeat frame 2023-11-02T09:40:50.083 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Sending heartbeat frame 2023-11-02T09:40:50.083 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.set_writer(19, >) 2023-11-02T09:40:50.083 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: set_writer(19, _) updated handler RdWr 2023-11-02T09:40:50.083 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned on writability watcher: 2023-11-02T09:40:50.083 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: call_later: added timeout with deadline=1300.911118955 and callback=>; now=1270.911118955; delay=30.0 2023-11-02T09:40:50.084 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.remove_writer(19) 2023-11-02T09:40:50.084 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: remove_writer(19) updated handler Rd 2023-11-02T09:40:50.084 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned off writability watcher: 2023-11-02T09:40:50.084 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: encountered timeout exception, reconnecting 2023-11-02T09:40:50.084 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:50.084 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Received heartbeat frame 2023-11-02T09:40:50.085 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Recv would block on 2023-11-02T09:40:50.085 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Sending heartbeat frame 2023-11-02T09:40:50.085 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Sending heartbeat frame 2023-11-02T09:40:50.085 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.set_writer(20, >) 2023-11-02T09:40:50.085 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: set_writer(20, _) updated handler RdWr 2023-11-02T09:40:50.086 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned on writability watcher: 2023-11-02T09:40:50.086 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: call_later: added timeout with deadline=1323.364699229 and callback=>; now=1293.364699229; delay=30.0 2023-11-02T09:40:50.086 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.remove_writer(20) 2023-11-02T09:40:50.086 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: remove_writer(20) updated handler Rd 2023-11-02T09:40:50.087 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned off writability watcher: 2023-11-02T09:40:50.087 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Received heartbeat frame 2023-11-02T09:40:50.087 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Recv would block on 2023-11-02T09:40:50.087 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Sending heartbeat frame 2023-11-02T09:40:50.088 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Sending heartbeat frame 2023-11-02T09:40:50.088 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.set_writer(19, >) 2023-11-02T09:40:50.088 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: set_writer(19, _) updated handler RdWr 2023-11-02T09:40:50.088 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned on writability watcher: 2023-11-02T09:40:50.088 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: call_later: added timeout with deadline=1330.911991021 and callback=>; now=1300.911991021; delay=30.0 2023-11-02T09:40:50.088 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.remove_writer(19) 2023-11-02T09:40:50.089 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: remove_writer(19) updated handler Rd 2023-11-02T09:40:50.089 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned off writability watcher: 2023-11-02T09:40:50.089 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.089 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.089 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.090 INFO:teuthology.orchestra.run.smithi156.stderr:16yXh6S4j5/DTrx599LHmw== 2023-11-02T09:40:50.090 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.090 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:59 GMT 2023-11-02T09:40:50.090 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/eGUsvoBtYJSqxUeCvhsqBzylTgymgvykZCGhaGcEyDzbdOQEcKXiVLmzXTuNcoF 2023-11-02T09:40:50.090 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.091 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:dHJ8EI4RYw3w5DL37kBD8Cwc5SU= 2023-11-02T09:40:50.091 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '16yXh6S4j5/DTrx599LHmw==', 'Content-Length': '3011426', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:32:59 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:dHJ8EI4RYw3w5DL37kBD8Cwc5SU='} 2023-11-02T09:40:50.091 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Received 14 heartbeat frames, sent 15, idle intervals 0 2023-11-02T09:40:50.091 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: call_later: added timeout with deadline=1370.924759121 and callback=>; now=1305.924759121; delay=65 2023-11-02T09:40:50.091 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: encountered ConnectionResetError exception, reconnecting 2023-11-02T09:40:50.092 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:50.092 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Received heartbeat frame 2023-11-02T09:40:50.092 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Recv would block on 2023-11-02T09:40:50.093 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Sending heartbeat frame 2023-11-02T09:40:50.093 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Sending heartbeat frame 2023-11-02T09:40:50.093 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.set_writer(20, >) 2023-11-02T09:40:50.093 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: set_writer(20, _) updated handler RdWr 2023-11-02T09:40:50.093 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned on writability watcher: 2023-11-02T09:40:50.094 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: call_later: added timeout with deadline=1353.365988118 and callback=>; now=1323.365988118; delay=30.0 2023-11-02T09:40:50.094 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.remove_writer(20) 2023-11-02T09:40:50.094 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: remove_writer(20) updated handler Rd 2023-11-02T09:40:50.094 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned off writability watcher: 2023-11-02T09:40:50.094 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Received 13 heartbeat frames, sent 13, idle intervals 0 2023-11-02T09:40:50.095 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: call_later: added timeout with deadline=1388.382536895 and callback=>; now=1323.382536895; delay=65 2023-11-02T09:40:50.095 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.095 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.095 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.095 INFO:teuthology.orchestra.run.smithi156.stderr:16yXh6S4j5/DTrx599LHmw== 2023-11-02T09:40:50.095 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.096 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:59 GMT 2023-11-02T09:40:50.096 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/eGUsvoBtYJSqxUeCvhsqBzylTgymgvykZCGhaGcEyDzbdOQEcKXiVLmzXTuNcoF 2023-11-02T09:40:50.096 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.096 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:dHJ8EI4RYw3w5DL37kBD8Cwc5SU= 2023-11-02T09:40:50.096 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '16yXh6S4j5/DTrx599LHmw==', 'Content-Length': '3011426', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:32:59 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:dHJ8EI4RYw3w5DL37kBD8Cwc5SU='} 2023-11-02T09:40:50.097 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: encountered ConnectionRefusedError exception, reconnecting 2023-11-02T09:40:50.097 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:50.097 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Received heartbeat frame 2023-11-02T09:40:50.097 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Recv would block on 2023-11-02T09:40:50.097 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Sending heartbeat frame 2023-11-02T09:40:50.098 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Sending heartbeat frame 2023-11-02T09:40:50.098 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.set_writer(19, >) 2023-11-02T09:40:50.098 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: set_writer(19, _) updated handler RdWr 2023-11-02T09:40:50.098 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned on writability watcher: 2023-11-02T09:40:50.098 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: call_later: added timeout with deadline=1360.913162714 and callback=>; now=1330.913162714; delay=30.0 2023-11-02T09:40:50.099 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.remove_writer(19) 2023-11-02T09:40:50.099 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: remove_writer(19) updated handler Rd 2023-11-02T09:40:50.099 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned off writability watcher: 2023-11-02T09:40:50.099 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-12/ 2023-11-02T09:40:50.099 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-12/ 2023-11-02T09:40:50.099 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: GET 2023-11-02T09:40:50.100 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-12/ 2023-11-02T09:40:50.100 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.100 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:50.100 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.100 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.101 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.101 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:50.101 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.101 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.101 INFO:teuthology.orchestra.run.smithi156.stderr:GET 2023-11-02T09:40:50.102 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.102 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.102 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:39:51 GMT 2023-11-02T09:40:50.102 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/ 2023-11-02T09:40:50.102 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.103 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:j3eIoydvXNsIQNY069bQDrxFqu8= 2023-11-02T09:40:50.103 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:39:51 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:j3eIoydvXNsIQNY069bQDrxFqu8=', 'Content-Length': '0'} 2023-11-02T09:40:50.103 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: encountered ConnectionRefusedError exception, reconnecting 2023-11-02T09:40:50.103 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:50.103 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.103 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.104 INFO:teuthology.orchestra.run.smithi156.stderr:GET 2023-11-02T09:40:50.104 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.104 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.104 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:39:51 GMT 2023-11-02T09:40:50.104 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/ 2023-11-02T09:40:50.105 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.105 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:j3eIoydvXNsIQNY069bQDrxFqu8= 2023-11-02T09:40:50.105 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:39:51 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:j3eIoydvXNsIQNY069bQDrxFqu8=', 'Content-Length': '0'} 2023-11-02T09:40:50.105 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: encountered ConnectionRefusedError exception, reconnecting 2023-11-02T09:40:50.105 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:50.106 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.106 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.106 INFO:teuthology.orchestra.run.smithi156.stderr:GET 2023-11-02T09:40:50.106 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.106 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.106 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:39:51 GMT 2023-11-02T09:40:50.107 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/ 2023-11-02T09:40:50.107 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.107 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:j3eIoydvXNsIQNY069bQDrxFqu8= 2023-11-02T09:40:50.107 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:39:51 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:j3eIoydvXNsIQNY069bQDrxFqu8=', 'Content-Length': '0'} 2023-11-02T09:40:50.107 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: encountered ConnectionRefusedError exception, reconnecting 2023-11-02T09:40:50.108 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:50.108 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.108 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.108 INFO:teuthology.orchestra.run.smithi156.stderr:GET 2023-11-02T09:40:50.108 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.109 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.109 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:39:51 GMT 2023-11-02T09:40:50.109 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/ 2023-11-02T09:40:50.109 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.109 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:j3eIoydvXNsIQNY069bQDrxFqu8= 2023-11-02T09:40:50.110 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:39:51 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:j3eIoydvXNsIQNY069bQDrxFqu8=', 'Content-Length': '0'} 2023-11-02T09:40:50.110 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: encountered ConnectionRefusedError exception, reconnecting 2023-11-02T09:40:50.110 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:50.110 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.111 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.111 INFO:teuthology.orchestra.run.smithi156.stderr:GET 2023-11-02T09:40:50.111 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.111 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.111 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:39:51 GMT 2023-11-02T09:40:50.112 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/ 2023-11-02T09:40:50.112 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.112 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:j3eIoydvXNsIQNY069bQDrxFqu8= 2023-11-02T09:40:50.112 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:39:51 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:j3eIoydvXNsIQNY069bQDrxFqu8=', 'Content-Length': '0'} 2023-11-02T09:40:50.112 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: encountered ConnectionRefusedError exception, reconnecting 2023-11-02T09:40:50.113 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:50.113 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Received heartbeat frame 2023-11-02T09:40:50.113 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Recv would block on 2023-11-02T09:40:50.113 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Sending heartbeat frame 2023-11-02T09:40:50.113 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Sending heartbeat frame 2023-11-02T09:40:50.114 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.set_writer(20, >) 2023-11-02T09:40:50.114 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: set_writer(20, _) updated handler RdWr 2023-11-02T09:40:50.114 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned on writability watcher: 2023-11-02T09:40:50.114 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: call_later: added timeout with deadline=1383.366689533 and callback=>; now=1353.366689533; delay=30.0 2023-11-02T09:40:50.114 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.remove_writer(20) 2023-11-02T09:40:50.115 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: remove_writer(20) updated handler Rd 2023-11-02T09:40:50.115 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned off writability watcher: 2023-11-02T09:40:50.115 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Received heartbeat frame 2023-11-02T09:40:50.115 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Recv would block on 2023-11-02T09:40:50.115 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Sending heartbeat frame 2023-11-02T09:40:50.116 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Sending heartbeat frame 2023-11-02T09:40:50.116 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.set_writer(19, >) 2023-11-02T09:40:50.116 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: set_writer(19, _) updated handler RdWr 2023-11-02T09:40:50.116 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned on writability watcher: 2023-11-02T09:40:50.116 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: call_later: added timeout with deadline=1390.914015678 and callback=>; now=1360.914015678; delay=30.0 2023-11-02T09:40:50.117 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.remove_writer(19) 2023-11-02T09:40:50.117 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: remove_writer(19) updated handler Rd 2023-11-02T09:40:50.117 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned off writability watcher: 2023-11-02T09:40:50.117 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.117 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.117 INFO:teuthology.orchestra.run.smithi156.stderr:GET 2023-11-02T09:40:50.118 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.118 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.118 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:39:51 GMT 2023-11-02T09:40:50.118 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/ 2023-11-02T09:40:50.118 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.119 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:j3eIoydvXNsIQNY069bQDrxFqu8= 2023-11-02T09:40:50.119 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:39:51 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:j3eIoydvXNsIQNY069bQDrxFqu8=', 'Content-Length': '0'} 2023-11-02T09:40:50.119 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: encountered ConnectionRefusedError exception, reconnecting 2023-11-02T09:40:50.119 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:50.120 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Received 16 heartbeat frames, sent 17, idle intervals 0 2023-11-02T09:40:50.120 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: call_later: added timeout with deadline=1435.925886496 and callback=>; now=1370.925886496; delay=65 2023-11-02T09:40:50.129 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.129 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.129 INFO:teuthology.orchestra.run.smithi156.stderr:GET 2023-11-02T09:40:50.129 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.130 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.130 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:39:51 GMT 2023-11-02T09:40:50.130 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-12/ 2023-11-02T09:40:50.130 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.130 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:j3eIoydvXNsIQNY069bQDrxFqu8= 2023-11-02T09:40:50.131 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:39:51 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:j3eIoydvXNsIQNY069bQDrxFqu8=', 'Content-Length': '0'} 2023-11-02T09:40:50.133 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: encountered ConnectionRefusedError exception, reconnecting 2023-11-02T09:40:50.133 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:50.133 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Received heartbeat frame 2023-11-02T09:40:50.134 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Recv would block on 2023-11-02T09:40:50.134 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Sending heartbeat frame 2023-11-02T09:40:50.134 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Sending heartbeat frame 2023-11-02T09:40:50.134 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.set_writer(20, >) 2023-11-02T09:40:50.135 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: set_writer(20, _) updated handler RdWr 2023-11-02T09:40:50.135 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned on writability watcher: 2023-11-02T09:40:50.135 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: call_later: added timeout with deadline=1413.367792266 and callback=>; now=1383.367792266; delay=30.0 2023-11-02T09:40:50.135 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.remove_writer(20) 2023-11-02T09:40:50.136 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: remove_writer(20) updated handler Rd 2023-11-02T09:40:50.136 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned off writability watcher: 2023-11-02T09:40:50.136 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Received 15 heartbeat frames, sent 15, idle intervals 0 2023-11-02T09:40:50.136 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: call_later: added timeout with deadline=1453.383482851 and callback=>; now=1388.383482851; delay=65 2023-11-02T09:40:50.136 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Received heartbeat frame 2023-11-02T09:40:50.137 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Recv would block on 2023-11-02T09:40:50.137 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Sending heartbeat frame 2023-11-02T09:40:50.137 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Sending heartbeat frame 2023-11-02T09:40:50.137 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.set_writer(19, >) 2023-11-02T09:40:50.137 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: set_writer(19, _) updated handler RdWr 2023-11-02T09:40:50.137 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned on writability watcher: 2023-11-02T09:40:50.138 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: call_later: added timeout with deadline=1420.914925189 and callback=>; now=1390.914925189; delay=30.0 2023-11-02T09:40:50.138 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.remove_writer(19) 2023-11-02T09:40:50.138 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: remove_writer(19) updated handler Rd 2023-11-02T09:40:50.138 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned off writability watcher: 2023-11-02T09:40:50.139 INFO:teuthology.orchestra.run.smithi156.stderr:--------------------- >> end captured logging << --------------------- 2023-11-02T09:40:50.139 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.139 INFO:teuthology.orchestra.run.smithi156.stderr:====================================================================== 2023-11-02T09:40:50.139 INFO:teuthology.orchestra.run.smithi156.stderr:FAIL: test pushing persistent notification amqp 2023-11-02T09:40:50.139 INFO:teuthology.orchestra.run.smithi156.stderr:---------------------------------------------------------------------- 2023-11-02T09:40:50.140 INFO:teuthology.orchestra.run.smithi156.stderr:Traceback (most recent call last): 2023-11-02T09:40:50.140 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/virtualenv/lib64/python3.9/site-packages/nose/case.py", line 198, in runTest 2023-11-02T09:40:50.140 INFO:teuthology.orchestra.run.smithi156.stderr: self.test(*self.arg) 2023-11-02T09:40:50.140 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/test_bn.py", line 3884, in test_ps_s3_persistent_notification_amqp 2023-11-02T09:40:50.140 INFO:teuthology.orchestra.run.smithi156.stderr: persistent_notification('amqp') 2023-11-02T09:40:50.141 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/test_bn.py", line 3862, in persistent_notification 2023-11-02T09:40:50.141 INFO:teuthology.orchestra.run.smithi156.stderr: receiver.verify_s3_events(keys, exact_match=exact_match, deletions=True) 2023-11-02T09:40:50.141 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/test_bn.py", line 240, in verify_s3_events 2023-11-02T09:40:50.141 INFO:teuthology.orchestra.run.smithi156.stderr: verify_s3_records_by_elements(self.events, keys, exact_match=exact_match, deletions=deletions, expected_sizes=expected_sizes) 2023-11-02T09:40:50.141 INFO:teuthology.orchestra.run.smithi156.stderr: File "/home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/test_bn.py", line 402, in verify_s3_records_by_elements 2023-11-02T09:40:50.145 INFO:teuthology.orchestra.run.smithi156.stderr: assert False, err 2023-11-02T09:40:50.145 INFO:teuthology.orchestra.run.smithi156.stderr:AssertionError: no deletion event found for key: 2023-11-02T09:40:50.145 INFO:teuthology.orchestra.run.smithi156.stderr:-------------------- >> begin captured logging << -------------------- 2023-11-02T09:40:50.146 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Using access key provided by client. 2023-11-02T09:40:50.146 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Using secret key provided by client. 2023-11-02T09:40:50.146 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/ 2023-11-02T09:40:50.146 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/ 2023-11-02T09:40:50.146 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.147 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/ 2023-11-02T09:40:50.147 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.147 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:50.147 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.147 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.148 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.148 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:50.148 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.148 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.148 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.149 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.149 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.149 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:36 GMT 2023-11-02T09:40:50.149 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/ 2023-11-02T09:40:50.149 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.150 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:pNHCAQN5i/7UhchDULUte8NMk8c= 2023-11-02T09:40:50.150 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:31:36 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:pNHCAQN5i/7UhchDULUte8NMk8c=', 'Content-Length': '0'} 2023-11-02T09:40:50.150 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx00000094517bd091edeca-0065436c78-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Content-Length', '0'), ('Date', 'Thu, 02 Nov 2023 09:31:36 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.151 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: Using EPollPoller 2023-11-02T09:40:50.151 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.base_connection: DEBUG: Created default connection workflow 2023-11-02T09:40:50.151 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.connection_workflow: DEBUG: Starting AMQP Connection workflow asynchronously. 2023-11-02T09:40:50.151 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: call_later: added timeout with deadline=850.889660036 and callback=functools.partial(>, first=True); now=850.889660036; delay=0 2023-11-02T09:40:50.152 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.connection_workflow: DEBUG: Beginning a new AMQP connection workflow cycle; attempts remaining after this: 0 2023-11-02T09:40:50.152 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: call_later: added timeout with deadline=850.88977703 and callback=>; now=850.88977703; delay=0 2023-11-02T09:40:50.152 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.connection_workflow: DEBUG: _try_next_config_async: 'localhost':5672 2023-11-02T09:40:50.152 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: add_callback_threadsafe: added callback=> 2023-11-02T09:40:50.152 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: process_timeouts: invoking callback=> 2023-11-02T09:40:50.152 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: Invoking asynchronous getaddrinfo() completion callback; host='localhost' 2023-11-02T09:40:50.153 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.connection_workflow: DEBUG: getaddrinfo returned 2 records 2023-11-02T09:40:50.153 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.connection_workflow: DEBUG: Attempting to connect using address record (, , 6, '', ('::1', 5672, 0, 0)) 2023-11-02T09:40:50.153 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.connection_workflow: INFO: Pika version 1.3.2 connecting to ('::1', 5672, 0, 0) 2023-11-02T09:40:50.154 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: add_callback_threadsafe: added callback=> 2023-11-02T09:40:50.154 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: call_later: added timeout with deadline=860.890533493 and callback=>; now=850.890533493; delay=10.0 2023-11-02T09:40:50.154 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: call_later: added timeout with deadline=865.890567787 and callback=>; now=850.890567787; delay=15.0 2023-11-02T09:40:50.155 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: process_timeouts: invoking callback=> 2023-11-02T09:40:50.155 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.set_writer(19, >) 2023-11-02T09:40:50.155 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: set_writer(19, _) added handler Wr 2023-11-02T09:40:50.155 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Connection-establishment is in progress for . 2023-11-02T09:40:50.156 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: INFO: Socket connected: 2023-11-02T09:40:50.156 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: _AsyncSocketConnector._report_completion(None); 2023-11-02T09:40:50.156 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.remove_writer(19) 2023-11-02T09:40:50.156 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: remove_writer(19) removed handler 2023-11-02T09:40:50.156 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: remove_timeout: removing timeout with deadline=860.890533493 and callback=> 2023-11-02T09:40:50.156 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.connection_workflow: DEBUG: TCP connection to broker established: . 2023-11-02T09:40:50.157 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: _AsyncStreamConnector.start(); 2023-11-02T09:40:50.157 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: add_callback_threadsafe: added callback=> 2023-11-02T09:40:50.157 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: process_timeouts: invoking callback=> 2023-11-02T09:40:50.158 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: _AsyncStreamConnector._start_async(); 2023-11-02T09:40:50.158 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: _AsyncStreamConnector._linkup() 2023-11-02T09:40:50.158 INFO:teuthology.orchestra.run.smithi156.stderr:pika.connection: DEBUG: New Connection state: CLOSED (prev=CLOSED) 2023-11-02T09:40:50.158 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Added: {'callback': >>, 'one_shot': True, 'only': None, 'arguments': None, 'calls': 1} 2023-11-02T09:40:50.158 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Added: {'callback': >>, 'one_shot': True, 'only': None, 'arguments': None, 'calls': 1} 2023-11-02T09:40:50.159 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Added: {'callback': >>, 'one_shot': False, 'only': None, 'arguments': None} 2023-11-02T09:40:50.159 INFO:teuthology.orchestra.run.smithi156.stderr:pika.connection: DEBUG: New Connection state: INIT (prev=CLOSED) 2023-11-02T09:40:50.159 INFO:teuthology.orchestra.run.smithi156.stderr:pika.connection: DEBUG: Using external connection workflow. 2023-11-02T09:40:50.159 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: _AsyncTransportBase.__init__: 2023-11-02T09:40:50.159 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.set_reader(19, >) 2023-11-02T09:40:50.160 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: set_reader(19, _) added handler Rd 2023-11-02T09:40:50.160 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: _linkup(): created transport 2023-11-02T09:40:50.160 INFO:teuthology.orchestra.run.smithi156.stderr:pika.connection: DEBUG: New Connection state: PROTOCOL (prev=INIT) 2023-11-02T09:40:50.160 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.set_writer(19, >) 2023-11-02T09:40:50.160 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: set_writer(19, _) updated handler RdWr 2023-11-02T09:40:50.161 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned on writability watcher: 2023-11-02T09:40:50.161 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: _linkup(): introduced transport to protocol ; _StreamingProtocolShim: params=> 2023-11-02T09:40:50.162 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: _AsyncStreamConnector._report_completion((, _StreamingProtocolShim: params=>)); 2023-11-02T09:40:50.164 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.connection_workflow: INFO: Streaming transport linked up: (, _StreamingProtocolShim: params=>). 2023-11-02T09:40:50.165 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Removing callback #0: {'callback': params=>>, 'one_shot': False, 'only': None, 'arguments': None} 2023-11-02T09:40:50.170 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Added: {'callback': >, 'one_shot': False, 'only': None, 'arguments': None} 2023-11-02T09:40:50.173 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Added: {'callback': >, 'one_shot': False, 'only': None, 'arguments': None} 2023-11-02T09:40:50.173 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: _AsyncStreamConnector._cleanup(False) 2023-11-02T09:40:50.173 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.remove_writer(19) 2023-11-02T09:40:50.173 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: remove_writer(19) updated handler Rd 2023-11-02T09:40:50.173 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned off writability watcher: 2023-11-02T09:40:50.174 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Processing 0:Connection.Start 2023-11-02T09:40:50.174 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Processing use of oneshot callback 2023-11-02T09:40:50.174 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: 0 registered uses left 2023-11-02T09:40:50.174 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Removing callback #0: {'callback': params=>>, 'one_shot': True, 'only': None, 'arguments': None, 'calls': 0} 2023-11-02T09:40:50.175 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Calling params=>> for "0:Connection.Start" 2023-11-02T09:40:50.175 INFO:teuthology.orchestra.run.smithi156.stderr:pika.connection: DEBUG: New Connection state: START (prev=PROTOCOL) 2023-11-02T09:40:50.175 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Added: {'callback': params=>>, 'one_shot': True, 'only': None, 'arguments': None, 'calls': 1} 2023-11-02T09:40:50.176 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.set_writer(19, >) 2023-11-02T09:40:50.176 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: set_writer(19, _) updated handler RdWr 2023-11-02T09:40:50.176 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned on writability watcher: 2023-11-02T09:40:50.176 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Recv would block on 2023-11-02T09:40:50.176 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.remove_writer(19) 2023-11-02T09:40:50.177 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: remove_writer(19) updated handler Rd 2023-11-02T09:40:50.177 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned off writability watcher: 2023-11-02T09:40:50.177 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Processing 0:Connection.Tune 2023-11-02T09:40:50.177 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Processing use of oneshot callback 2023-11-02T09:40:50.178 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: 0 registered uses left 2023-11-02T09:40:50.178 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Removing callback #0: {'callback': params=>>, 'one_shot': True, 'only': None, 'arguments': None, 'calls': 0} 2023-11-02T09:40:50.178 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Calling params=>> for "0:Connection.Tune" 2023-11-02T09:40:50.178 INFO:teuthology.orchestra.run.smithi156.stderr:pika.connection: DEBUG: New Connection state: TUNE (prev=START) 2023-11-02T09:40:50.179 INFO:teuthology.orchestra.run.smithi156.stderr:pika.connection: DEBUG: Creating a HeartbeatChecker: 60 2023-11-02T09:40:50.179 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: timeout: 60.000000 send_interval: 30.000000 check_interval: 65.000000 2023-11-02T09:40:50.180 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: call_later: added timeout with deadline=880.893948027 and callback=>; now=850.893948027; delay=30.0 2023-11-02T09:40:50.180 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: call_later: added timeout with deadline=915.894019645 and callback=>; now=850.894019645; delay=65 2023-11-02T09:40:50.181 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.set_writer(19, >) 2023-11-02T09:40:50.181 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: set_writer(19, _) updated handler RdWr 2023-11-02T09:40:50.181 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned on writability watcher: 2023-11-02T09:40:50.181 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Added: {'callback': params=>>, 'one_shot': True, 'only': None, 'arguments': None, 'calls': 1} 2023-11-02T09:40:50.182 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Recv would block on 2023-11-02T09:40:50.182 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.remove_writer(19) 2023-11-02T09:40:50.183 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: remove_writer(19) updated handler Rd 2023-11-02T09:40:50.183 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned off writability watcher: 2023-11-02T09:40:50.183 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Processing 0:Connection.OpenOk 2023-11-02T09:40:50.183 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Processing use of oneshot callback 2023-11-02T09:40:50.184 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: 0 registered uses left 2023-11-02T09:40:50.184 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Removing callback #0: {'callback': params=>>, 'one_shot': True, 'only': None, 'arguments': None, 'calls': 0} 2023-11-02T09:40:50.184 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Calling params=>> for "0:Connection.OpenOk" 2023-11-02T09:40:50.184 INFO:teuthology.orchestra.run.smithi156.stderr:pika.connection: DEBUG: New Connection state: OPEN (prev=TUNE) 2023-11-02T09:40:50.184 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Processing 0:_on_connection_open_ok 2023-11-02T09:40:50.185 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Calling > for "0:_on_connection_open_ok" 2023-11-02T09:40:50.185 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.connection_workflow: DEBUG: AMQPConnector: AMQP handshake attempt completed; state=3; error=None; 'localhost'/(, , 6, '', ('::1', 5672, 0, 0)) 2023-11-02T09:40:50.185 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.connection_workflow: DEBUG: AMQPConnector: AMQP connection established for 'localhost'/(, , 6, '', ('::1', 5672, 0, 0)): params=> 2023-11-02T09:40:50.186 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.connection_workflow: INFO: AMQPConnector - reporting success: params=> 2023-11-02T09:40:50.186 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: remove_timeout: removing timeout with deadline=865.890567787 and callback=> 2023-11-02T09:40:50.186 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.connection_workflow: DEBUG: Connection attempt completed with params=> 2023-11-02T09:40:50.186 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.connection_workflow: INFO: AMQPConnectionWorkflow - reporting success: params=> 2023-11-02T09:40:50.186 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Recv would block on 2023-11-02T09:40:50.187 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.blocking_connection: INFO: Connection workflow succeeded: params=> 2023-11-02T09:40:50.187 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Added: {'callback': >, 'one_shot': False, 'only': None, 'arguments': None} 2023-11-02T09:40:50.187 INFO:teuthology.orchestra.run.smithi156.stderr:pika.connection: DEBUG: Creating channel 1 2023-11-02T09:40:50.188 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Added: {'callback': params=>>, 'one_shot': True, 'only': params=>>, 'arguments': None, 'calls': 1} 2023-11-02T09:40:50.188 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Added: {'callback': params=>>>, 'one_shot': False, 'only': None, 'arguments': None} 2023-11-02T09:40:50.188 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Added: {'callback': params=>>>, 'one_shot': False, 'only': None, 'arguments': None} 2023-11-02T09:40:50.188 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Added: {'callback': params=>>>, 'one_shot': False, 'only': None, 'arguments': None} 2023-11-02T09:40:50.189 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Added: {'callback': params=>>>, 'one_shot': True, 'only': None, 'arguments': None, 'calls': 1} 2023-11-02T09:40:50.189 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.set_writer(19, >) 2023-11-02T09:40:50.189 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: set_writer(19, _) updated handler RdWr 2023-11-02T09:40:50.189 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned on writability watcher: 2023-11-02T09:40:50.189 INFO:teuthology.orchestra.run.smithi156.stderr:pika.channel: DEBUG: Entering blocking state on frame ; acceptable_replies=[] 2023-11-02T09:40:50.190 INFO:teuthology.orchestra.run.smithi156.stderr:pika.channel: DEBUG: Adding on_synchronous_complete callback 2023-11-02T09:40:50.190 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Added: {'callback': params=>>>, 'one_shot': True, 'only': None, 'arguments': None, 'calls': 1} 2023-11-02T09:40:50.190 INFO:teuthology.orchestra.run.smithi156.stderr:pika.channel: DEBUG: Adding passed-in RPC response callback 2023-11-02T09:40:50.190 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Added: {'callback': params=>>>, 'one_shot': True, 'only': None, 'arguments': None, 'calls': 1} 2023-11-02T09:40:50.190 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Added: {'callback': params=>>>>, 'one_shot': False, 'only': None, 'arguments': None} 2023-11-02T09:40:50.191 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Added: {'callback': >, 'one_shot': False, 'only': None, 'arguments': None} 2023-11-02T09:40:50.191 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Added: {'callback': params=>>>>, 'one_shot': False, 'only': params=>>, 'arguments': None} 2023-11-02T09:40:50.191 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Added: {'callback': >, 'one_shot': False, 'only': None, 'arguments': None} 2023-11-02T09:40:50.191 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.blocking_connection: INFO: Created channel=1 2023-11-02T09:40:50.191 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.remove_writer(19) 2023-11-02T09:40:50.192 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: remove_writer(19) updated handler Rd 2023-11-02T09:40:50.192 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned off writability watcher: 2023-11-02T09:40:50.192 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Processing 1:Channel.OpenOk 2023-11-02T09:40:50.193 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Processing use of oneshot callback 2023-11-02T09:40:50.193 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: 0 registered uses left 2023-11-02T09:40:50.193 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Removing callback #0: {'callback': params=>>>, 'one_shot': True, 'only': None, 'arguments': None, 'calls': 0} 2023-11-02T09:40:50.193 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Processing use of oneshot callback 2023-11-02T09:40:50.193 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: 0 registered uses left 2023-11-02T09:40:50.194 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Removing callback #0: {'callback': params=>>>, 'one_shot': True, 'only': None, 'arguments': None, 'calls': 0} 2023-11-02T09:40:50.194 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Calling params=>>> for "1:Channel.OpenOk" 2023-11-02T09:40:50.194 INFO:teuthology.orchestra.run.smithi156.stderr:pika.channel: DEBUG: 0 blocked frames 2023-11-02T09:40:50.194 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Calling params=>>> for "1:Channel.OpenOk" 2023-11-02T09:40:50.194 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Recv would block on 2023-11-02T09:40:50.195 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.set_writer(19, >) 2023-11-02T09:40:50.195 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: set_writer(19, _) updated handler RdWr 2023-11-02T09:40:50.195 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned on writability watcher: 2023-11-02T09:40:50.195 INFO:teuthology.orchestra.run.smithi156.stderr:pika.channel: DEBUG: Entering blocking state on frame ; acceptable_replies=[] 2023-11-02T09:40:50.196 INFO:teuthology.orchestra.run.smithi156.stderr:pika.channel: DEBUG: Adding on_synchronous_complete callback 2023-11-02T09:40:50.196 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Added: {'callback': params=>>>, 'one_shot': True, 'only': None, 'arguments': None, 'calls': 1} 2023-11-02T09:40:50.196 INFO:teuthology.orchestra.run.smithi156.stderr:pika.channel: DEBUG: Adding passed-in RPC response callback 2023-11-02T09:40:50.196 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Added: {'callback': >, 'one_shot': True, 'only': None, 'arguments': None, 'calls': 1} 2023-11-02T09:40:50.197 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.remove_writer(19) 2023-11-02T09:40:50.197 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: remove_writer(19) updated handler Rd 2023-11-02T09:40:50.197 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned off writability watcher: 2023-11-02T09:40:50.197 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Processing 1:Exchange.DeclareOk 2023-11-02T09:40:50.198 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Processing use of oneshot callback 2023-11-02T09:40:50.198 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: 0 registered uses left 2023-11-02T09:40:50.198 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Removing callback #0: {'callback': params=>>>, 'one_shot': True, 'only': None, 'arguments': None, 'calls': 0} 2023-11-02T09:40:50.198 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Processing use of oneshot callback 2023-11-02T09:40:50.198 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: 0 registered uses left 2023-11-02T09:40:50.199 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Removing callback #0: {'callback': >, 'one_shot': True, 'only': None, 'arguments': None, 'calls': 0} 2023-11-02T09:40:50.199 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Calling params=>>> for "1:Exchange.DeclareOk" 2023-11-02T09:40:50.199 INFO:teuthology.orchestra.run.smithi156.stderr:pika.channel: DEBUG: 0 blocked frames 2023-11-02T09:40:50.199 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Calling > for "1:Exchange.DeclareOk" 2023-11-02T09:40:50.199 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Recv would block on 2023-11-02T09:40:50.200 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.set_writer(19, >) 2023-11-02T09:40:50.200 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: set_writer(19, _) updated handler RdWr 2023-11-02T09:40:50.200 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned on writability watcher: 2023-11-02T09:40:50.200 INFO:teuthology.orchestra.run.smithi156.stderr:pika.channel: DEBUG: Entering blocking state on frame ; acceptable_replies=[] 2023-11-02T09:40:50.200 INFO:teuthology.orchestra.run.smithi156.stderr:pika.channel: DEBUG: Adding on_synchronous_complete callback 2023-11-02T09:40:50.201 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Added: {'callback': params=>>>, 'one_shot': True, 'only': None, 'arguments': None, 'calls': 1} 2023-11-02T09:40:50.201 INFO:teuthology.orchestra.run.smithi156.stderr:pika.channel: DEBUG: Adding passed-in RPC response callback 2023-11-02T09:40:50.201 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Added: {'callback': >, 'one_shot': True, 'only': None, 'arguments': None, 'calls': 1} 2023-11-02T09:40:50.201 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.remove_writer(19) 2023-11-02T09:40:50.201 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: remove_writer(19) updated handler Rd 2023-11-02T09:40:50.201 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned off writability watcher: 2023-11-02T09:40:50.202 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Processing 1:Queue.DeclareOk 2023-11-02T09:40:50.202 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Processing use of oneshot callback 2023-11-02T09:40:50.202 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: 0 registered uses left 2023-11-02T09:40:50.203 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Removing callback #0: {'callback': params=>>>, 'one_shot': True, 'only': None, 'arguments': None, 'calls': 0} 2023-11-02T09:40:50.203 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Processing use of oneshot callback 2023-11-02T09:40:50.203 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: 0 registered uses left 2023-11-02T09:40:50.203 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Removing callback #0: {'callback': >, 'one_shot': True, 'only': None, 'arguments': None, 'calls': 0} 2023-11-02T09:40:50.204 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Calling params=>>> for "1:Queue.DeclareOk" 2023-11-02T09:40:50.204 INFO:teuthology.orchestra.run.smithi156.stderr:pika.channel: DEBUG: 0 blocked frames 2023-11-02T09:40:50.204 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Calling > for "1:Queue.DeclareOk" 2023-11-02T09:40:50.204 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Recv would block on 2023-11-02T09:40:50.204 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.set_writer(19, >) 2023-11-02T09:40:50.205 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: set_writer(19, _) updated handler RdWr 2023-11-02T09:40:50.205 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned on writability watcher: 2023-11-02T09:40:50.205 INFO:teuthology.orchestra.run.smithi156.stderr:pika.channel: DEBUG: Entering blocking state on frame ; acceptable_replies=[] 2023-11-02T09:40:50.205 INFO:teuthology.orchestra.run.smithi156.stderr:pika.channel: DEBUG: Adding on_synchronous_complete callback 2023-11-02T09:40:50.205 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Added: {'callback': params=>>>, 'one_shot': True, 'only': None, 'arguments': None, 'calls': 1} 2023-11-02T09:40:50.206 INFO:teuthology.orchestra.run.smithi156.stderr:pika.channel: DEBUG: Adding passed-in RPC response callback 2023-11-02T09:40:50.206 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Added: {'callback': >, 'one_shot': True, 'only': None, 'arguments': None, 'calls': 1} 2023-11-02T09:40:50.206 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.remove_writer(19) 2023-11-02T09:40:50.207 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: remove_writer(19) updated handler Rd 2023-11-02T09:40:50.207 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned off writability watcher: 2023-11-02T09:40:50.207 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Processing 1:Queue.BindOk 2023-11-02T09:40:50.207 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Processing use of oneshot callback 2023-11-02T09:40:50.207 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: 0 registered uses left 2023-11-02T09:40:50.208 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Removing callback #0: {'callback': params=>>>, 'one_shot': True, 'only': None, 'arguments': None, 'calls': 0} 2023-11-02T09:40:50.208 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Processing use of oneshot callback 2023-11-02T09:40:50.208 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: 0 registered uses left 2023-11-02T09:40:50.209 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Removing callback #0: {'callback': >, 'one_shot': True, 'only': None, 'arguments': None, 'calls': 0} 2023-11-02T09:40:50.209 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Calling params=>>> for "1:Queue.BindOk" 2023-11-02T09:40:50.209 INFO:teuthology.orchestra.run.smithi156.stderr:pika.channel: DEBUG: 0 blocked frames 2023-11-02T09:40:50.209 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Calling > for "1:Queue.BindOk" 2023-11-02T09:40:50.210 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Recv would block on 2023-11-02T09:40:50.210 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.set_writer(19, >) 2023-11-02T09:40:50.210 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: set_writer(19, _) updated handler RdWr 2023-11-02T09:40:50.210 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned on writability watcher: 2023-11-02T09:40:50.210 INFO:teuthology.orchestra.run.smithi156.stderr:pika.channel: DEBUG: Entering blocking state on frame ; acceptable_replies=[(, {'consumer_tag': 'ctag1.b23b6bbceb5941a9bf8f70d096bc7037'})] 2023-11-02T09:40:50.211 INFO:teuthology.orchestra.run.smithi156.stderr:pika.channel: DEBUG: Adding on_synchronous_complete callback 2023-11-02T09:40:50.211 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Added: {'callback': params=>>>, 'one_shot': True, 'only': None, 'arguments': {'consumer_tag': 'ctag1.b23b6bbceb5941a9bf8f70d096bc7037'}, 'calls': 1} 2023-11-02T09:40:50.211 INFO:teuthology.orchestra.run.smithi156.stderr:pika.channel: DEBUG: Adding passed-in RPC response callback 2023-11-02T09:40:50.211 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Added: {'callback': params=>>>, 'one_shot': True, 'only': None, 'arguments': {'consumer_tag': 'ctag1.b23b6bbceb5941a9bf8f70d096bc7037'}, 'calls': 1} 2023-11-02T09:40:50.211 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.remove_writer(19) 2023-11-02T09:40:50.212 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: remove_writer(19) updated handler Rd 2023-11-02T09:40:50.212 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned off writability watcher: 2023-11-02T09:40:50.212 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Processing 1:Basic.ConsumeOk 2023-11-02T09:40:50.212 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Processing use of oneshot callback 2023-11-02T09:40:50.212 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: 0 registered uses left 2023-11-02T09:40:50.213 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Comparing {'consumer_tag': 'ctag1.b23b6bbceb5941a9bf8f70d096bc7037'} to {'consumer_tag': 'ctag1.b23b6bbceb5941a9bf8f70d096bc7037'} 2023-11-02T09:40:50.213 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Removing callback #1: {'callback': params=>>>, 'one_shot': True, 'only': None, 'arguments': {'consumer_tag': 'ctag1.b23b6bbceb5941a9bf8f70d096bc7037'}, 'calls': 0} 2023-11-02T09:40:50.213 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Processing use of oneshot callback 2023-11-02T09:40:50.214 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: 0 registered uses left 2023-11-02T09:40:50.214 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Comparing {'consumer_tag': 'ctag1.b23b6bbceb5941a9bf8f70d096bc7037'} to {'consumer_tag': 'ctag1.b23b6bbceb5941a9bf8f70d096bc7037'} 2023-11-02T09:40:50.214 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Removing callback #1: {'callback': params=>>>, 'one_shot': True, 'only': None, 'arguments': {'consumer_tag': 'ctag1.b23b6bbceb5941a9bf8f70d096bc7037'}, 'calls': 0} 2023-11-02T09:40:50.214 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Calling > for "1:Basic.ConsumeOk" 2023-11-02T09:40:50.214 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Calling params=>>> for "1:Basic.ConsumeOk" 2023-11-02T09:40:50.215 INFO:teuthology.orchestra.run.smithi156.stderr:pika.channel: DEBUG: 0 blocked frames 2023-11-02T09:40:50.215 INFO:teuthology.orchestra.run.smithi156.stderr:pika.callback: DEBUG: Calling params=>>> for "1:Basic.ConsumeOk" 2023-11-02T09:40:50.215 INFO:teuthology.orchestra.run.smithi156.stderr:pika.channel: DEBUG: Discarding frame "])> 2023-11-02T09:40:50.215 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Recv would block on 2023-11-02T09:40:50.215 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP receiver started 2023-11-02T09:40:50.216 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.hooks: DEBUG: Event choose-service-name: calling handler 2023-11-02T09:40:50.216 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.hooks: DEBUG: Event creating-client-class.sns: calling handler 2023-11-02T09:40:50.216 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.regions: DEBUG: Creating a regex based endpoint for sns, default 2023-11-02T09:40:50.216 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.endpoint: DEBUG: Setting sns timeout as (60, 60) 2023-11-02T09:40:50.217 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.client: DEBUG: Registering retry handlers for service: sns 2023-11-02T09:40:50.217 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.hooks: DEBUG: Event before-parameter-build.sns.CreateTopic: calling handler 2023-11-02T09:40:50.217 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.regions: DEBUG: Calling endpoint provider with parameters: {'Region': 'default', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi156.front.sepia.ceph.com:80'} 2023-11-02T09:40:50.217 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.regions: DEBUG: Endpoint provider result: http://smithi156.front.sepia.ceph.com:80 2023-11-02T09:40:50.218 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.hooks: DEBUG: Event before-call.sns.CreateTopic: calling handler 2023-11-02T09:40:50.218 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.hooks: DEBUG: Event before-call.sns.CreateTopic: calling handler 2023-11-02T09:40:50.218 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.endpoint: DEBUG: Making request for OperationModel(name=CreateTopic) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.28.76 md/Botocore#1.31.76 ua/2.0 os/linux#5.14.0-378.el9.x86_64 md/arch#x86_64 lang/python#3.9.17 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.76'}, 'body': {'Action': 'CreateTopic', 'Version': '2010-03-31', 'Name': 'uicwqr-11_topic', 'Attributes.entry.1.key': 'push-endpoint', 'Attributes.entry.1.value': 'amqp://localhost', 'Attributes.entry.2.key': 'amqp-exchange', 'Attributes.entry.2.value': 'ex1', 'Attributes.entry.3.key': 'amqp-ack-level', 'Attributes.entry.3.value': 'broker', 'Attributes.entry.4.key': 'persistent', 'Attributes.entry.4.value': 'true'}, 'url': 'http://smithi156.front.sepia.ceph.com:80/', 'context': {'client_region': 'default', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2023-11-02T09:40:50.218 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.hooks: DEBUG: Event request-created.sns.CreateTopic: calling handler > 2023-11-02T09:40:50.219 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.hooks: DEBUG: Event choose-signer.sns.CreateTopic: calling handler 2023-11-02T09:40:50.219 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.auth: DEBUG: Calculating signature using v4 auth. 2023-11-02T09:40:50.219 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.auth: DEBUG: CanonicalRequest: 2023-11-02T09:40:50.219 INFO:teuthology.orchestra.run.smithi156.stderr:POST 2023-11-02T09:40:50.219 INFO:teuthology.orchestra.run.smithi156.stderr:/ 2023-11-02T09:40:50.220 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.220 INFO:teuthology.orchestra.run.smithi156.stderr:content-type:application/x-www-form-urlencoded; charset=utf-8 2023-11-02T09:40:50.220 INFO:teuthology.orchestra.run.smithi156.stderr:host:smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.220 INFO:teuthology.orchestra.run.smithi156.stderr:x-amz-date:20231102T093136Z 2023-11-02T09:40:50.220 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.221 INFO:teuthology.orchestra.run.smithi156.stderr:content-type;host;x-amz-date 2023-11-02T09:40:50.221 INFO:teuthology.orchestra.run.smithi156.stderr:2118af5255bb07a45f9607629c42db933fdb2a5ae9950a4c4b8e74d256035a3c 2023-11-02T09:40:50.221 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.auth: DEBUG: StringToSign: 2023-11-02T09:40:50.221 INFO:teuthology.orchestra.run.smithi156.stderr:AWS4-HMAC-SHA256 2023-11-02T09:40:50.221 INFO:teuthology.orchestra.run.smithi156.stderr:20231102T093136Z 2023-11-02T09:40:50.221 INFO:teuthology.orchestra.run.smithi156.stderr:20231102/default/sns/aws4_request 2023-11-02T09:40:50.222 INFO:teuthology.orchestra.run.smithi156.stderr:89e7a093f4815af22c7b844018e9707fdee7aa1d4e2bd3c2aa070f3c4c75b46f 2023-11-02T09:40:50.222 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.auth: DEBUG: Signature: 2023-11-02T09:40:50.222 INFO:teuthology.orchestra.run.smithi156.stderr:6e8744b5861a49f7a99ceaed9c60c47a2bc2f60ae3ae3eb561c213690d0c0652 2023-11-02T09:40:50.222 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.hooks: DEBUG: Event request-created.sns.CreateTopic: calling handler 2023-11-02T09:40:50.223 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.endpoint: DEBUG: Sending http request: 2023-11-02T09:40:50.223 INFO:teuthology.orchestra.run.smithi156.stderr:urllib3.connectionpool: DEBUG: Starting new HTTP connection (1): smithi156.front.sepia.ceph.com:80 2023-11-02T09:40:50.224 INFO:teuthology.orchestra.run.smithi156.stderr:urllib3.connectionpool: DEBUG: http://smithi156.front.sepia.ceph.com:80 "POST / HTTP/1.1" 200 311 2023-11-02T09:40:50.224 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.parsers: DEBUG: Response headers: {'x-amz-request-id': 'tx00000ec9bca3e1d89f4c1-0065436c78-117b-default', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (reef)', 'Content-Length': '311', 'Date': 'Thu, 02 Nov 2023 09:31:36 GMT', 'Connection': 'Keep-Alive'} 2023-11-02T09:40:50.224 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.parsers: DEBUG: Response body: 2023-11-02T09:40:50.225 INFO:teuthology.orchestra.run.smithi156.stderr:b'arn:aws:sns:default::uicwqr-11_topic8100026f-34ce-4e78-9bac-c57f344b7c64.4475.17049443182473508033' 2023-11-02T09:40:50.225 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.hooks: DEBUG: Event needs-retry.sns.CreateTopic: calling handler 2023-11-02T09:40:50.225 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.retryhandler: DEBUG: No retry needed. 2023-11-02T09:40:50.225 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.hooks: DEBUG: Event choose-service-name: calling handler 2023-11-02T09:40:50.225 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.hooks: DEBUG: Event creating-client-class.s3: calling handler 2023-11-02T09:40:50.226 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.hooks: DEBUG: Event creating-client-class.s3: calling handler ._handler at 0x7f0477f87ee0> 2023-11-02T09:40:50.226 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.hooks: DEBUG: Event creating-client-class.s3: calling handler 2023-11-02T09:40:50.226 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.endpoint: DEBUG: Setting s3 timeout as (60, 60) 2023-11-02T09:40:50.226 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.client: DEBUG: Registering retry handlers for service: s3 2023-11-02T09:40:50.226 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.utils: DEBUG: Registering S3 region redirector handler 2023-11-02T09:40:50.227 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.hooks: DEBUG: Event before-parameter-build.s3.PutBucketNotificationConfiguration: calling handler 2023-11-02T09:40:50.227 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.hooks: DEBUG: Event before-parameter-build.s3.PutBucketNotificationConfiguration: calling handler 2023-11-02T09:40:50.227 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.hooks: DEBUG: Event before-parameter-build.s3.PutBucketNotificationConfiguration: calling handler > 2023-11-02T09:40:50.228 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.hooks: DEBUG: Event before-parameter-build.s3.PutBucketNotificationConfiguration: calling handler 2023-11-02T09:40:50.228 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.hooks: DEBUG: Event before-endpoint-resolution.s3: calling handler 2023-11-02T09:40:50.228 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.hooks: DEBUG: Event before-endpoint-resolution.s3: calling handler > 2023-11-02T09:40:50.228 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.regions: DEBUG: Calling endpoint provider with parameters: {'Bucket': 'uicwqr-11', 'Region': 'us-east-1', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://smithi156.front.sepia.ceph.com:80', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': True, 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True} 2023-11-02T09:40:50.228 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.regions: DEBUG: Endpoint provider result: http://smithi156.front.sepia.ceph.com:80/uicwqr-11 2023-11-02T09:40:50.229 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.regions: DEBUG: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None" 2023-11-02T09:40:50.229 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.regions: DEBUG: Selected auth type "v4" as "v4" with signing context params: {'region': 'us-east-1', 'signing_name': 's3', 'disableDoubleEncoding': True} 2023-11-02T09:40:50.229 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.hooks: DEBUG: Event before-call.s3.PutBucketNotificationConfiguration: calling handler 2023-11-02T09:40:50.229 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.hooks: DEBUG: Event before-call.s3.PutBucketNotificationConfiguration: calling handler 2023-11-02T09:40:50.229 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.hooks: DEBUG: Event before-call.s3.PutBucketNotificationConfiguration: calling handler 2023-11-02T09:40:50.230 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.endpoint: DEBUG: Making request for OperationModel(name=PutBucketNotificationConfiguration) with params: {'url_path': '?notification', 'query_string': {}, 'method': 'PUT', 'headers': {'User-Agent': 'Boto3/1.28.76 md/Botocore#1.31.76 ua/2.0 os/linux#5.14.0-378.el9.x86_64 md/arch#x86_64 lang/python#3.9.17 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.76'}, 'body': b'uicwqr-11_notifarn:aws:sns:default::uicwqr-11_topic', 'auth_path': '/uicwqr-11/', 'url': 'http://smithi156.front.sepia.ceph.com:80/uicwqr-11?notification', 'context': {'client_region': 'us-east-1', 'client_config': , 'has_streaming_input': False, 'auth_type': 'v4', 's3_redirect': {'redirected': False, 'bucket': 'uicwqr-11', 'params': {'Bucket': 'uicwqr-11', 'NotificationConfiguration': {'TopicConfigurations': [{'Id': 'uicwqr-11_notif', 'TopicArn': 'arn:aws:sns:default::uicwqr-11_topic', 'Events': []}]}}}, 'signing': {'region': 'us-east-1', 'signing_name': 's3', 'disableDoubleEncoding': True}}} 2023-11-02T09:40:50.230 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.hooks: DEBUG: Event request-created.s3.PutBucketNotificationConfiguration: calling handler > 2023-11-02T09:40:50.230 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.hooks: DEBUG: Event choose-signer.s3.PutBucketNotificationConfiguration: calling handler > 2023-11-02T09:40:50.230 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.hooks: DEBUG: Event choose-signer.s3.PutBucketNotificationConfiguration: calling handler 2023-11-02T09:40:50.230 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.hooks: DEBUG: Event before-sign.s3.PutBucketNotificationConfiguration: calling handler 2023-11-02T09:40:50.231 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.auth: DEBUG: Calculating signature using v4 auth. 2023-11-02T09:40:50.231 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.auth: DEBUG: CanonicalRequest: 2023-11-02T09:40:50.231 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.231 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11 2023-11-02T09:40:50.231 INFO:teuthology.orchestra.run.smithi156.stderr:notification= 2023-11-02T09:40:50.232 INFO:teuthology.orchestra.run.smithi156.stderr:host:smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.232 INFO:teuthology.orchestra.run.smithi156.stderr:x-amz-content-sha256:4a3af3deb26f793f504ca0e71a2dbf51c00de7d538c7c96e2c096ff41b3c1a23 2023-11-02T09:40:50.232 INFO:teuthology.orchestra.run.smithi156.stderr:x-amz-date:20231102T093136Z 2023-11-02T09:40:50.232 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.232 INFO:teuthology.orchestra.run.smithi156.stderr:host;x-amz-content-sha256;x-amz-date 2023-11-02T09:40:50.233 INFO:teuthology.orchestra.run.smithi156.stderr:4a3af3deb26f793f504ca0e71a2dbf51c00de7d538c7c96e2c096ff41b3c1a23 2023-11-02T09:40:50.233 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.auth: DEBUG: StringToSign: 2023-11-02T09:40:50.233 INFO:teuthology.orchestra.run.smithi156.stderr:AWS4-HMAC-SHA256 2023-11-02T09:40:50.233 INFO:teuthology.orchestra.run.smithi156.stderr:20231102T093136Z 2023-11-02T09:40:50.233 INFO:teuthology.orchestra.run.smithi156.stderr:20231102/us-east-1/s3/aws4_request 2023-11-02T09:40:50.234 INFO:teuthology.orchestra.run.smithi156.stderr:cf5fc082108eb5894e1f7258eb582cdf7cf3015182906cc5d4da208e464bb103 2023-11-02T09:40:50.234 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.auth: DEBUG: Signature: 2023-11-02T09:40:50.234 INFO:teuthology.orchestra.run.smithi156.stderr:598dd602b51620e98e2bf0c725e0c92c2889e712b345d337c005720f2fa319f6 2023-11-02T09:40:50.235 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.hooks: DEBUG: Event request-created.s3.PutBucketNotificationConfiguration: calling handler 2023-11-02T09:40:50.235 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.endpoint: DEBUG: Sending http request: 2023-11-02T09:40:50.236 INFO:teuthology.orchestra.run.smithi156.stderr:urllib3.connectionpool: DEBUG: Starting new HTTP connection (1): smithi156.front.sepia.ceph.com:80 2023-11-02T09:40:50.237 INFO:teuthology.orchestra.run.smithi156.stderr:urllib3.connectionpool: DEBUG: http://smithi156.front.sepia.ceph.com:80 "PUT /uicwqr-11?notification HTTP/1.1" 200 0 2023-11-02T09:40:50.237 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.parsers: DEBUG: Response headers: {'x-amz-request-id': 'tx000007fc86088f953cdea-0065436c78-117b-default', 'Server': 'Ceph Object Gateway (reef)', 'Content-Length': '0', 'Date': 'Thu, 02 Nov 2023 09:31:36 GMT', 'Connection': 'Keep-Alive'} 2023-11-02T09:40:50.237 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.parsers: DEBUG: Response body: 2023-11-02T09:40:50.238 INFO:teuthology.orchestra.run.smithi156.stderr:b'' 2023-11-02T09:40:50.238 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.hooks: DEBUG: Event needs-retry.s3.PutBucketNotificationConfiguration: calling handler 2023-11-02T09:40:50.238 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.retryhandler: DEBUG: No retry needed. 2023-11-02T09:40:50.238 INFO:teuthology.orchestra.run.smithi156.stderr:botocore.hooks: DEBUG: Event needs-retry.s3.PutBucketNotificationConfiguration: calling handler > 2023-11-02T09:40:50.238 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/0 2023-11-02T09:40:50.239 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/0 2023-11-02T09:40:50.239 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.239 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/0 2023-11-02T09:40:50.239 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.239 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'TZv6emWfyAwh2kkLkbnieA==', 'Content-Length': '3008193', 'Expect': '100-Continue'} 2023-11-02T09:40:50.240 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.240 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.240 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.240 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.240 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.241 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.241 INFO:teuthology.orchestra.run.smithi156.stderr:TZv6emWfyAwh2kkLkbnieA== 2023-11-02T09:40:50.241 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.241 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:36 GMT 2023-11-02T09:40:50.241 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/0 2023-11-02T09:40:50.242 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.242 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:Ela++Nau1jhRIUVuHPTKS3ITwxU= 2023-11-02T09:40:50.242 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'TZv6emWfyAwh2kkLkbnieA==', 'Content-Length': '3008193', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:36 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:Ela++Nau1jhRIUVuHPTKS3ITwxU='} 2023-11-02T09:40:50.242 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/1 2023-11-02T09:40:50.242 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/1 2023-11-02T09:40:50.243 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.243 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/1 2023-11-02T09:40:50.243 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.243 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '0KCRyVAPI9KcIl6908cCIQ==', 'Content-Length': '3010806', 'Expect': '100-Continue'} 2023-11-02T09:40:50.243 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.244 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.244 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.244 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:50.244 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.245 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.245 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.245 INFO:teuthology.orchestra.run.smithi156.stderr:0KCRyVAPI9KcIl6908cCIQ== 2023-11-02T09:40:50.245 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.246 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:36 GMT 2023-11-02T09:40:50.246 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/1 2023-11-02T09:40:50.246 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.246 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:kJDsMWU3OqJ/o7eo2kr2T/ngsFI= 2023-11-02T09:40:50.246 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '0KCRyVAPI9KcIl6908cCIQ==', 'Content-Length': '3010806', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:36 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:kJDsMWU3OqJ/o7eo2kr2T/ngsFI='} 2023-11-02T09:40:50.247 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/2 2023-11-02T09:40:50.247 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/2 2023-11-02T09:40:50.247 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.247 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/2 2023-11-02T09:40:50.247 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.248 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'q2wcCb7D+aPWyeclK3LM8g==', 'Content-Length': '3008496', 'Expect': '100-Continue'} 2023-11-02T09:40:50.248 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.248 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.249 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.249 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:50.249 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.249 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.249 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.250 INFO:teuthology.orchestra.run.smithi156.stderr:q2wcCb7D+aPWyeclK3LM8g== 2023-11-02T09:40:50.250 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.250 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:36 GMT 2023-11-02T09:40:50.250 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/2 2023-11-02T09:40:50.250 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.251 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:klgwKOTfCFgTqprmppCzKi0lMA4= 2023-11-02T09:40:50.251 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'q2wcCb7D+aPWyeclK3LM8g==', 'Content-Length': '3008496', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:36 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:klgwKOTfCFgTqprmppCzKi0lMA4='} 2023-11-02T09:40:50.251 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"4d9bfa7a659fc80c21da490b91b9e278"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000009a77f49808d8e5ec-0065436c78-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:36 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.251 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/3 2023-11-02T09:40:50.251 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/3 2023-11-02T09:40:50.252 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.252 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/3 2023-11-02T09:40:50.252 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.252 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'jVi4wWhD7cTrkN0sfnKp4w==', 'Content-Length': '3009014', 'Expect': '100-Continue'} 2023-11-02T09:40:50.252 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.253 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.253 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.253 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.253 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.253 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.253 INFO:teuthology.orchestra.run.smithi156.stderr:jVi4wWhD7cTrkN0sfnKp4w== 2023-11-02T09:40:50.254 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.254 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:36 GMT 2023-11-02T09:40:50.254 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/3 2023-11-02T09:40:50.254 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.254 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:oQR3Wm2Pew0BMNJnLibwar/UwYE= 2023-11-02T09:40:50.256 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'jVi4wWhD7cTrkN0sfnKp4w==', 'Content-Length': '3009014', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:36 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:oQR3Wm2Pew0BMNJnLibwar/UwYE='} 2023-11-02T09:40:50.256 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/4 2023-11-02T09:40:50.256 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/4 2023-11-02T09:40:50.256 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.257 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/4 2023-11-02T09:40:50.257 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.257 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'chRJAd5+xAZCxWol4bH05w==', 'Content-Length': '3011482', 'Expect': '100-Continue'} 2023-11-02T09:40:50.257 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.258 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.258 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.258 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:50.259 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.259 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.259 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.259 INFO:teuthology.orchestra.run.smithi156.stderr:chRJAd5+xAZCxWol4bH05w== 2023-11-02T09:40:50.259 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.260 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:36 GMT 2023-11-02T09:40:50.260 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/4 2023-11-02T09:40:50.260 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.260 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:Fr4dTb3ZDiTRYgMdvEpXoqTj/Bo= 2023-11-02T09:40:50.260 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'chRJAd5+xAZCxWol4bH05w==', 'Content-Length': '3011482', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:36 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:Fr4dTb3ZDiTRYgMdvEpXoqTj/Bo='} 2023-11-02T09:40:50.261 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"d0a091c9500f23d29c225ebdd3c70221"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000003e605d10577b1b8c-0065436c78-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:36 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.261 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/5 2023-11-02T09:40:50.261 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/5 2023-11-02T09:40:50.261 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.262 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/5 2023-11-02T09:40:50.262 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.262 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '6w9PJkLvBqemvW8DwT03yw==', 'Content-Length': '3009219', 'Expect': '100-Continue'} 2023-11-02T09:40:50.262 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.262 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.263 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.263 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.263 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.263 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.264 INFO:teuthology.orchestra.run.smithi156.stderr:6w9PJkLvBqemvW8DwT03yw== 2023-11-02T09:40:50.264 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.264 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:36 GMT 2023-11-02T09:40:50.264 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/5 2023-11-02T09:40:50.264 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.265 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:55lEYJTEL/7peoUFZAHTt6VL5gI= 2023-11-02T09:40:50.265 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '6w9PJkLvBqemvW8DwT03yw==', 'Content-Length': '3009219', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:36 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:55lEYJTEL/7peoUFZAHTt6VL5gI='} 2023-11-02T09:40:50.265 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/6 2023-11-02T09:40:50.265 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/6 2023-11-02T09:40:50.265 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.266 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/6 2023-11-02T09:40:50.266 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.266 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'Q8TWF3X6raalJ/9iujp/yg==', 'Content-Length': '3012382', 'Expect': '100-Continue'} 2023-11-02T09:40:50.267 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.267 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.267 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.267 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:50.267 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.268 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.268 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.268 INFO:teuthology.orchestra.run.smithi156.stderr:Q8TWF3X6raalJ/9iujp/yg== 2023-11-02T09:40:50.268 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.268 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:36 GMT 2023-11-02T09:40:50.270 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/6 2023-11-02T09:40:50.270 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.270 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:hlV54lSj3gaENAEsB0CHQbPB9NE= 2023-11-02T09:40:50.270 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'Q8TWF3X6raalJ/9iujp/yg==', 'Content-Length': '3012382', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:36 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:hlV54lSj3gaENAEsB0CHQbPB9NE='} 2023-11-02T09:40:50.271 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/7 2023-11-02T09:40:50.271 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/7 2023-11-02T09:40:50.271 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.271 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/7 2023-11-02T09:40:50.271 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.272 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'gQ1wqFIAEsU7i3IK0udmgA==', 'Content-Length': '3012420', 'Expect': '100-Continue'} 2023-11-02T09:40:50.272 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.272 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.272 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.272 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:50.273 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.273 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.273 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.273 INFO:teuthology.orchestra.run.smithi156.stderr:gQ1wqFIAEsU7i3IK0udmgA== 2023-11-02T09:40:50.273 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.274 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:36 GMT 2023-11-02T09:40:50.274 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/7 2023-11-02T09:40:50.274 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.274 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:gf8odKmrEMyex817Y3uYI+9HG0Q= 2023-11-02T09:40:50.274 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'gQ1wqFIAEsU7i3IK0udmgA==', 'Content-Length': '3012420', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:36 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:gf8odKmrEMyex817Y3uYI+9HG0Q='} 2023-11-02T09:40:50.275 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"ab6c1c09bec3f9a3d6c9e7252b72ccf2"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000472bef4d0e28e2db-0065436c78-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:36 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.275 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/8 2023-11-02T09:40:50.275 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/8 2023-11-02T09:40:50.275 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.275 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/8 2023-11-02T09:40:50.276 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.276 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '4bYNQxVhX6NPb3sbhuZVYQ==', 'Content-Length': '3009423', 'Expect': '100-Continue'} 2023-11-02T09:40:50.276 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.277 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.277 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.277 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.277 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.278 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.278 INFO:teuthology.orchestra.run.smithi156.stderr:4bYNQxVhX6NPb3sbhuZVYQ== 2023-11-02T09:40:50.278 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.278 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:36 GMT 2023-11-02T09:40:50.278 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/8 2023-11-02T09:40:50.279 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.279 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:fo3lE0IFsIG4j3qIj9AkyTK8hxE= 2023-11-02T09:40:50.279 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '4bYNQxVhX6NPb3sbhuZVYQ==', 'Content-Length': '3009423', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:36 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:fo3lE0IFsIG4j3qIj9AkyTK8hxE='} 2023-11-02T09:40:50.279 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/9 2023-11-02T09:40:50.279 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/9 2023-11-02T09:40:50.280 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.280 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/9 2023-11-02T09:40:50.281 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.281 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'huT+RJ0tahfvpo7njZ4LFw==', 'Content-Length': '3013203', 'Expect': '100-Continue'} 2023-11-02T09:40:50.281 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.281 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.281 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.282 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:50.282 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.282 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.282 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.282 INFO:teuthology.orchestra.run.smithi156.stderr:huT+RJ0tahfvpo7njZ4LFw== 2023-11-02T09:40:50.283 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.283 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:36 GMT 2023-11-02T09:40:50.283 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/9 2023-11-02T09:40:50.283 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.284 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:ODD2bTrZtetQNq70s3JGhIkDJEA= 2023-11-02T09:40:50.284 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'huT+RJ0tahfvpo7njZ4LFw==', 'Content-Length': '3013203', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:36 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:ODD2bTrZtetQNq70s3JGhIkDJEA='} 2023-11-02T09:40:50.284 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/11 2023-11-02T09:40:50.284 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/11 2023-11-02T09:40:50.284 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.285 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/11 2023-11-02T09:40:50.285 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.285 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'yDcgNF8TAcLApSp1CYE7MQ==', 'Content-Length': '3009872', 'Expect': '100-Continue'} 2023-11-02T09:40:50.287 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.287 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.288 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.288 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:50.288 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.288 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.288 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.289 INFO:teuthology.orchestra.run.smithi156.stderr:yDcgNF8TAcLApSp1CYE7MQ== 2023-11-02T09:40:50.289 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.289 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:36 GMT 2023-11-02T09:40:50.289 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/11 2023-11-02T09:40:50.289 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.290 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:C46OiMBNzLWnAj0sOz8sYbtHlyI= 2023-11-02T09:40:50.290 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'yDcgNF8TAcLApSp1CYE7MQ==', 'Content-Length': '3009872', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:36 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:C46OiMBNzLWnAj0sOz8sYbtHlyI='} 2023-11-02T09:40:50.290 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/10 2023-11-02T09:40:50.291 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/10 2023-11-02T09:40:50.291 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.291 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/10 2023-11-02T09:40:50.291 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.291 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'z6un/57rcofEfUQARTqJmA==', 'Content-Length': '3011710', 'Expect': '100-Continue'} 2023-11-02T09:40:50.292 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.292 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.292 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.292 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:50.292 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.293 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.293 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.293 INFO:teuthology.orchestra.run.smithi156.stderr:z6un/57rcofEfUQARTqJmA== 2023-11-02T09:40:50.295 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.295 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:36 GMT 2023-11-02T09:40:50.296 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/10 2023-11-02T09:40:50.296 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.297 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:9flGJqBXRZXIjDJq42QqEAgVlzQ= 2023-11-02T09:40:50.297 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'z6un/57rcofEfUQARTqJmA==', 'Content-Length': '3011710', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:36 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:9flGJqBXRZXIjDJq42QqEAgVlzQ='} 2023-11-02T09:40:50.298 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"8d58b8c16843edc4eb90dd2c7e72a9e3"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000118ed421a9d6c9d7-0065436c78-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:36 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.298 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/12 2023-11-02T09:40:50.298 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/12 2023-11-02T09:40:50.298 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.299 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/12 2023-11-02T09:40:50.301 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.301 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'tOs6cA6vtaetprEhsRHiEA==', 'Content-Length': '3008825', 'Expect': '100-Continue'} 2023-11-02T09:40:50.304 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.304 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.304 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.304 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.304 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.305 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.305 INFO:teuthology.orchestra.run.smithi156.stderr:tOs6cA6vtaetprEhsRHiEA== 2023-11-02T09:40:50.305 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.305 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:36 GMT 2023-11-02T09:40:50.305 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/12 2023-11-02T09:40:50.306 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.306 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:UfH7ZmI3y2bLSVpmk/5KlqI3nps= 2023-11-02T09:40:50.306 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'tOs6cA6vtaetprEhsRHiEA==', 'Content-Length': '3008825', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:36 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:UfH7ZmI3y2bLSVpmk/5KlqI3nps='} 2023-11-02T09:40:50.306 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/14 2023-11-02T09:40:50.306 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/14 2023-11-02T09:40:50.307 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.307 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/14 2023-11-02T09:40:50.307 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.307 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'x18LUYjA0WT3Pe2ueBaBxQ==', 'Content-Length': '3013150', 'Expect': '100-Continue'} 2023-11-02T09:40:50.308 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.308 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.308 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.308 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:50.309 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.309 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.309 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.309 INFO:teuthology.orchestra.run.smithi156.stderr:x18LUYjA0WT3Pe2ueBaBxQ== 2023-11-02T09:40:50.309 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.310 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:37 GMT 2023-11-02T09:40:50.310 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/14 2023-11-02T09:40:50.310 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.310 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:ecCMacRCiXgmJXtNTX6WJwd8cZw= 2023-11-02T09:40:50.310 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'x18LUYjA0WT3Pe2ueBaBxQ==', 'Content-Length': '3013150', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:37 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:ecCMacRCiXgmJXtNTX6WJwd8cZw='} 2023-11-02T09:40:50.311 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/13 2023-11-02T09:40:50.311 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/13 2023-11-02T09:40:50.311 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.311 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/13 2023-11-02T09:40:50.318 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.319 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'dfm97pRINdyEX1Ytvz8juw==', 'Content-Length': '3010407', 'Expect': '100-Continue'} 2023-11-02T09:40:50.319 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.319 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.319 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.319 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:50.320 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.320 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.320 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.320 INFO:teuthology.orchestra.run.smithi156.stderr:dfm97pRINdyEX1Ytvz8juw== 2023-11-02T09:40:50.320 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.321 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:37 GMT 2023-11-02T09:40:50.321 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/13 2023-11-02T09:40:50.321 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.321 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:yD4c81RORrbyFoyETfx2U0YW2Do= 2023-11-02T09:40:50.321 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'dfm97pRINdyEX1Ytvz8juw==', 'Content-Length': '3010407', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:37 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:yD4c81RORrbyFoyETfx2U0YW2Do='} 2023-11-02T09:40:50.322 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"72144901de7ec40642c56a25e1b1f4e7"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000769fea771f366d51-0065436c78-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:37 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.322 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/15 2023-11-02T09:40:50.322 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/15 2023-11-02T09:40:50.322 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.322 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/15 2023-11-02T09:40:50.323 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.323 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'ysiJGTrosJkRHLUMBwAI2w==', 'Content-Length': '3011515', 'Expect': '100-Continue'} 2023-11-02T09:40:50.323 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.323 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.323 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.324 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.324 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.324 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.324 INFO:teuthology.orchestra.run.smithi156.stderr:ysiJGTrosJkRHLUMBwAI2w== 2023-11-02T09:40:50.325 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.325 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:37 GMT 2023-11-02T09:40:50.325 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/15 2023-11-02T09:40:50.325 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.325 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:h7d8mB4XLFGi0GU+eCXc2VchRBU= 2023-11-02T09:40:50.326 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'ysiJGTrosJkRHLUMBwAI2w==', 'Content-Length': '3011515', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:37 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:h7d8mB4XLFGi0GU+eCXc2VchRBU='} 2023-11-02T09:40:50.326 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"eb0f4f2642ef06a7a6bd6f03c13d37cb"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000059a7760e9bd32fe5-0065436c78-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:37 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.326 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/16 2023-11-02T09:40:50.326 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/16 2023-11-02T09:40:50.326 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.327 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/16 2023-11-02T09:40:50.327 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.327 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'Sn029OnoK0yBvjxhYtTntQ==', 'Content-Length': '3012129', 'Expect': '100-Continue'} 2023-11-02T09:40:50.327 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.327 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.328 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.328 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.328 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.328 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.328 INFO:teuthology.orchestra.run.smithi156.stderr:Sn029OnoK0yBvjxhYtTntQ== 2023-11-02T09:40:50.329 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.329 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:37 GMT 2023-11-02T09:40:50.329 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/16 2023-11-02T09:40:50.329 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.329 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:ps/b/8GYyuMzBZJlwkFv6S/ae0A= 2023-11-02T09:40:50.329 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'Sn029OnoK0yBvjxhYtTntQ==', 'Content-Length': '3012129', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:37 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:ps/b/8GYyuMzBZJlwkFv6S/ae0A='} 2023-11-02T09:40:50.330 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/17 2023-11-02T09:40:50.330 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/17 2023-11-02T09:40:50.330 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.332 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/17 2023-11-02T09:40:50.332 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.332 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'Jt/CECiXk2E+DD3ZG8BEgQ==', 'Content-Length': '3010541', 'Expect': '100-Continue'} 2023-11-02T09:40:50.332 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.333 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.333 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.333 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:50.334 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.334 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.334 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.335 INFO:teuthology.orchestra.run.smithi156.stderr:Jt/CECiXk2E+DD3ZG8BEgQ== 2023-11-02T09:40:50.335 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.335 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:37 GMT 2023-11-02T09:40:50.335 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/17 2023-11-02T09:40:50.336 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.336 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:1mY6YRHCa08z0WLA1MGSvf2xQ04= 2023-11-02T09:40:50.336 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'Jt/CECiXk2E+DD3ZG8BEgQ==', 'Content-Length': '3010541', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:37 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:1mY6YRHCa08z0WLA1MGSvf2xQ04='} 2023-11-02T09:40:50.336 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/18 2023-11-02T09:40:50.336 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/18 2023-11-02T09:40:50.337 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.337 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/18 2023-11-02T09:40:50.337 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.337 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'RnD1ZwXJe7NfwiReVoupTA==', 'Content-Length': '3011586', 'Expect': '100-Continue'} 2023-11-02T09:40:50.337 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.338 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.338 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.338 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:50.338 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.339 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.339 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.339 INFO:teuthology.orchestra.run.smithi156.stderr:RnD1ZwXJe7NfwiReVoupTA== 2023-11-02T09:40:50.339 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.339 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:37 GMT 2023-11-02T09:40:50.339 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/18 2023-11-02T09:40:50.340 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.340 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:kS1XoUhWikcYnWVq2OGcM4HhZxg= 2023-11-02T09:40:50.340 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'RnD1ZwXJe7NfwiReVoupTA==', 'Content-Length': '3011586', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:37 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:kS1XoUhWikcYnWVq2OGcM4HhZxg='} 2023-11-02T09:40:50.340 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"43c4d61775faada6a527ff62ba3a7fca"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000008a2af9cfee43ff64-0065436c78-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:37 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.340 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/19 2023-11-02T09:40:50.341 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/19 2023-11-02T09:40:50.341 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.341 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/19 2023-11-02T09:40:50.341 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.342 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'V63bRymQ8UflfKl0rAuaOA==', 'Content-Length': '3010832', 'Expect': '100-Continue'} 2023-11-02T09:40:50.342 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.342 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.342 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.342 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.343 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.343 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.343 INFO:teuthology.orchestra.run.smithi156.stderr:V63bRymQ8UflfKl0rAuaOA== 2023-11-02T09:40:50.343 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.344 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:37 GMT 2023-11-02T09:40:50.344 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/19 2023-11-02T09:40:50.344 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.344 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:o4Mi5cR26Y4zjZQZOSRI+Oyu7EM= 2023-11-02T09:40:50.344 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'V63bRymQ8UflfKl0rAuaOA==', 'Content-Length': '3010832', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:37 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:o4Mi5cR26Y4zjZQZOSRI+Oyu7EM='} 2023-11-02T09:40:50.345 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/20 2023-11-02T09:40:50.345 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/20 2023-11-02T09:40:50.345 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.345 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/20 2023-11-02T09:40:50.346 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.346 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'xJJG1iwv1L+hncaAN4T3ww==', 'Content-Length': '3010447', 'Expect': '100-Continue'} 2023-11-02T09:40:50.346 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.346 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.347 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.347 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:50.347 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.347 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.347 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.348 INFO:teuthology.orchestra.run.smithi156.stderr:xJJG1iwv1L+hncaAN4T3ww== 2023-11-02T09:40:50.348 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.348 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:37 GMT 2023-11-02T09:40:50.348 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/20 2023-11-02T09:40:50.348 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.349 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:iQzAzpdP8ogNEgJzjA+Z4snJFfg= 2023-11-02T09:40:50.349 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'xJJG1iwv1L+hncaAN4T3ww==', 'Content-Length': '3010447', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:37 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:iQzAzpdP8ogNEgJzjA+Z4snJFfg='} 2023-11-02T09:40:50.349 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"810d70a8520012c53b8b720ad2e76680"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000605ab92cc6fcf770-0065436c78-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:37 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.349 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/22 2023-11-02T09:40:50.350 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/22 2023-11-02T09:40:50.350 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.350 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/22 2023-11-02T09:40:50.350 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.350 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'gxECR/cvtB3DVgt7XkCyAA==', 'Content-Length': '3010949', 'Expect': '100-Continue'} 2023-11-02T09:40:50.351 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.351 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.351 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.351 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.351 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.352 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.352 INFO:teuthology.orchestra.run.smithi156.stderr:gxECR/cvtB3DVgt7XkCyAA== 2023-11-02T09:40:50.352 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.352 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:37 GMT 2023-11-02T09:40:50.352 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/22 2023-11-02T09:40:50.352 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.353 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:/LrVgVplLUtO83YG/C7NVOFvubI= 2023-11-02T09:40:50.353 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'gxECR/cvtB3DVgt7XkCyAA==', 'Content-Length': '3010949', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:37 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:/LrVgVplLUtO83YG/C7NVOFvubI='} 2023-11-02T09:40:50.353 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/21 2023-11-02T09:40:50.353 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/21 2023-11-02T09:40:50.353 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.354 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/21 2023-11-02T09:40:50.354 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.354 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'uWzseYUVZt53rxtLVCuiqw==', 'Content-Length': '3006835', 'Expect': '100-Continue'} 2023-11-02T09:40:50.354 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.355 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.355 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.355 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:50.355 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.355 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.356 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.356 INFO:teuthology.orchestra.run.smithi156.stderr:uWzseYUVZt53rxtLVCuiqw== 2023-11-02T09:40:50.356 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.356 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:37 GMT 2023-11-02T09:40:50.356 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/21 2023-11-02T09:40:50.357 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.357 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:fwqzYQ5+UeVWL0G+rz1Yi1NWRYg= 2023-11-02T09:40:50.357 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'uWzseYUVZt53rxtLVCuiqw==', 'Content-Length': '3006835', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:37 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:fwqzYQ5+UeVWL0G+rz1Yi1NWRYg='} 2023-11-02T09:40:50.357 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/23 2023-11-02T09:40:50.357 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/23 2023-11-02T09:40:50.358 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.358 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/23 2023-11-02T09:40:50.358 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.358 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'PcShsqo93pqEhg4PteCweA==', 'Content-Length': '3008375', 'Expect': '100-Continue'} 2023-11-02T09:40:50.359 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.359 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.359 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.359 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:50.359 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.360 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.360 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.360 INFO:teuthology.orchestra.run.smithi156.stderr:PcShsqo93pqEhg4PteCweA== 2023-11-02T09:40:50.360 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.360 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:37 GMT 2023-11-02T09:40:50.361 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/23 2023-11-02T09:40:50.361 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.361 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:ppRg0Zp9sbsTZEWUhwVAHydKVjc= 2023-11-02T09:40:50.361 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'PcShsqo93pqEhg4PteCweA==', 'Content-Length': '3008375', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:37 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:ppRg0Zp9sbsTZEWUhwVAHydKVjc='} 2023-11-02T09:40:50.361 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"e1b60d4315615fa34f6f7b1b86e65561"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005c2229961d296e1b-0065436c78-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:37 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.362 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/24 2023-11-02T09:40:50.362 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/24 2023-11-02T09:40:50.362 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.362 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/24 2023-11-02T09:40:50.363 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.363 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '5F45Lp34bsnk6hDLRMphwA==', 'Content-Length': '3011281', 'Expect': '100-Continue'} 2023-11-02T09:40:50.363 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.363 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.364 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.364 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.364 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.364 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.365 INFO:teuthology.orchestra.run.smithi156.stderr:5F45Lp34bsnk6hDLRMphwA== 2023-11-02T09:40:50.365 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.365 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:37 GMT 2023-11-02T09:40:50.365 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/24 2023-11-02T09:40:50.365 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.366 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:0ugb9Fa9Q8FsuThJz6Ih6egBLu4= 2023-11-02T09:40:50.366 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '5F45Lp34bsnk6hDLRMphwA==', 'Content-Length': '3011281', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:37 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:0ugb9Fa9Q8FsuThJz6Ih6egBLu4='} 2023-11-02T09:40:50.366 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/25 2023-11-02T09:40:50.366 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/25 2023-11-02T09:40:50.367 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.367 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/25 2023-11-02T09:40:50.367 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.367 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'cXMxzm76w02Mh3rVhxGREw==', 'Content-Length': '3011210', 'Expect': '100-Continue'} 2023-11-02T09:40:50.368 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.368 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.368 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.368 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:50.368 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.369 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.369 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.369 INFO:teuthology.orchestra.run.smithi156.stderr:cXMxzm76w02Mh3rVhxGREw== 2023-11-02T09:40:50.369 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.370 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:37 GMT 2023-11-02T09:40:50.370 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/25 2023-11-02T09:40:50.370 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.371 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:aPzSuXiFPrZ1Qkb/M0ftOEkkjRA= 2023-11-02T09:40:50.371 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'cXMxzm76w02Mh3rVhxGREw==', 'Content-Length': '3011210', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:37 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:aPzSuXiFPrZ1Qkb/M0ftOEkkjRA='} 2023-11-02T09:40:50.371 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/27 2023-11-02T09:40:50.371 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/27 2023-11-02T09:40:50.371 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.372 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/27 2023-11-02T09:40:50.372 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.372 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'ru3JUmgvlhnVWzrcW5pMQg==', 'Content-Length': '3008994', 'Expect': '100-Continue'} 2023-11-02T09:40:50.372 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.372 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.373 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.373 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:50.373 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.373 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.374 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.374 INFO:teuthology.orchestra.run.smithi156.stderr:ru3JUmgvlhnVWzrcW5pMQg== 2023-11-02T09:40:50.374 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.374 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:37 GMT 2023-11-02T09:40:50.374 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/27 2023-11-02T09:40:50.375 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.375 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:A2z3/IjTAXUU/LT+2ZKqJnbp0fw= 2023-11-02T09:40:50.375 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'ru3JUmgvlhnVWzrcW5pMQg==', 'Content-Length': '3008994', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:37 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:A2z3/IjTAXUU/LT+2ZKqJnbp0fw='} 2023-11-02T09:40:50.375 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/26 2023-11-02T09:40:50.375 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/26 2023-11-02T09:40:50.376 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.376 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/26 2023-11-02T09:40:50.376 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.376 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'LZkPwUlHu21NikwNSJG/tA==', 'Content-Length': '3011294', 'Expect': '100-Continue'} 2023-11-02T09:40:50.376 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.377 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.377 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.377 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:50.377 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.378 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.378 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.378 INFO:teuthology.orchestra.run.smithi156.stderr:LZkPwUlHu21NikwNSJG/tA== 2023-11-02T09:40:50.378 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.378 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:37 GMT 2023-11-02T09:40:50.379 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/26 2023-11-02T09:40:50.379 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.379 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:6nSqlCL0wcLQqCziBCUrbW1jEp4= 2023-11-02T09:40:50.379 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'LZkPwUlHu21NikwNSJG/tA==', 'Content-Length': '3011294', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:37 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:6nSqlCL0wcLQqCziBCUrbW1jEp4='} 2023-11-02T09:40:50.380 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"86e4fe449d2d6a17efa68ee78d9e0b17"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a2cdb83654bd95ca-0065436c78-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:37 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.380 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/28 2023-11-02T09:40:50.380 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/28 2023-11-02T09:40:50.380 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.380 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/28 2023-11-02T09:40:50.381 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.381 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'K9SsJH/q3fqOFpOqxe+dAA==', 'Content-Length': '3008683', 'Expect': '100-Continue'} 2023-11-02T09:40:50.381 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.381 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.381 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.382 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.382 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.382 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.382 INFO:teuthology.orchestra.run.smithi156.stderr:K9SsJH/q3fqOFpOqxe+dAA== 2023-11-02T09:40:50.383 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.383 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:37 GMT 2023-11-02T09:40:50.383 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/28 2023-11-02T09:40:50.383 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.383 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:5KsYGxURhb/AC1kU/Llx8L0TPxY= 2023-11-02T09:40:50.384 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'K9SsJH/q3fqOFpOqxe+dAA==', 'Content-Length': '3008683', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:37 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:5KsYGxURhb/AC1kU/Llx8L0TPxY='} 2023-11-02T09:40:50.384 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/29 2023-11-02T09:40:50.384 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/29 2023-11-02T09:40:50.384 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.384 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/29 2023-11-02T09:40:50.385 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.385 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'W45LeV10gOrdUIEuhDG1UA==', 'Content-Length': '3010799', 'Expect': '100-Continue'} 2023-11-02T09:40:50.385 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.385 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.385 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.386 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:50.386 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.386 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.386 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.386 INFO:teuthology.orchestra.run.smithi156.stderr:W45LeV10gOrdUIEuhDG1UA== 2023-11-02T09:40:50.386 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.387 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:37 GMT 2023-11-02T09:40:50.387 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/29 2023-11-02T09:40:50.387 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.387 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:QU/5exru/ZnlhF78FCB6BFhUhFo= 2023-11-02T09:40:50.387 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'W45LeV10gOrdUIEuhDG1UA==', 'Content-Length': '3010799', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:37 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:QU/5exru/ZnlhF78FCB6BFhUhFo='} 2023-11-02T09:40:50.388 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"cfaba7ff9eeb7287c47d4400453a8998"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000f6b0d3b3cb75584-0065436c78-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:37 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.388 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"c83720345f1301c2c0a52a7509813b31"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000082f5ba08993c71d4-0065436c78-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:37 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.388 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/31 2023-11-02T09:40:50.388 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/31 2023-11-02T09:40:50.388 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.389 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/31 2023-11-02T09:40:50.389 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.389 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'Cexv9lPSJ7z0S4Xr1a99Yw==', 'Content-Length': '3011164', 'Expect': '100-Continue'} 2023-11-02T09:40:50.390 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.390 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.390 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.390 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.390 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.391 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.391 INFO:teuthology.orchestra.run.smithi156.stderr:Cexv9lPSJ7z0S4Xr1a99Yw== 2023-11-02T09:40:50.391 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.391 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:37 GMT 2023-11-02T09:40:50.392 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/31 2023-11-02T09:40:50.392 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.392 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:fjd4Jn/AZQz1Nm5GoZbuhDXWmFg= 2023-11-02T09:40:50.392 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'Cexv9lPSJ7z0S4Xr1a99Yw==', 'Content-Length': '3011164', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:37 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:fjd4Jn/AZQz1Nm5GoZbuhDXWmFg='} 2023-11-02T09:40:50.393 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/32 2023-11-02T09:40:50.393 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/32 2023-11-02T09:40:50.393 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.393 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/32 2023-11-02T09:40:50.393 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.394 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'HfYy+4OhGY6vQ6wH7mk8Kw==', 'Content-Length': '3012462', 'Expect': '100-Continue'} 2023-11-02T09:40:50.394 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.394 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.394 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.394 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.395 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.395 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.395 INFO:teuthology.orchestra.run.smithi156.stderr:HfYy+4OhGY6vQ6wH7mk8Kw== 2023-11-02T09:40:50.395 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.395 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:37 GMT 2023-11-02T09:40:50.396 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/32 2023-11-02T09:40:50.396 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.396 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:ArJ7YPWe39KA/Imt2A7Fbgqu0oI= 2023-11-02T09:40:50.396 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'HfYy+4OhGY6vQ6wH7mk8Kw==', 'Content-Length': '3012462', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:37 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:ArJ7YPWe39KA/Imt2A7Fbgqu0oI='} 2023-11-02T09:40:50.397 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/30 2023-11-02T09:40:50.397 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/30 2023-11-02T09:40:50.397 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.397 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/30 2023-11-02T09:40:50.397 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.398 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 't6/KbDOaHhh9UabNKemz7w==', 'Content-Length': '3007538', 'Expect': '100-Continue'} 2023-11-02T09:40:50.398 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.398 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.398 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.399 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:50.399 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.399 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.399 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.400 INFO:teuthology.orchestra.run.smithi156.stderr:t6/KbDOaHhh9UabNKemz7w== 2023-11-02T09:40:50.400 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.400 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:37 GMT 2023-11-02T09:40:50.400 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/30 2023-11-02T09:40:50.400 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.401 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:ncHSuvVAn9swf6Mgp/8175ABgO0= 2023-11-02T09:40:50.401 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 't6/KbDOaHhh9UabNKemz7w==', 'Content-Length': '3007538', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:37 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:ncHSuvVAn9swf6Mgp/8175ABgO0='} 2023-11-02T09:40:50.401 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/33 2023-11-02T09:40:50.401 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/33 2023-11-02T09:40:50.401 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.402 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/33 2023-11-02T09:40:50.402 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.402 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'd17ese5YZCGO7WJifjIlOQ==', 'Content-Length': '3009725', 'Expect': '100-Continue'} 2023-11-02T09:40:50.402 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.402 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.403 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.403 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:50.403 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.403 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.404 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.404 INFO:teuthology.orchestra.run.smithi156.stderr:d17ese5YZCGO7WJifjIlOQ== 2023-11-02T09:40:50.404 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.404 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:37 GMT 2023-11-02T09:40:50.404 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/33 2023-11-02T09:40:50.405 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.405 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:dWEqzigR5t9d+0O/uT2rGRoMAoY= 2023-11-02T09:40:50.405 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'd17ese5YZCGO7WJifjIlOQ==', 'Content-Length': '3009725', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:37 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:dWEqzigR5t9d+0O/uT2rGRoMAoY='} 2023-11-02T09:40:50.405 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"b4eb3a700eafb5a7ada6b121b111e210"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000cfa21d1179bfc106-0065436c78-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:37 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.405 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"c75f0b5188c0d164f73dedae781681c5"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000007cad735ecc2ebe97-0065436c79-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:37 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.406 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/34 2023-11-02T09:40:50.406 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/34 2023-11-02T09:40:50.406 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.406 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/34 2023-11-02T09:40:50.406 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.407 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rHgJWNVN25LcW5vBHyFVFw==', 'Content-Length': '3009650', 'Expect': '100-Continue'} 2023-11-02T09:40:50.407 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.407 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.407 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.407 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.408 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.408 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.408 INFO:teuthology.orchestra.run.smithi156.stderr:rHgJWNVN25LcW5vBHyFVFw== 2023-11-02T09:40:50.408 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.408 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:37 GMT 2023-11-02T09:40:50.409 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/34 2023-11-02T09:40:50.409 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.409 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:gtlTlpWtBNie90kMYOPhHx4Lmf0= 2023-11-02T09:40:50.409 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rHgJWNVN25LcW5vBHyFVFw==', 'Content-Length': '3009650', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:37 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:gtlTlpWtBNie90kMYOPhHx4Lmf0='} 2023-11-02T09:40:50.409 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/35 2023-11-02T09:40:50.410 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/35 2023-11-02T09:40:50.410 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.410 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/35 2023-11-02T09:40:50.410 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.410 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'u+OBjwohzYDt0CsQhZNaeg==', 'Content-Length': '3010999', 'Expect': '100-Continue'} 2023-11-02T09:40:50.411 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.411 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.411 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.411 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.411 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.412 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.412 INFO:teuthology.orchestra.run.smithi156.stderr:u+OBjwohzYDt0CsQhZNaeg== 2023-11-02T09:40:50.412 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.412 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:37 GMT 2023-11-02T09:40:50.412 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/35 2023-11-02T09:40:50.413 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.413 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:3ux1o8cjQWBG73fPcM6OwhJR5pU= 2023-11-02T09:40:50.413 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'u+OBjwohzYDt0CsQhZNaeg==', 'Content-Length': '3010999', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:37 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:3ux1o8cjQWBG73fPcM6OwhJR5pU='} 2023-11-02T09:40:50.413 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"75f9bdee944835dc845f562dbf3f23bb"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000fe6e1436602d925e-0065436c79-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:37 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.413 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/38 2023-11-02T09:40:50.413 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/38 2023-11-02T09:40:50.414 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.414 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/38 2023-11-02T09:40:50.414 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.414 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '0WQeq00ShxUtUREu5KSLBQ==', 'Content-Length': '3011508', 'Expect': '100-Continue'} 2023-11-02T09:40:50.414 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.415 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.415 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.415 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.416 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.416 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.416 INFO:teuthology.orchestra.run.smithi156.stderr:0WQeq00ShxUtUREu5KSLBQ== 2023-11-02T09:40:50.416 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.416 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:37 GMT 2023-11-02T09:40:50.417 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/38 2023-11-02T09:40:50.417 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.417 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:soKNRzkNMXtS3vp8QtU0qII5B6Y= 2023-11-02T09:40:50.417 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '0WQeq00ShxUtUREu5KSLBQ==', 'Content-Length': '3011508', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:37 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:soKNRzkNMXtS3vp8QtU0qII5B6Y='} 2023-11-02T09:40:50.418 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/37 2023-11-02T09:40:50.418 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/37 2023-11-02T09:40:50.418 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.418 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/37 2023-11-02T09:40:50.418 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.419 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 's8xFtyUg1O76y4Rrjw/jRA==', 'Content-Length': '3008974', 'Expect': '100-Continue'} 2023-11-02T09:40:50.419 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.419 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.419 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.419 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:50.419 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.420 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.420 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.420 INFO:teuthology.orchestra.run.smithi156.stderr:s8xFtyUg1O76y4Rrjw/jRA== 2023-11-02T09:40:50.420 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.420 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:37 GMT 2023-11-02T09:40:50.421 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/37 2023-11-02T09:40:50.421 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.421 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:Yw1d+pE+7sCbHOup3HYVdEo6V48= 2023-11-02T09:40:50.421 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 's8xFtyUg1O76y4Rrjw/jRA==', 'Content-Length': '3008974', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:37 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:Yw1d+pE+7sCbHOup3HYVdEo6V48='} 2023-11-02T09:40:50.422 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"4a7d36f4e9e82b4c81be3c6162d4e7b5"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000008b3e807c3bd2f236-0065436c79-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:37 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.422 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/40 2023-11-02T09:40:50.422 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/40 2023-11-02T09:40:50.422 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.422 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/40 2023-11-02T09:40:50.423 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.423 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'khf6t99OAiRbRDWj5F0S5w==', 'Content-Length': '3010522', 'Expect': '100-Continue'} 2023-11-02T09:40:50.423 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.423 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.423 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.424 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.424 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.424 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.424 INFO:teuthology.orchestra.run.smithi156.stderr:khf6t99OAiRbRDWj5F0S5w== 2023-11-02T09:40:50.424 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.425 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:37 GMT 2023-11-02T09:40:50.425 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/40 2023-11-02T09:40:50.425 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.425 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:yUD4Z0X080sgTMJiHPIo6ldyGm4= 2023-11-02T09:40:50.425 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'khf6t99OAiRbRDWj5F0S5w==', 'Content-Length': '3010522', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:37 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:yUD4Z0X080sgTMJiHPIo6ldyGm4='} 2023-11-02T09:40:50.426 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/39 2023-11-02T09:40:50.426 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/39 2023-11-02T09:40:50.426 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.426 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/39 2023-11-02T09:40:50.426 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.427 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'sFtUv78PIC+dO/HwcJo4bQ==', 'Content-Length': '3009225', 'Expect': '100-Continue'} 2023-11-02T09:40:50.427 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.427 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.427 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.428 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:50.428 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.428 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.428 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.428 INFO:teuthology.orchestra.run.smithi156.stderr:sFtUv78PIC+dO/HwcJo4bQ== 2023-11-02T09:40:50.429 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.429 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:37 GMT 2023-11-02T09:40:50.429 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/39 2023-11-02T09:40:50.429 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.429 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:LBVwZAitlApkRz+rkMO+sVMtjIk= 2023-11-02T09:40:50.430 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'sFtUv78PIC+dO/HwcJo4bQ==', 'Content-Length': '3009225', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:37 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:LBVwZAitlApkRz+rkMO+sVMtjIk='} 2023-11-02T09:40:50.430 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/36 2023-11-02T09:40:50.430 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/36 2023-11-02T09:40:50.430 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.430 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/36 2023-11-02T09:40:50.431 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.431 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'RipzIK2+gDR3pwCKVYJBdw==', 'Content-Length': '3013286', 'Expect': '100-Continue'} 2023-11-02T09:40:50.431 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.431 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.431 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.432 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:50.432 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.432 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.432 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.432 INFO:teuthology.orchestra.run.smithi156.stderr:RipzIK2+gDR3pwCKVYJBdw== 2023-11-02T09:40:50.433 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.433 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:37 GMT 2023-11-02T09:40:50.433 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/36 2023-11-02T09:40:50.433 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.433 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:NROvkg7zp5viLDOzr8VwXs83sMs= 2023-11-02T09:40:50.434 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'RipzIK2+gDR3pwCKVYJBdw==', 'Content-Length': '3013286', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:37 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:NROvkg7zp5viLDOzr8VwXs83sMs='} 2023-11-02T09:40:50.434 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/41 2023-11-02T09:40:50.434 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/41 2023-11-02T09:40:50.434 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.434 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/41 2023-11-02T09:40:50.434 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.435 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'YRSpN8Y9ljXWaju6p2fWLw==', 'Content-Length': '3011136', 'Expect': '100-Continue'} 2023-11-02T09:40:50.435 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.435 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.435 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.436 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:50.436 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.436 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.436 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.436 INFO:teuthology.orchestra.run.smithi156.stderr:YRSpN8Y9ljXWaju6p2fWLw== 2023-11-02T09:40:50.436 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.437 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:37 GMT 2023-11-02T09:40:50.437 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/41 2023-11-02T09:40:50.437 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.437 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:B4kPd/2Zg43pLVO1bipG1e/3oTs= 2023-11-02T09:40:50.437 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'YRSpN8Y9ljXWaju6p2fWLw==', 'Content-Length': '3011136', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:37 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:B4kPd/2Zg43pLVO1bipG1e/3oTs='} 2023-11-02T09:40:50.438 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"cac889193ae8b099111cb50c070008db"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000074e2fe40f1ba81ed-0065436c79-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:37 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.438 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/43 2023-11-02T09:40:50.438 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/43 2023-11-02T09:40:50.438 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.439 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/43 2023-11-02T09:40:50.439 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.439 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'aN1tKCTVwnxBsFI+zDBfog==', 'Content-Length': '3011925', 'Expect': '100-Continue'} 2023-11-02T09:40:50.439 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.439 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.440 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.440 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.440 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.440 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.441 INFO:teuthology.orchestra.run.smithi156.stderr:aN1tKCTVwnxBsFI+zDBfog== 2023-11-02T09:40:50.443 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.443 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:37 GMT 2023-11-02T09:40:50.443 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/43 2023-11-02T09:40:50.443 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.444 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:+4Ful4tcuATNBl0dfWggnKNx0Tc= 2023-11-02T09:40:50.444 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'aN1tKCTVwnxBsFI+zDBfog==', 'Content-Length': '3011925', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:37 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:+4Ful4tcuATNBl0dfWggnKNx0Tc='} 2023-11-02T09:40:50.444 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"26dfc210289793613e0c3dd91bc04481"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000fc2c799c271a118a-0065436c79-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:37 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.444 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/46 2023-11-02T09:40:50.445 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/46 2023-11-02T09:40:50.445 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.446 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/46 2023-11-02T09:40:50.446 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.446 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '8uORT4YofNMkhEQM84VNCQ==', 'Content-Length': '3009989', 'Expect': '100-Continue'} 2023-11-02T09:40:50.446 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.447 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.447 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.447 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.447 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.447 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.448 INFO:teuthology.orchestra.run.smithi156.stderr:8uORT4YofNMkhEQM84VNCQ== 2023-11-02T09:40:50.448 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.448 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:37 GMT 2023-11-02T09:40:50.448 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/46 2023-11-02T09:40:50.448 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.449 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:7yFe4w4nEPFzA5up5AxtlCNjItc= 2023-11-02T09:40:50.449 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '8uORT4YofNMkhEQM84VNCQ==', 'Content-Length': '3009989', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:37 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:7yFe4w4nEPFzA5up5AxtlCNjItc='} 2023-11-02T09:40:50.449 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/42 2023-11-02T09:40:50.450 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/42 2023-11-02T09:40:50.450 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.450 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/42 2023-11-02T09:40:50.451 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.451 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '+5iAjzRE6ZkYkpnGxFEENQ==', 'Content-Length': '3011141', 'Expect': '100-Continue'} 2023-11-02T09:40:50.451 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.451 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.451 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.452 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:50.452 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.452 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.452 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.453 INFO:teuthology.orchestra.run.smithi156.stderr:+5iAjzRE6ZkYkpnGxFEENQ== 2023-11-02T09:40:50.453 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.453 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:37 GMT 2023-11-02T09:40:50.453 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/42 2023-11-02T09:40:50.454 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.454 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:xo0+xIKbDnRDEITyANC/BXpI99M= 2023-11-02T09:40:50.454 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '+5iAjzRE6ZkYkpnGxFEENQ==', 'Content-Length': '3011141', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:37 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:xo0+xIKbDnRDEITyANC/BXpI99M='} 2023-11-02T09:40:50.454 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/44 2023-11-02T09:40:50.454 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/44 2023-11-02T09:40:50.455 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.455 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/44 2023-11-02T09:40:50.455 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.455 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'GvO0c66bEo5G9RBpIM4I5g==', 'Content-Length': '3008445', 'Expect': '100-Continue'} 2023-11-02T09:40:50.455 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.456 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.456 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.456 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:50.456 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.456 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.457 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.457 INFO:teuthology.orchestra.run.smithi156.stderr:GvO0c66bEo5G9RBpIM4I5g== 2023-11-02T09:40:50.457 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.457 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:37 GMT 2023-11-02T09:40:50.457 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/44 2023-11-02T09:40:50.458 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.458 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:kkI7PEY5VjZUKXmTdU/RawryZkg= 2023-11-02T09:40:50.458 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'GvO0c66bEo5G9RBpIM4I5g==', 'Content-Length': '3008445', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:37 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:kkI7PEY5VjZUKXmTdU/RawryZkg='} 2023-11-02T09:40:50.458 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"4670f56705c97bb35fc2245e568ba94c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000045189def91f7f3-0065436c79-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:37 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.458 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/45 2023-11-02T09:40:50.459 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/45 2023-11-02T09:40:50.459 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.459 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/45 2023-11-02T09:40:50.459 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.459 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'UwjyJQv5uRl6ZNIffog0bw==', 'Content-Length': '3011930', 'Expect': '100-Continue'} 2023-11-02T09:40:50.460 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.460 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.460 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.460 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.460 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.461 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.461 INFO:teuthology.orchestra.run.smithi156.stderr:UwjyJQv5uRl6ZNIffog0bw== 2023-11-02T09:40:50.461 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.461 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:37 GMT 2023-11-02T09:40:50.461 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/45 2023-11-02T09:40:50.462 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.462 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:ViVVyngzP0MfIbGErrTfp9SOrlQ= 2023-11-02T09:40:50.462 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'UwjyJQv5uRl6ZNIffog0bw==', 'Content-Length': '3011930', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:37 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:ViVVyngzP0MfIbGErrTfp9SOrlQ='} 2023-11-02T09:40:50.462 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"57addb472990f147e57ca974ac0b9a38"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a7a76939213f4ea2-0065436c79-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:37 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.462 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/47 2023-11-02T09:40:50.463 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/47 2023-11-02T09:40:50.463 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.463 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/47 2023-11-02T09:40:50.463 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.464 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'WUm5t6XzPPcWe+rjlsYkjw==', 'Content-Length': '3011031', 'Expect': '100-Continue'} 2023-11-02T09:40:50.464 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.464 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.464 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.464 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.465 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.465 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.465 INFO:teuthology.orchestra.run.smithi156.stderr:WUm5t6XzPPcWe+rjlsYkjw== 2023-11-02T09:40:50.465 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.465 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:37 GMT 2023-11-02T09:40:50.466 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/47 2023-11-02T09:40:50.466 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.466 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:dWDnetRCJOPtChxmIymz97sx8bY= 2023-11-02T09:40:50.466 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'WUm5t6XzPPcWe+rjlsYkjw==', 'Content-Length': '3011031', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:37 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:dWDnetRCJOPtChxmIymz97sx8bY='} 2023-11-02T09:40:50.466 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"b96cec79851566de77af1b4b542ba2ab"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000002f97c09069684f62-0065436c79-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:37 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.467 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/48 2023-11-02T09:40:50.467 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/48 2023-11-02T09:40:50.467 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.467 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/48 2023-11-02T09:40:50.467 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.468 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '9v5+f9LWzTwUXacIYnNtvw==', 'Content-Length': '3012545', 'Expect': '100-Continue'} 2023-11-02T09:40:50.468 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.468 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.468 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.468 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.469 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.469 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.469 INFO:teuthology.orchestra.run.smithi156.stderr:9v5+f9LWzTwUXacIYnNtvw== 2023-11-02T09:40:50.469 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.469 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:37 GMT 2023-11-02T09:40:50.470 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/48 2023-11-02T09:40:50.470 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.470 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:Hr6K+mhdGc1c7UI4jy5vEU19GMk= 2023-11-02T09:40:50.470 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '9v5+f9LWzTwUXacIYnNtvw==', 'Content-Length': '3012545', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:37 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:Hr6K+mhdGc1c7UI4jy5vEU19GMk='} 2023-11-02T09:40:50.470 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/49 2023-11-02T09:40:50.471 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/49 2023-11-02T09:40:50.471 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.471 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/49 2023-11-02T09:40:50.471 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.472 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'Pm/ztqLc48wawah/rLg/2g==', 'Content-Length': '3012559', 'Expect': '100-Continue'} 2023-11-02T09:40:50.472 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.472 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.472 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.472 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:50.473 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.473 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.473 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.473 INFO:teuthology.orchestra.run.smithi156.stderr:Pm/ztqLc48wawah/rLg/2g== 2023-11-02T09:40:50.473 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.474 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:37 GMT 2023-11-02T09:40:50.474 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/49 2023-11-02T09:40:50.474 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.474 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:Yr/6Ul21/AAM4nuv68dyYAGIvig= 2023-11-02T09:40:50.474 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'Pm/ztqLc48wawah/rLg/2g==', 'Content-Length': '3012559', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:37 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:Yr/6Ul21/AAM4nuv68dyYAGIvig='} 2023-11-02T09:40:50.475 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/52 2023-11-02T09:40:50.475 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/52 2023-11-02T09:40:50.475 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.475 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/52 2023-11-02T09:40:50.476 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.476 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'CZU7Ddbjb96XLS4x+cYrMQ==', 'Content-Length': '3011439', 'Expect': '100-Continue'} 2023-11-02T09:40:50.476 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.476 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.476 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.477 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:50.477 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.477 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.477 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.477 INFO:teuthology.orchestra.run.smithi156.stderr:CZU7Ddbjb96XLS4x+cYrMQ== 2023-11-02T09:40:50.478 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.478 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:37 GMT 2023-11-02T09:40:50.478 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/52 2023-11-02T09:40:50.478 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.478 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:PS5dg0aRPHU9m8CW8DhdSsII7F4= 2023-11-02T09:40:50.479 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'CZU7Ddbjb96XLS4x+cYrMQ==', 'Content-Length': '3011439', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:37 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:PS5dg0aRPHU9m8CW8DhdSsII7F4='} 2023-11-02T09:40:50.479 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"83110247f72fb41dc3560b7b5e40b200"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a9e83858f1f89032-0065436c79-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:37 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.479 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"c49246d62c2fd4bfa19dc6803784f7c3"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000019fa78742e0acb79-0065436c79-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:37 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.479 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"717331ce6efac34d8c877ad587119113"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000004dd63fa82282b4ff-0065436c79-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:37 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.480 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/51 2023-11-02T09:40:50.480 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/51 2023-11-02T09:40:50.480 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.480 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/51 2023-11-02T09:40:50.480 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.481 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'VvXKoC/9aADk8ido6pzqgQ==', 'Content-Length': '3009686', 'Expect': '100-Continue'} 2023-11-02T09:40:50.481 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.481 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.481 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.481 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.483 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.483 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.483 INFO:teuthology.orchestra.run.smithi156.stderr:VvXKoC/9aADk8ido6pzqgQ== 2023-11-02T09:40:50.484 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.484 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:37 GMT 2023-11-02T09:40:50.484 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/51 2023-11-02T09:40:50.484 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.484 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:O+2G0z9cT0DoYh5KqVV7pd3nWPE= 2023-11-02T09:40:50.485 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'VvXKoC/9aADk8ido6pzqgQ==', 'Content-Length': '3009686', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:37 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:O+2G0z9cT0DoYh5KqVV7pd3nWPE='} 2023-11-02T09:40:50.485 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/50 2023-11-02T09:40:50.485 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/50 2023-11-02T09:40:50.485 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.485 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/50 2023-11-02T09:40:50.486 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.486 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'LKqlvjdSICoT+yG+4L/KYw==', 'Content-Length': '3008492', 'Expect': '100-Continue'} 2023-11-02T09:40:50.486 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.486 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.487 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.487 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.487 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.487 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.487 INFO:teuthology.orchestra.run.smithi156.stderr:LKqlvjdSICoT+yG+4L/KYw== 2023-11-02T09:40:50.488 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.488 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:37 GMT 2023-11-02T09:40:50.488 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/50 2023-11-02T09:40:50.488 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.488 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:+Bl9eN/4EC9RN0PPBOxQLorZ7Jg= 2023-11-02T09:40:50.488 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'LKqlvjdSICoT+yG+4L/KYw==', 'Content-Length': '3008492', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:37 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:+Bl9eN/4EC9RN0PPBOxQLorZ7Jg='} 2023-11-02T09:40:50.489 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"e45e392e9df86ec9e4ea10cb44ca61c0"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b54afe26c7be336c-0065436c79-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:37 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.489 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/54 2023-11-02T09:40:50.489 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/54 2023-11-02T09:40:50.490 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.490 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/54 2023-11-02T09:40:50.490 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.490 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '/FlwSzesH5gwwN4FrOn/BA==', 'Content-Length': '3009484', 'Expect': '100-Continue'} 2023-11-02T09:40:50.491 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.491 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.491 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.491 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.491 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.492 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.493 INFO:teuthology.orchestra.run.smithi156.stderr:/FlwSzesH5gwwN4FrOn/BA== 2023-11-02T09:40:50.493 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.493 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:37 GMT 2023-11-02T09:40:50.493 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/54 2023-11-02T09:40:50.494 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.494 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:OLJqmVTpXaFmQheEZvwtqPJdl2s= 2023-11-02T09:40:50.494 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '/FlwSzesH5gwwN4FrOn/BA==', 'Content-Length': '3009484', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:37 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:OLJqmVTpXaFmQheEZvwtqPJdl2s='} 2023-11-02T09:40:50.494 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/53 2023-11-02T09:40:50.494 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/53 2023-11-02T09:40:50.495 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.495 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/53 2023-11-02T09:40:50.495 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.495 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'mxLkLXEPU2LG5DegcCDj8Q==', 'Content-Length': '3011494', 'Expect': '100-Continue'} 2023-11-02T09:40:50.495 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.496 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.496 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.496 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.496 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.496 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.497 INFO:teuthology.orchestra.run.smithi156.stderr:mxLkLXEPU2LG5DegcCDj8Q== 2023-11-02T09:40:50.497 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.497 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:37 GMT 2023-11-02T09:40:50.497 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/53 2023-11-02T09:40:50.497 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.497 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:dnOsloroxP1eeAxO9RPtDR9mSEs= 2023-11-02T09:40:50.498 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'mxLkLXEPU2LG5DegcCDj8Q==', 'Content-Length': '3011494', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:37 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:dnOsloroxP1eeAxO9RPtDR9mSEs='} 2023-11-02T09:40:50.498 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/58 2023-11-02T09:40:50.498 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/58 2023-11-02T09:40:50.498 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.499 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/58 2023-11-02T09:40:50.499 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.499 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'Zgt/M2lHIu7zJodk3/tUsw==', 'Content-Length': '3010811', 'Expect': '100-Continue'} 2023-11-02T09:40:50.499 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.499 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.500 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.500 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:50.500 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.506 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.506 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.506 INFO:teuthology.orchestra.run.smithi156.stderr:Zgt/M2lHIu7zJodk3/tUsw== 2023-11-02T09:40:50.506 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.506 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:37 GMT 2023-11-02T09:40:50.507 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/58 2023-11-02T09:40:50.507 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.507 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:Zu0Akh7s33+iVG0bOmROCs90yyg= 2023-11-02T09:40:50.507 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'Zgt/M2lHIu7zJodk3/tUsw==', 'Content-Length': '3010811', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:37 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:Zu0Akh7s33+iVG0bOmROCs90yyg='} 2023-11-02T09:40:50.507 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"3dc4a1b2aa3dde9a84860e0fb5e0b078"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000361270ab10feda6-0065436c79-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:37 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.508 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/57 2023-11-02T09:40:50.508 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/57 2023-11-02T09:40:50.508 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.508 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/57 2023-11-02T09:40:50.508 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.509 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lfsrTLXRBBmVKnygoQlx8w==', 'Content-Length': '3010884', 'Expect': '100-Continue'} 2023-11-02T09:40:50.509 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.509 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.509 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.509 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.510 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.510 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.510 INFO:teuthology.orchestra.run.smithi156.stderr:lfsrTLXRBBmVKnygoQlx8w== 2023-11-02T09:40:50.510 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.510 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:38 GMT 2023-11-02T09:40:50.511 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/57 2023-11-02T09:40:50.511 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.511 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:3FrzJYSdESDrxPa00TyI5UQ8ZAs= 2023-11-02T09:40:50.511 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lfsrTLXRBBmVKnygoQlx8w==', 'Content-Length': '3010884', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:38 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:3FrzJYSdESDrxPa00TyI5UQ8ZAs='} 2023-11-02T09:40:50.511 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/56 2023-11-02T09:40:50.512 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/56 2023-11-02T09:40:50.512 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.512 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/56 2023-11-02T09:40:50.512 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.512 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '2NYYVuRDpTaVVT/Y7owHqw==', 'Content-Length': '3011463', 'Expect': '100-Continue'} 2023-11-02T09:40:50.513 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.513 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.513 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.513 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:50.513 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.514 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.514 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.514 INFO:teuthology.orchestra.run.smithi156.stderr:2NYYVuRDpTaVVT/Y7owHqw== 2023-11-02T09:40:50.514 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.514 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:38 GMT 2023-11-02T09:40:50.515 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/56 2023-11-02T09:40:50.515 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.515 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:L7WQT/Nbh5aFfEZ+pyOUBUcSLwE= 2023-11-02T09:40:50.515 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '2NYYVuRDpTaVVT/Y7owHqw==', 'Content-Length': '3011463', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:38 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:L7WQT/Nbh5aFfEZ+pyOUBUcSLwE='} 2023-11-02T09:40:50.515 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/55 2023-11-02T09:40:50.516 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/55 2023-11-02T09:40:50.516 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.516 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/55 2023-11-02T09:40:50.516 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.517 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'N4mgMUgTEYlkAV0cH96GhQ==', 'Content-Length': '3009629', 'Expect': '100-Continue'} 2023-11-02T09:40:50.517 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.517 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.517 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.517 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:50.517 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.518 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.518 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.518 INFO:teuthology.orchestra.run.smithi156.stderr:N4mgMUgTEYlkAV0cH96GhQ== 2023-11-02T09:40:50.518 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.518 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:38 GMT 2023-11-02T09:40:50.519 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/55 2023-11-02T09:40:50.519 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.519 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:QFf2n7Sdx8GlCC/Y+4TJl5pm7bw= 2023-11-02T09:40:50.519 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'N4mgMUgTEYlkAV0cH96GhQ==', 'Content-Length': '3009629', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:38 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:QFf2n7Sdx8GlCC/Y+4TJl5pm7bw='} 2023-11-02T09:40:50.519 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"2d990fc14947bb6d4d8a4c0d4891bfb4"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000001af743d75331401a-0065436c79-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.520 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/60 2023-11-02T09:40:50.520 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/60 2023-11-02T09:40:50.520 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.520 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/60 2023-11-02T09:40:50.520 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.521 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'q8QsvEc5YQUfrSoviArNEA==', 'Content-Length': '3009571', 'Expect': '100-Continue'} 2023-11-02T09:40:50.521 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.521 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.521 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.521 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.522 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.522 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.522 INFO:teuthology.orchestra.run.smithi156.stderr:q8QsvEc5YQUfrSoviArNEA== 2023-11-02T09:40:50.522 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.522 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:38 GMT 2023-11-02T09:40:50.523 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/60 2023-11-02T09:40:50.523 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.523 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:G6MK1Vamm0EsEXOxevkpeXbjwVo= 2023-11-02T09:40:50.523 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'q8QsvEc5YQUfrSoviArNEA==', 'Content-Length': '3009571', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:38 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:G6MK1Vamm0EsEXOxevkpeXbjwVo='} 2023-11-02T09:40:50.524 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"aeedc952682f9619d55b3adc5b9a4c42"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000de32cc7239512501-0065436c79-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.524 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/59 2023-11-02T09:40:50.524 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/59 2023-11-02T09:40:50.524 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.525 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/59 2023-11-02T09:40:50.525 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.525 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'z3l8Gy3FbAJ5J29lK8GeUQ==', 'Content-Length': '3009143', 'Expect': '100-Continue'} 2023-11-02T09:40:50.525 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.526 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.526 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.526 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.526 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.526 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.527 INFO:teuthology.orchestra.run.smithi156.stderr:z3l8Gy3FbAJ5J29lK8GeUQ== 2023-11-02T09:40:50.527 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.527 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:38 GMT 2023-11-02T09:40:50.527 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/59 2023-11-02T09:40:50.527 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.528 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:M5OOlmFzr8+6SMBk/8HOQNGCYIM= 2023-11-02T09:40:50.528 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'z3l8Gy3FbAJ5J29lK8GeUQ==', 'Content-Length': '3009143', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:38 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:M5OOlmFzr8+6SMBk/8HOQNGCYIM='} 2023-11-02T09:40:50.528 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"2bd4ac247feaddfa8e1693aac5ef9d00"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000301d2c81d636183a-0065436c79-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.528 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/61 2023-11-02T09:40:50.528 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/61 2023-11-02T09:40:50.529 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.529 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/61 2023-11-02T09:40:50.529 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.529 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'IGRvHVrk5BPwE1O+eVc8aw==', 'Content-Length': '3011233', 'Expect': '100-Continue'} 2023-11-02T09:40:50.529 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.530 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.530 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.530 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.530 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.530 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.531 INFO:teuthology.orchestra.run.smithi156.stderr:IGRvHVrk5BPwE1O+eVc8aw== 2023-11-02T09:40:50.531 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.531 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:38 GMT 2023-11-02T09:40:50.531 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/61 2023-11-02T09:40:50.531 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.532 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:KNI1fWrlA0lQS7cBtbhKFuhR5d0= 2023-11-02T09:40:50.532 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'IGRvHVrk5BPwE1O+eVc8aw==', 'Content-Length': '3011233', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:38 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:KNI1fWrlA0lQS7cBtbhKFuhR5d0='} 2023-11-02T09:40:50.532 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/62 2023-11-02T09:40:50.532 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/62 2023-11-02T09:40:50.532 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.533 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/62 2023-11-02T09:40:50.533 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.533 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'NDR6YYXUM3mNLq14w6nz0w==', 'Content-Length': '3010634', 'Expect': '100-Continue'} 2023-11-02T09:40:50.533 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.533 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.533 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.534 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:50.534 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.534 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.534 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.534 INFO:teuthology.orchestra.run.smithi156.stderr:NDR6YYXUM3mNLq14w6nz0w== 2023-11-02T09:40:50.535 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.535 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:38 GMT 2023-11-02T09:40:50.535 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/62 2023-11-02T09:40:50.535 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.535 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:FEpuB42T7kjCBjqS+7Asx/5/Z5Y= 2023-11-02T09:40:50.536 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'NDR6YYXUM3mNLq14w6nz0w==', 'Content-Length': '3010634', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:38 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:FEpuB42T7kjCBjqS+7Asx/5/Z5Y='} 2023-11-02T09:40:50.536 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/64 2023-11-02T09:40:50.536 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/64 2023-11-02T09:40:50.536 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.536 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/64 2023-11-02T09:40:50.537 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.537 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'RfBRJ0bXiFlCDDi8A71hcA==', 'Content-Length': '3012154', 'Expect': '100-Continue'} 2023-11-02T09:40:50.537 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.537 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.537 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.538 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:50.538 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.538 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.538 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.538 INFO:teuthology.orchestra.run.smithi156.stderr:RfBRJ0bXiFlCDDi8A71hcA== 2023-11-02T09:40:50.541 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.542 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:38 GMT 2023-11-02T09:40:50.542 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/64 2023-11-02T09:40:50.542 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.542 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:eJrkEauDhFLQprtihzvs9tGZO5A= 2023-11-02T09:40:50.543 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'RfBRJ0bXiFlCDDi8A71hcA==', 'Content-Length': '3012154', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:38 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:eJrkEauDhFLQprtihzvs9tGZO5A='} 2023-11-02T09:40:50.543 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/67 2023-11-02T09:40:50.543 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/67 2023-11-02T09:40:50.543 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.544 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/67 2023-11-02T09:40:50.544 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.544 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'xwSug5v3iZtu94fXnvQTPQ==', 'Content-Length': '3011238', 'Expect': '100-Continue'} 2023-11-02T09:40:50.544 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.545 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.545 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.546 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:50.546 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.546 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.546 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.547 INFO:teuthology.orchestra.run.smithi156.stderr:xwSug5v3iZtu94fXnvQTPQ== 2023-11-02T09:40:50.547 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.547 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:38 GMT 2023-11-02T09:40:50.547 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/67 2023-11-02T09:40:50.547 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.548 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:Nn3TpLWOC221x45mirx+nsMI3jM= 2023-11-02T09:40:50.548 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'xwSug5v3iZtu94fXnvQTPQ==', 'Content-Length': '3011238', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:38 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:Nn3TpLWOC221x45mirx+nsMI3jM='} 2023-11-02T09:40:50.548 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"5b8e4b795d7480eadd50812e8431b550"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000f9e4e83a5f04e2df-0065436c79-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.548 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/63 2023-11-02T09:40:50.548 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/63 2023-11-02T09:40:50.549 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.549 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/63 2023-11-02T09:40:50.549 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.549 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'JncQbjyDAyYcxfoG4nMDdg==', 'Content-Length': '3011316', 'Expect': '100-Continue'} 2023-11-02T09:40:50.550 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.550 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.550 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.550 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.550 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.551 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.551 INFO:teuthology.orchestra.run.smithi156.stderr:JncQbjyDAyYcxfoG4nMDdg== 2023-11-02T09:40:50.551 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.551 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:38 GMT 2023-11-02T09:40:50.551 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/63 2023-11-02T09:40:50.552 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.552 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:btLtuILS1C7TTzUmgWQssz+cjAE= 2023-11-02T09:40:50.552 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'JncQbjyDAyYcxfoG4nMDdg==', 'Content-Length': '3011316', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:38 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:btLtuILS1C7TTzUmgWQssz+cjAE='} 2023-11-02T09:40:50.552 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/65 2023-11-02T09:40:50.552 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/65 2023-11-02T09:40:50.553 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.553 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/65 2023-11-02T09:40:50.553 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.553 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'zb+LXfWDIHONWXbL0RcLBQ==', 'Content-Length': '3011274', 'Expect': '100-Continue'} 2023-11-02T09:40:50.553 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.554 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.554 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.554 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:50.554 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.555 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.555 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.555 INFO:teuthology.orchestra.run.smithi156.stderr:zb+LXfWDIHONWXbL0RcLBQ== 2023-11-02T09:40:50.555 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.555 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:38 GMT 2023-11-02T09:40:50.555 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/65 2023-11-02T09:40:50.556 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.556 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:ISXFBBtl/KaR6+ci2r3YphbzoaQ= 2023-11-02T09:40:50.556 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'zb+LXfWDIHONWXbL0RcLBQ==', 'Content-Length': '3011274', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:38 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:ISXFBBtl/KaR6+ci2r3YphbzoaQ='} 2023-11-02T09:40:50.556 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/66 2023-11-02T09:40:50.556 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/66 2023-11-02T09:40:50.557 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.557 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/66 2023-11-02T09:40:50.557 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.557 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'HbjzJy5nlPnh8Mf+Sx5kIQ==', 'Content-Length': '3013417', 'Expect': '100-Continue'} 2023-11-02T09:40:50.558 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.558 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.558 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.558 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:50.558 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.559 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.559 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.559 INFO:teuthology.orchestra.run.smithi156.stderr:HbjzJy5nlPnh8Mf+Sx5kIQ== 2023-11-02T09:40:50.559 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.559 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:38 GMT 2023-11-02T09:40:50.560 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/66 2023-11-02T09:40:50.560 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.560 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:tCfXif+GDWOT+sL+pf/kfK6axUY= 2023-11-02T09:40:50.560 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'HbjzJy5nlPnh8Mf+Sx5kIQ==', 'Content-Length': '3013417', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:38 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:tCfXif+GDWOT+sL+pf/kfK6axUY='} 2023-11-02T09:40:50.560 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/68 2023-11-02T09:40:50.561 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/68 2023-11-02T09:40:50.561 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.561 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/68 2023-11-02T09:40:50.561 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.561 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'cQ993fV3reZR1U26+moHXQ==', 'Content-Length': '3009723', 'Expect': '100-Continue'} 2023-11-02T09:40:50.562 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.562 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.562 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.562 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:50.562 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.563 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.563 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.563 INFO:teuthology.orchestra.run.smithi156.stderr:cQ993fV3reZR1U26+moHXQ== 2023-11-02T09:40:50.563 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.563 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:38 GMT 2023-11-02T09:40:50.564 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/68 2023-11-02T09:40:50.564 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.564 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:TrJdMrLmSe8JtgVAilIVvc9kf4g= 2023-11-02T09:40:50.564 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'cQ993fV3reZR1U26+moHXQ==', 'Content-Length': '3009723', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:38 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:TrJdMrLmSe8JtgVAilIVvc9kf4g='} 2023-11-02T09:40:50.564 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/70 2023-11-02T09:40:50.565 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/70 2023-11-02T09:40:50.565 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.565 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/70 2023-11-02T09:40:50.565 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.565 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'q8WUzdvICjMR8lT0UPW36A==', 'Content-Length': '3010899', 'Expect': '100-Continue'} 2023-11-02T09:40:50.566 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.566 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.566 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.566 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:50.566 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.567 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.567 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.567 INFO:teuthology.orchestra.run.smithi156.stderr:q8WUzdvICjMR8lT0UPW36A== 2023-11-02T09:40:50.567 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.567 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:38 GMT 2023-11-02T09:40:50.568 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/70 2023-11-02T09:40:50.568 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.568 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:7ikbOoQ0rShutLwOQ4ZhKK8+VXs= 2023-11-02T09:40:50.568 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'q8WUzdvICjMR8lT0UPW36A==', 'Content-Length': '3010899', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:38 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:7ikbOoQ0rShutLwOQ4ZhKK8+VXs='} 2023-11-02T09:40:50.568 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"775edeb1ee5864218eed62627e322539"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ebc3aad1c6fc5906-0065436c79-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.570 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"1df632fb83a1198eaf43ac07ee693c2b"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000008c81109028cad549-0065436c79-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.570 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"09ec6ff653d227bcf44b85ebd5af7d63"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000008d4222eb2cfeb55d-0065436c79-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.570 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"b7afca6c339a1e187d51a6cd29e9b3ef"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000817d0d8cec172079-0065436c79-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.570 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/69 2023-11-02T09:40:50.571 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/69 2023-11-02T09:40:50.571 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.571 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/69 2023-11-02T09:40:50.571 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.571 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'g7A6A5p/B7EbOxes4OdALg==', 'Content-Length': '3011620', 'Expect': '100-Continue'} 2023-11-02T09:40:50.572 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.572 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.572 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.572 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.572 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.573 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.573 INFO:teuthology.orchestra.run.smithi156.stderr:g7A6A5p/B7EbOxes4OdALg== 2023-11-02T09:40:50.573 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.573 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:38 GMT 2023-11-02T09:40:50.574 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/69 2023-11-02T09:40:50.574 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.574 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:8Lxbjr9oAzncubTWEC7IkpP35Xo= 2023-11-02T09:40:50.574 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'g7A6A5p/B7EbOxes4OdALg==', 'Content-Length': '3011620', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:38 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:8Lxbjr9oAzncubTWEC7IkpP35Xo='} 2023-11-02T09:40:50.575 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/71 2023-11-02T09:40:50.575 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/71 2023-11-02T09:40:50.575 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.575 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/71 2023-11-02T09:40:50.575 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.575 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'gGbd7nLiNW/qgsfyxjuVJg==', 'Content-Length': '3010765', 'Expect': '100-Continue'} 2023-11-02T09:40:50.576 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.576 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.576 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.576 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.576 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.577 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.577 INFO:teuthology.orchestra.run.smithi156.stderr:gGbd7nLiNW/qgsfyxjuVJg== 2023-11-02T09:40:50.577 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.577 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:38 GMT 2023-11-02T09:40:50.577 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/71 2023-11-02T09:40:50.578 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.578 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:TxJqrNvya7AxcqfAkpWFEpnPR/s= 2023-11-02T09:40:50.578 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'gGbd7nLiNW/qgsfyxjuVJg==', 'Content-Length': '3010765', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:38 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:TxJqrNvya7AxcqfAkpWFEpnPR/s='} 2023-11-02T09:40:50.578 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/72 2023-11-02T09:40:50.579 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/72 2023-11-02T09:40:50.579 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.579 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/72 2023-11-02T09:40:50.579 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.579 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'a/DxQJ/kFqjnKmfTnY7bJQ==', 'Content-Length': '3008010', 'Expect': '100-Continue'} 2023-11-02T09:40:50.580 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.580 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.580 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.580 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.580 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.581 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.581 INFO:teuthology.orchestra.run.smithi156.stderr:a/DxQJ/kFqjnKmfTnY7bJQ== 2023-11-02T09:40:50.581 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.581 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:38 GMT 2023-11-02T09:40:50.581 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/72 2023-11-02T09:40:50.582 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.582 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:BNxU+YOmviK6zrrErkBESbye3s0= 2023-11-02T09:40:50.582 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'a/DxQJ/kFqjnKmfTnY7bJQ==', 'Content-Length': '3008010', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:38 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:BNxU+YOmviK6zrrErkBESbye3s0='} 2023-11-02T09:40:50.582 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/74 2023-11-02T09:40:50.582 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/74 2023-11-02T09:40:50.583 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.583 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/74 2023-11-02T09:40:50.583 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.583 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'm/chINiGpUm+a1HkFZNiNA==', 'Content-Length': '3009999', 'Expect': '100-Continue'} 2023-11-02T09:40:50.583 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.584 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.584 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.584 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.584 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.584 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.584 INFO:teuthology.orchestra.run.smithi156.stderr:m/chINiGpUm+a1HkFZNiNA== 2023-11-02T09:40:50.585 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.585 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:38 GMT 2023-11-02T09:40:50.585 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/74 2023-11-02T09:40:50.585 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.585 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:f1929zA/ndWhgSrmgXsLoEN/BDk= 2023-11-02T09:40:50.586 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'm/chINiGpUm+a1HkFZNiNA==', 'Content-Length': '3009999', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:38 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:f1929zA/ndWhgSrmgXsLoEN/BDk='} 2023-11-02T09:40:50.586 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/73 2023-11-02T09:40:50.586 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/73 2023-11-02T09:40:50.586 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.587 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/73 2023-11-02T09:40:50.587 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.587 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'dkpakJjGdJ4t/qDaCR4CMg==', 'Content-Length': '3010709', 'Expect': '100-Continue'} 2023-11-02T09:40:50.587 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.587 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.587 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.588 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:50.588 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.588 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.588 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.588 INFO:teuthology.orchestra.run.smithi156.stderr:dkpakJjGdJ4t/qDaCR4CMg== 2023-11-02T09:40:50.589 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.589 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:38 GMT 2023-11-02T09:40:50.589 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/73 2023-11-02T09:40:50.589 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.589 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:K6AaqngQSu83Xva4PmfRs1oYJu8= 2023-11-02T09:40:50.590 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'dkpakJjGdJ4t/qDaCR4CMg==', 'Content-Length': '3010709', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:38 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:K6AaqngQSu83Xva4PmfRs1oYJu8='} 2023-11-02T09:40:50.590 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"bbe3818f0a21cd80edd02b1085935a7a"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d12600a0e751f88f-0065436c79-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.590 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/78 2023-11-02T09:40:50.590 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/78 2023-11-02T09:40:50.590 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.591 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/78 2023-11-02T09:40:50.591 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.591 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'ReOFWchj/dCSQq864U0/0A==', 'Content-Length': '3009792', 'Expect': '100-Continue'} 2023-11-02T09:40:50.591 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.591 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.592 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.592 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.592 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.592 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.592 INFO:teuthology.orchestra.run.smithi156.stderr:ReOFWchj/dCSQq864U0/0A== 2023-11-02T09:40:50.593 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.593 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:38 GMT 2023-11-02T09:40:50.593 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/78 2023-11-02T09:40:50.593 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.594 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:9jIKHcEfJXa+rd35Q+6ArfoDzlQ= 2023-11-02T09:40:50.594 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'ReOFWchj/dCSQq864U0/0A==', 'Content-Length': '3009792', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:38 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:9jIKHcEfJXa+rd35Q+6ArfoDzlQ='} 2023-11-02T09:40:50.594 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"ac780958d54ddb92dc5b9bc11f215517"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000062cffb3afdaf7da7-0065436c79-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.594 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/76 2023-11-02T09:40:50.595 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/76 2023-11-02T09:40:50.595 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.595 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/76 2023-11-02T09:40:50.595 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.595 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'QYRWI05Nr6b8FtMqLa+h4g==', 'Content-Length': '3009946', 'Expect': '100-Continue'} 2023-11-02T09:40:50.595 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.596 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.596 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.596 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.596 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.596 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.597 INFO:teuthology.orchestra.run.smithi156.stderr:QYRWI05Nr6b8FtMqLa+h4g== 2023-11-02T09:40:50.597 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.599 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:38 GMT 2023-11-02T09:40:50.599 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/76 2023-11-02T09:40:50.599 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.600 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:1+GMgXyZKxXPvUhhOB6BEmIJTro= 2023-11-02T09:40:50.600 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'QYRWI05Nr6b8FtMqLa+h4g==', 'Content-Length': '3009946', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:38 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:1+GMgXyZKxXPvUhhOB6BEmIJTro='} 2023-11-02T09:40:50.600 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/77 2023-11-02T09:40:50.600 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/77 2023-11-02T09:40:50.600 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.601 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/77 2023-11-02T09:40:50.601 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.601 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'tqYkrhO1fSTYYY/EngEDpQ==', 'Content-Length': '3009958', 'Expect': '100-Continue'} 2023-11-02T09:40:50.601 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.602 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.602 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.602 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:50.602 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.602 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.603 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.603 INFO:teuthology.orchestra.run.smithi156.stderr:tqYkrhO1fSTYYY/EngEDpQ== 2023-11-02T09:40:50.603 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.603 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:38 GMT 2023-11-02T09:40:50.604 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/77 2023-11-02T09:40:50.604 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.604 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:zVTC9yQIY3mJvCtgLzjcsMSpyPk= 2023-11-02T09:40:50.604 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'tqYkrhO1fSTYYY/EngEDpQ==', 'Content-Length': '3009958', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:38 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:zVTC9yQIY3mJvCtgLzjcsMSpyPk='} 2023-11-02T09:40:50.604 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/75 2023-11-02T09:40:50.605 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/75 2023-11-02T09:40:50.605 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.605 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/75 2023-11-02T09:40:50.605 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.605 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '5Dvj+ljuOsJsy8TSPy6QoQ==', 'Content-Length': '3010941', 'Expect': '100-Continue'} 2023-11-02T09:40:50.606 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.606 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.606 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.606 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:50.606 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.607 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.607 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.607 INFO:teuthology.orchestra.run.smithi156.stderr:5Dvj+ljuOsJsy8TSPy6QoQ== 2023-11-02T09:40:50.607 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.607 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:38 GMT 2023-11-02T09:40:50.608 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/75 2023-11-02T09:40:50.608 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.608 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:BWK0H9zRfpxdN1QLy0d5Tw7wJq4= 2023-11-02T09:40:50.608 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '5Dvj+ljuOsJsy8TSPy6QoQ==', 'Content-Length': '3010941', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:38 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:BWK0H9zRfpxdN1QLy0d5Tw7wJq4='} 2023-11-02T09:40:50.608 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/83 2023-11-02T09:40:50.609 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/83 2023-11-02T09:40:50.609 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.609 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/83 2023-11-02T09:40:50.609 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.609 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'QWoaWwCaR3UGkEFDAHHrcg==', 'Content-Length': '3011279', 'Expect': '100-Continue'} 2023-11-02T09:40:50.610 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.610 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.610 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.610 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:50.610 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.611 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.611 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.611 INFO:teuthology.orchestra.run.smithi156.stderr:QWoaWwCaR3UGkEFDAHHrcg== 2023-11-02T09:40:50.611 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.612 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:38 GMT 2023-11-02T09:40:50.612 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/83 2023-11-02T09:40:50.612 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.612 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:VLVu2IqAPRB0/hNSebweqLbI7po= 2023-11-02T09:40:50.612 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'QWoaWwCaR3UGkEFDAHHrcg==', 'Content-Length': '3011279', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:38 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:VLVu2IqAPRB0/hNSebweqLbI7po='} 2023-11-02T09:40:50.612 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"d1641eab4d1287152d51112ee4a48b05"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e66da4eeb71b76ef-0065436c79-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.613 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/80 2023-11-02T09:40:50.613 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/80 2023-11-02T09:40:50.613 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.613 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/80 2023-11-02T09:40:50.613 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.614 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'pZYXGc1DKAM+YUXCqhTSOw==', 'Content-Length': '3012514', 'Expect': '100-Continue'} 2023-11-02T09:40:50.614 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.614 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.614 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.615 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.615 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.615 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.615 INFO:teuthology.orchestra.run.smithi156.stderr:pZYXGc1DKAM+YUXCqhTSOw== 2023-11-02T09:40:50.615 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.616 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:38 GMT 2023-11-02T09:40:50.616 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/80 2023-11-02T09:40:50.616 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.616 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:r2WqsX0t06Ukl7d3PyCskvuxQSU= 2023-11-02T09:40:50.617 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'pZYXGc1DKAM+YUXCqhTSOw==', 'Content-Length': '3012514', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:38 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:r2WqsX0t06Ukl7d3PyCskvuxQSU='} 2023-11-02T09:40:50.617 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/79 2023-11-02T09:40:50.617 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/79 2023-11-02T09:40:50.617 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.617 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/79 2023-11-02T09:40:50.617 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.618 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'oVcTB1pKpzg/gIljSwcMWA==', 'Content-Length': '3010254', 'Expect': '100-Continue'} 2023-11-02T09:40:50.618 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.618 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.618 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.618 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:50.619 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.619 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.619 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.619 INFO:teuthology.orchestra.run.smithi156.stderr:oVcTB1pKpzg/gIljSwcMWA== 2023-11-02T09:40:50.619 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.620 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:38 GMT 2023-11-02T09:40:50.620 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/79 2023-11-02T09:40:50.620 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.620 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:htWQtL0B9xUmMw0nUpFnJm7QY60= 2023-11-02T09:40:50.620 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'oVcTB1pKpzg/gIljSwcMWA==', 'Content-Length': '3010254', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:38 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:htWQtL0B9xUmMw0nUpFnJm7QY60='} 2023-11-02T09:40:50.621 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/84 2023-11-02T09:40:50.621 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/84 2023-11-02T09:40:50.621 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.621 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/84 2023-11-02T09:40:50.621 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.622 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'z96tQ33+DeRj8aC8mcZBPw==', 'Content-Length': '3011100', 'Expect': '100-Continue'} 2023-11-02T09:40:50.622 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.622 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.622 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.622 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:50.623 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.623 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.623 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.623 INFO:teuthology.orchestra.run.smithi156.stderr:z96tQ33+DeRj8aC8mcZBPw== 2023-11-02T09:40:50.623 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.624 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:38 GMT 2023-11-02T09:40:50.624 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/84 2023-11-02T09:40:50.624 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.624 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:TwfFnC7cQ31bYbBRqPKEixbInRE= 2023-11-02T09:40:50.624 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'z96tQ33+DeRj8aC8mcZBPw==', 'Content-Length': '3011100', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:38 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:TwfFnC7cQ31bYbBRqPKEixbInRE='} 2023-11-02T09:40:50.625 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"462a7320adbe803477a7008a55824177"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a86469f50f41b9bc-0065436c79-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.625 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/82 2023-11-02T09:40:50.625 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/82 2023-11-02T09:40:50.625 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.625 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/82 2023-11-02T09:40:50.626 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.626 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'xO5wlga3mT+uu5ccTRZM7Q==', 'Content-Length': '3007901', 'Expect': '100-Continue'} 2023-11-02T09:40:50.626 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.626 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.627 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.627 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.627 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.627 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.627 INFO:teuthology.orchestra.run.smithi156.stderr:xO5wlga3mT+uu5ccTRZM7Q== 2023-11-02T09:40:50.628 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.628 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:38 GMT 2023-11-02T09:40:50.628 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/82 2023-11-02T09:40:50.628 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.628 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:bJmE0UkJtbkL7P/1MyRaDXfYjcU= 2023-11-02T09:40:50.629 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'xO5wlga3mT+uu5ccTRZM7Q==', 'Content-Length': '3007901', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:38 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:bJmE0UkJtbkL7P/1MyRaDXfYjcU='} 2023-11-02T09:40:50.629 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"6114a937c63d9635d66a3bbaa767d62f"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ed6e47c3909d8eb0-0065436c79-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.629 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/81 2023-11-02T09:40:50.629 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/81 2023-11-02T09:40:50.629 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.630 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/81 2023-11-02T09:40:50.630 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.630 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '4oOlKM5f+0gkGc/tXc9D+g==', 'Content-Length': '3010711', 'Expect': '100-Continue'} 2023-11-02T09:40:50.630 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.630 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.631 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.631 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.631 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.631 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.631 INFO:teuthology.orchestra.run.smithi156.stderr:4oOlKM5f+0gkGc/tXc9D+g== 2023-11-02T09:40:50.632 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.632 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:38 GMT 2023-11-02T09:40:50.632 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/81 2023-11-02T09:40:50.632 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.632 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:RamdV2yPtJlQ3S38npJWeRWq+RI= 2023-11-02T09:40:50.633 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '4oOlKM5f+0gkGc/tXc9D+g==', 'Content-Length': '3010711', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:38 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:RamdV2yPtJlQ3S38npJWeRWq+RI='} 2023-11-02T09:40:50.633 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"68dd6d2824d5c27c41b0523ecc305fa2"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000bfeaec16b0bad5b2-0065436c79-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.633 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/88 2023-11-02T09:40:50.633 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/88 2023-11-02T09:40:50.633 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.634 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/88 2023-11-02T09:40:50.634 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.634 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'YwGNskL4y+AG1N2fOhao8Q==', 'Content-Length': '3011687', 'Expect': '100-Continue'} 2023-11-02T09:40:50.634 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.634 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.635 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.635 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.635 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.635 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.635 INFO:teuthology.orchestra.run.smithi156.stderr:YwGNskL4y+AG1N2fOhao8Q== 2023-11-02T09:40:50.636 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.636 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:38 GMT 2023-11-02T09:40:50.636 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/88 2023-11-02T09:40:50.636 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.636 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:cwenXM7t4/ey4MZPFgrsRTyR94Q= 2023-11-02T09:40:50.637 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'YwGNskL4y+AG1N2fOhao8Q==', 'Content-Length': '3011687', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:38 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:cwenXM7t4/ey4MZPFgrsRTyR94Q='} 2023-11-02T09:40:50.637 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/86 2023-11-02T09:40:50.637 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/86 2023-11-02T09:40:50.637 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.638 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/86 2023-11-02T09:40:50.638 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.638 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '5PIKe6lmThf5GKsb7+dPDA==', 'Content-Length': '3007674', 'Expect': '100-Continue'} 2023-11-02T09:40:50.638 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.638 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.639 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.640 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:50.640 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.640 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.640 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.641 INFO:teuthology.orchestra.run.smithi156.stderr:5PIKe6lmThf5GKsb7+dPDA== 2023-11-02T09:40:50.641 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.641 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:38 GMT 2023-11-02T09:40:50.641 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/86 2023-11-02T09:40:50.642 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.642 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:84DhPjhtkPVfm8fKr0w4mZ0kk6U= 2023-11-02T09:40:50.642 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '5PIKe6lmThf5GKsb7+dPDA==', 'Content-Length': '3007674', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:38 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:84DhPjhtkPVfm8fKr0w4mZ0kk6U='} 2023-11-02T09:40:50.642 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"f2e3914f86287cd32484440cf3854d09"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000242f2f101ab97309-0065436c79-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.642 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/85 2023-11-02T09:40:50.643 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/85 2023-11-02T09:40:50.643 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.643 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/85 2023-11-02T09:40:50.643 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.643 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'A0fAOM0V9dP26mT++XNdqg==', 'Content-Length': '3011185', 'Expect': '100-Continue'} 2023-11-02T09:40:50.644 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.644 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.644 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.644 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.645 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.645 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.645 INFO:teuthology.orchestra.run.smithi156.stderr:A0fAOM0V9dP26mT++XNdqg== 2023-11-02T09:40:50.645 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.645 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:38 GMT 2023-11-02T09:40:50.646 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/85 2023-11-02T09:40:50.646 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.646 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:D2TfXjQvlnLiR1xFGbIb3B0hlQw= 2023-11-02T09:40:50.646 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'A0fAOM0V9dP26mT++XNdqg==', 'Content-Length': '3011185', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:38 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:D2TfXjQvlnLiR1xFGbIb3B0hlQw='} 2023-11-02T09:40:50.646 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/87 2023-11-02T09:40:50.647 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/87 2023-11-02T09:40:50.647 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.647 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/87 2023-11-02T09:40:50.647 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.647 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'fi1/elyJcDZN0RaYZLQf2g==', 'Content-Length': '3012459', 'Expect': '100-Continue'} 2023-11-02T09:40:50.648 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.648 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.648 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.648 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:50.648 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.649 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.649 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.649 INFO:teuthology.orchestra.run.smithi156.stderr:fi1/elyJcDZN0RaYZLQf2g== 2023-11-02T09:40:50.649 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.649 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:38 GMT 2023-11-02T09:40:50.650 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/87 2023-11-02T09:40:50.650 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.650 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:3BTSIlSArP8ZFA9noZo1eywKQDY= 2023-11-02T09:40:50.650 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'fi1/elyJcDZN0RaYZLQf2g==', 'Content-Length': '3012459', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:38 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:3BTSIlSArP8ZFA9noZo1eywKQDY='} 2023-11-02T09:40:50.650 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"b3cc45b72520d4eefacb846b8f0fe344"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000135d6d1d67d7f88a-0065436c79-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.651 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/89 2023-11-02T09:40:50.651 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/89 2023-11-02T09:40:50.651 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.651 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/89 2023-11-02T09:40:50.651 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.652 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '9jfuUjHi+UvJ7MjYX3N93Q==', 'Content-Length': '3013525', 'Expect': '100-Continue'} 2023-11-02T09:40:50.652 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.652 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.653 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.653 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.655 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.655 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.656 INFO:teuthology.orchestra.run.smithi156.stderr:9jfuUjHi+UvJ7MjYX3N93Q== 2023-11-02T09:40:50.656 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.657 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:38 GMT 2023-11-02T09:40:50.657 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/89 2023-11-02T09:40:50.657 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.657 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:3eAcXX9CTGMeM9uon93xD/fjHRA= 2023-11-02T09:40:50.658 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '9jfuUjHi+UvJ7MjYX3N93Q==', 'Content-Length': '3013525', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:38 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:3eAcXX9CTGMeM9uon93xD/fjHRA='} 2023-11-02T09:40:50.658 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"b05b54bfbf0f202f9d3bf1f0709a386d"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000bfcdd762c6babd8c-0065436c79-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.658 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/90 2023-11-02T09:40:50.658 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/90 2023-11-02T09:40:50.658 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.659 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/90 2023-11-02T09:40:50.659 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.659 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'IFKBVHN8Ek/FekQq1BoDCw==', 'Content-Length': '3010459', 'Expect': '100-Continue'} 2023-11-02T09:40:50.659 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.659 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.660 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.660 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.660 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.660 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.660 INFO:teuthology.orchestra.run.smithi156.stderr:IFKBVHN8Ek/FekQq1BoDCw== 2023-11-02T09:40:50.661 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.661 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:38 GMT 2023-11-02T09:40:50.661 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/90 2023-11-02T09:40:50.661 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.661 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:7mQtgPbgtFfck279dFQ9Ru2HQu4= 2023-11-02T09:40:50.662 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'IFKBVHN8Ek/FekQq1BoDCw==', 'Content-Length': '3010459', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:38 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:7mQtgPbgtFfck279dFQ9Ru2HQu4='} 2023-11-02T09:40:50.662 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"5308f2250bf9b9197a64d21f7e88346f"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ffa901c162c45ecf-0065436c79-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.662 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"9217fab7df4e02245b4435a3e45d12e7"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005327bd5c5f646e21-0065436c79-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.662 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/93 2023-11-02T09:40:50.663 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/93 2023-11-02T09:40:50.663 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.663 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/93 2023-11-02T09:40:50.663 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.664 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'TryMDBDhxro6e4Dwj4jowg==', 'Content-Length': '3010473', 'Expect': '100-Continue'} 2023-11-02T09:40:50.664 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.664 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.664 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.664 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.665 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.665 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.665 INFO:teuthology.orchestra.run.smithi156.stderr:TryMDBDhxro6e4Dwj4jowg== 2023-11-02T09:40:50.665 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.665 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:38 GMT 2023-11-02T09:40:50.666 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/93 2023-11-02T09:40:50.666 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.666 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:JuhM8cr3LeLD0LcKrNYMYV3koJM= 2023-11-02T09:40:50.666 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'TryMDBDhxro6e4Dwj4jowg==', 'Content-Length': '3010473', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:38 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:JuhM8cr3LeLD0LcKrNYMYV3koJM='} 2023-11-02T09:40:50.666 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"fb98808f3444e999189299c6c4510435"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000090f5c6e2abd3c534-0065436c79-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.667 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/92 2023-11-02T09:40:50.667 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/92 2023-11-02T09:40:50.667 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.667 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/92 2023-11-02T09:40:50.667 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.668 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'egRRqMKY7Zs4KBad/cDbJQ==', 'Content-Length': '3012915', 'Expect': '100-Continue'} 2023-11-02T09:40:50.668 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.668 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.668 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.668 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.669 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.669 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.669 INFO:teuthology.orchestra.run.smithi156.stderr:egRRqMKY7Zs4KBad/cDbJQ== 2023-11-02T09:40:50.669 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.669 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:38 GMT 2023-11-02T09:40:50.670 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/92 2023-11-02T09:40:50.670 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.670 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:tYec5J+HwdNouWVzOcmPWrrPFIs= 2023-11-02T09:40:50.670 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'egRRqMKY7Zs4KBad/cDbJQ==', 'Content-Length': '3012915', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:38 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:tYec5J+HwdNouWVzOcmPWrrPFIs='} 2023-11-02T09:40:50.671 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/91 2023-11-02T09:40:50.671 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/91 2023-11-02T09:40:50.671 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.671 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/91 2023-11-02T09:40:50.671 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.671 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '2eBIZNrQlSXgy2+mlzzqPQ==', 'Content-Length': '3008440', 'Expect': '100-Continue'} 2023-11-02T09:40:50.672 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.672 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.672 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.672 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.672 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.673 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.673 INFO:teuthology.orchestra.run.smithi156.stderr:2eBIZNrQlSXgy2+mlzzqPQ== 2023-11-02T09:40:50.673 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.673 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:38 GMT 2023-11-02T09:40:50.673 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/91 2023-11-02T09:40:50.674 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.674 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:yBdj7ptO4SlehH0PRPlET7YbIDo= 2023-11-02T09:40:50.674 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '2eBIZNrQlSXgy2+mlzzqPQ==', 'Content-Length': '3008440', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:38 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:yBdj7ptO4SlehH0PRPlET7YbIDo='} 2023-11-02T09:40:50.674 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"1af3b473ae9b128e46f5106920ce08e6"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000003bee9f276e6bf8b0-0065436c79-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.675 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/94 2023-11-02T09:40:50.675 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/94 2023-11-02T09:40:50.675 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.675 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/94 2023-11-02T09:40:50.675 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.675 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '7CV2Vqoy/iksFkUqPCFpTQ==', 'Content-Length': '3010098', 'Expect': '100-Continue'} 2023-11-02T09:40:50.676 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.676 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.676 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.676 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.677 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.677 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.677 INFO:teuthology.orchestra.run.smithi156.stderr:7CV2Vqoy/iksFkUqPCFpTQ== 2023-11-02T09:40:50.677 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.677 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:38 GMT 2023-11-02T09:40:50.678 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/94 2023-11-02T09:40:50.678 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.678 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:27s2dmOmClu+NmHrouasZs6o0Lw= 2023-11-02T09:40:50.678 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '7CV2Vqoy/iksFkUqPCFpTQ==', 'Content-Length': '3010098', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:38 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:27s2dmOmClu+NmHrouasZs6o0Lw='} 2023-11-02T09:40:50.678 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/95 2023-11-02T09:40:50.679 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/95 2023-11-02T09:40:50.679 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.679 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/95 2023-11-02T09:40:50.679 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.679 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'e5Jx8iuW33V80S7rZ8AI3w==', 'Content-Length': '3009434', 'Expect': '100-Continue'} 2023-11-02T09:40:50.680 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.680 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.680 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.680 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:50.680 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.682 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.682 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.682 INFO:teuthology.orchestra.run.smithi156.stderr:e5Jx8iuW33V80S7rZ8AI3w== 2023-11-02T09:40:50.682 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.683 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:38 GMT 2023-11-02T09:40:50.683 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/95 2023-11-02T09:40:50.683 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.683 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:5c4tZumjFBgabesqwa7pPx99/gs= 2023-11-02T09:40:50.683 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'e5Jx8iuW33V80S7rZ8AI3w==', 'Content-Length': '3009434', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:38 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:5c4tZumjFBgabesqwa7pPx99/gs='} 2023-11-02T09:40:50.684 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/96 2023-11-02T09:40:50.684 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/96 2023-11-02T09:40:50.684 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.684 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/96 2023-11-02T09:40:50.684 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.685 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'k0YFvzP4YaBXsKNnmM/cgA==', 'Content-Length': '3010750', 'Expect': '100-Continue'} 2023-11-02T09:40:50.685 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.685 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.685 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.685 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:50.686 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.686 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.686 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.686 INFO:teuthology.orchestra.run.smithi156.stderr:k0YFvzP4YaBXsKNnmM/cgA== 2023-11-02T09:40:50.686 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.687 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:38 GMT 2023-11-02T09:40:50.687 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/96 2023-11-02T09:40:50.687 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.687 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:hO2ZL84vlRa5HElk5lYZ6oTlyBI= 2023-11-02T09:40:50.687 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'k0YFvzP4YaBXsKNnmM/cgA==', 'Content-Length': '3010750', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:38 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:hO2ZL84vlRa5HElk5lYZ6oTlyBI='} 2023-11-02T09:40:50.688 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/97 2023-11-02T09:40:50.688 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/97 2023-11-02T09:40:50.688 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.688 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/97 2023-11-02T09:40:50.689 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.689 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'gfW/eYGfy2tuzCWw/nTVlg==', 'Content-Length': '3011494', 'Expect': '100-Continue'} 2023-11-02T09:40:50.689 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.689 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.689 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.690 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2023-11-02T09:40:50.690 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.690 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.690 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.690 INFO:teuthology.orchestra.run.smithi156.stderr:gfW/eYGfy2tuzCWw/nTVlg== 2023-11-02T09:40:50.691 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.691 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:38 GMT 2023-11-02T09:40:50.691 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/97 2023-11-02T09:40:50.691 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.691 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:9+S7UN97drQJ21QXQiIhqPjUYZ0= 2023-11-02T09:40:50.692 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'gfW/eYGfy2tuzCWw/nTVlg==', 'Content-Length': '3011494', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:38 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:9+S7UN97drQJ21QXQiIhqPjUYZ0='} 2023-11-02T09:40:50.692 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"f6fe7e7fd2d6cd3c145da70862736dbf"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000028f32cf0c64abc51-0065436c79-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.692 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/98 2023-11-02T09:40:50.692 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/98 2023-11-02T09:40:50.692 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.693 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/98 2023-11-02T09:40:50.693 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.693 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'BG+pQbpC/2RYHVmteusdyg==', 'Content-Length': '3009416', 'Expect': '100-Continue'} 2023-11-02T09:40:50.694 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.694 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.694 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.694 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.694 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.695 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.695 INFO:teuthology.orchestra.run.smithi156.stderr:BG+pQbpC/2RYHVmteusdyg== 2023-11-02T09:40:50.695 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.695 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:38 GMT 2023-11-02T09:40:50.695 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/98 2023-11-02T09:40:50.696 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.696 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:2N6udX+YkqonCdmKtRKN5jvoI6g= 2023-11-02T09:40:50.696 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'BG+pQbpC/2RYHVmteusdyg==', 'Content-Length': '3009416', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:38 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:2N6udX+YkqonCdmKtRKN5jvoI6g='} 2023-11-02T09:40:50.696 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"5949b9b7a5f33cf7167beae396c6248f"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000001c63d05a4878e86e-0065436c79-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.696 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/99 2023-11-02T09:40:50.697 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/99 2023-11-02T09:40:50.697 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: PUT 2023-11-02T09:40:50.697 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/99 2023-11-02T09:40:50.697 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.697 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'CZQ314BQz9upnZrsSZCFlA==', 'Content-Length': '3010085', 'Expect': '100-Continue'} 2023-11-02T09:40:50.698 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.698 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.698 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.698 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.698 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.699 INFO:teuthology.orchestra.run.smithi156.stderr:PUT 2023-11-02T09:40:50.699 INFO:teuthology.orchestra.run.smithi156.stderr:CZQ314BQz9upnZrsSZCFlA== 2023-11-02T09:40:50.699 INFO:teuthology.orchestra.run.smithi156.stderr:application/octet-stream 2023-11-02T09:40:50.699 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:38 GMT 2023-11-02T09:40:50.699 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/99 2023-11-02T09:40:50.700 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.700 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:jbx1v+fj0fPF3grmaVUxUy8WRs4= 2023-11-02T09:40:50.700 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'CZQ314BQz9upnZrsSZCFlA==', 'Content-Length': '3010085', 'Expect': '100-Continue', 'Date': 'Thu, 02 Nov 2023 09:31:38 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:jbx1v+fj0fPF3grmaVUxUy8WRs4='} 2023-11-02T09:40:50.700 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"3e6ff3b6a2dce3cc1ac1a87facb83fda"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000583f4ea6678d50be-0065436c79-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.700 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"d8d61856e443a53695553fd8ee8c07ab"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000f13659b309a0504c-0065436c7a-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.701 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"56f5caa02ffd6800e4f22768ea9cea81"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000054bdf997b5a44b75-0065436c79-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.701 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"95fb2b4cb5d10419952a7ca0a10971f3"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000001f4f157d84dc1230-0065436c7a-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.701 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"09953b0dd6e36fde972d2e31f9c62b31"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000068607c370b75c034-0065436c79-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.702 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"fc59704b37ac1f9830c0de05ace9ff04"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000269fd6f9f536bd2e-0065436c79-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.702 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"2caaa5be3752202a13fb21bee0bfca63"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000003285995278144077-0065436c79-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.702 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"9b12e42d710f5362c6e437a07020e3f1"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000c2ba232589d083b-0065436c79-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.702 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"660b7f33694722eef3268764dffb54b3"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000029e2d3e1adfe51f1-0065436c79-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.703 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"3789a0314813118964015d1c1fde8685"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000007d14dcfb551e5bbe-0065436c7a-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.703 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"710f7dddf577ade651d54dbafa6a075d"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000886790ae6cfb7566-0065436c7a-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.703 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"abc42cbc473961051fad2a2f880acd10"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000002658b3f4f9bb0e73-0065436c7a-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.703 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"cf797c1b2dc56c0279276f652bc19e51"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000df37e4522001accd-0065436c7a-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.703 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"20646f1d5ae4e413f01353be79573c6b"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000003a4f33fa627ef504-0065436c7a-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.704 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"34347a6185d433798d2ead78c3a9f3d3"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000009003d9cd99937d2a-0065436c7a-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.704 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"83b03a039a7f07b11b3b17ace0e7402e"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000074ec478c34eb544a-0065436c7a-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.704 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"45f0512746d78859420c38bc03bd6170"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000166de6fc38f85325-0065436c7a-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.704 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"c704ae839bf7899b6ef787d79ef4133d"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d9f2fae5d6a3a888-0065436c7a-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.704 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"abc594cddbc80a3311f254f450f5b7e8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000aea4654a9b5d275c-0065436c7a-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.705 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"2677106e3c8303261cc5fa06e2730376"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000721f1327e3cabedd-0065436c7a-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.705 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"1db8f3272e6794f9e1f0c7fe4b1e6421"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000888a7fbd5768fb3a-0065436c7a-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.705 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"cdbf8b5df58320738d5976cbd1170b05"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000aa300dd7c8fc028c-0065436c7a-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.705 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"764a5a9098c6749e2dfea0da091e0232"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000061e9180d14b1476e-0065436c7a-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.705 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"8066ddee72e2356fea82c7f2c63b9526"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d256270562e28054-0065436c7a-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.706 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"45e38559c863fdd09242af3ae14d3fd0"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000003cef058b6ceebe9f-0065436c7a-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.706 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"416a1a5b009a4775069041430071eb72"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000050b366a521637411-0065436c7a-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.706 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"6bf0f1409fe416a8e72a67d39d8edb25"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000c65d8af3b52820d8-0065436c7a-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.706 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"e283a528ce5ffb482419cfed5dcf43fa"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000124aaef1811c7ab8-0065436c7a-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.706 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"63018db242f8cbe006d4dd9f3a16a8f1"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000002dc5f403871705c2-0065436c7a-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.707 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"9bf72120d886a549be6b51e415936234"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e0cb5c2d0af764b9-0065436c7a-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.707 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"b6a624ae13b57d24d8618fc49e0103a5"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a99d98112c616315-0065436c7a-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.707 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"418456234e4dafa6fc16d32a2dafa1e2"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000020e7e3682c6a303-0065436c7a-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.707 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"e43be3fa58ee3ac26ccbc4d23f2e90a1"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ead4997a2c018e46-0065436c7a-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.707 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"0347c038cd15f5d3f6ea64fef9735daa"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000008a33594fb98dd8c7-0065436c7a-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.708 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"c4ee709606b7993faebb971c4d164ced"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ce0403111abdf9b8-0065436c7a-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.708 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"f637ee5231e2f94bc9ecc8d85f737ddd"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000001bed61178b4d7596-0065436c7a-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.708 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"7b9271f22b96df757cd12eeb67c008df"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000002f0033103030a621-0065436c7a-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.708 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"7e2d7f7a5c8970364dd1169864b41fda"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000479c83dd4ab984ee-0065436c7a-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.708 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a5961719cd4328033e6145c2aa14d23b"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d99bc9321f006fcc-0065436c7a-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.709 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"e4f20a7ba9664e17f918ab1befe74f0c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000401b5ca888571cb-0065436c7a-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.709 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"934605bf33f861a057b0a36798cfdc80"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000004ac84eb09e2c63d2-0065436c7a-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.709 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"cfdead437dfe0de463f1a0bc99c6413f"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b204c2ea65211b13-0065436c7a-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.709 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"20528154737c124fc57a442ad41a030b"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000031c7a43c0cc0e3b3-0065436c7a-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.709 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"4ebc8c0c10e1c6ba3a7b80f08f88e8c2"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005c9d81c05eee68bd-0065436c7a-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.710 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"d9e04864dad09525e0cb6fa6973cea3d"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000001c46d6cfec66e6c7-0065436c7a-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.710 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a15713075a4aa7383f8089634b070c58"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000fca436c48f82793a-0065436c7a-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.710 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"046fa941ba42ff64581d59ad7aeb1dca"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000080f09cd765d1aaf2-0065436c7a-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.710 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"099437d78050cfdba99d9aec49908594"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000009e5eb8c4bff0a5ef-0065436c7a-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.711 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"7a0451a8c298ed9b3828169dfdc0db25"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e9ff907e6ad44239-0065436c7a-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.711 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"ec257656aa32fe292c16452a3c21694d"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e33f1dc1fc7c9b4f-0065436c7a-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.711 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"81f5bf79819fcb6b6ecc25b0fe74d596"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000282d53da4f037785-0065436c7a-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.711 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/ 2023-11-02T09:40:50.711 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/ 2023-11-02T09:40:50.712 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: GET 2023-11-02T09:40:50.712 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/ 2023-11-02T09:40:50.712 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.712 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:50.712 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.712 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.713 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.713 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.713 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.713 INFO:teuthology.orchestra.run.smithi156.stderr:GET 2023-11-02T09:40:50.714 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.714 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.714 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:31:38 GMT 2023-11-02T09:40:50.714 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/ 2023-11-02T09:40:50.714 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.715 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:akk/NCrvCwHETzuBCeJ6/TjtHqA= 2023-11-02T09:40:50.715 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:31:38 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:akk/NCrvCwHETzuBCeJ6/TjtHqA=', 'Content-Length': '0'} 2023-11-02T09:40:50.715 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a49371e585ea12d7-0065436c7a-117b-default'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:31:38 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.715 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: b'uicwqr-111000false02023-11-02T09:31:36.700Z"4d9bfa7a659fc80c21da490b91b9e278"3008193STANDARDfoo.client.0Mr. foo.client.0Normal12023-11-02T09:31:36.758Z"d0a091c9500f23d29c225ebdd3c70221"3010806STANDARDfoo.client.0Mr. foo.client.0Normal102023-11-02T09:31:37.371Z"cfaba7ff9eeb7287c47d4400453a8998"3011710STANDARDfoo.client.0Mr. foo.client.0Normal112023-11-02T09:31:37.371Z"c83720345f1301c2c0a52a7509813b31"3009872STANDARDfoo.client.0Mr. foo.client.0Normal122023-11-02T09:31:37.496Z"b4eb3a700eafb5a7ada6b121b111e210"3008825STANDARDfoo.client.0Mr. foo.client.0Normal132023-11-02T09:31:37.547Z"75f9bdee944835dc845f562dbf3f23bb"3010407STANDARDfoo.client.0Mr. foo.client.0Normal142023-11-02T09:31:37.497Z"c75f0b5188c0d164f73dedae781681c5"3013150STANDARDfoo.client.0Mr. foo.client.0Normal152023-11-02T09:31:37.656Z"cac889193ae8b099111cb50c070008db"3011515STANDARDfoo.client.0Mr. foo.client.0Normal162023-11-02T09:31:37.611Z"4a7d36f4e9e82b4c81be3c6162d4e7b5"3012129STANDARDfoo.client.0Mr. foo.client.0Normal172023-11-02T09:31:37.691Z"26dfc210289793613e0c3dd91bc04481"3010541STANDARDfoo.client.0Mr. foo.client.0Normal182023-11-02T09:31:37.739Z"4670f56705c97bb35fc2245e568ba94c"3011586STANDARDfoo.client.0Mr. foo.client.0Normal192023-11-02T09:31:37.774Z"57addb472990f147e57ca974ac0b9a38"3010832STANDARDfoo.client.0Mr. foo.client.0Normal22023-11-02T09:31:36.844Z"ab6c1c09bec3f9a3d6c9e7252b72ccf2"3008496STANDARDfoo.client.0Mr. foo.client.0Normal202023-11-02T09:31:37.883Z"c49246d62c2fd4bfa19dc6803784f7c3"3010447STANDARDfoo.client.0Mr. foo.client.0Normal212023-11-02T09:31:37.792Z"b96cec79851566de77af1b4b542ba2ab"3006835STANDARDfoo.client.0Mr. foo.client.0Normal222023-11-02T09:31:37.885Z"83110247f72fb41dc3560b7b5e40b200"3010949STANDARDfoo.client.0Mr. foo.client.0Normal232023-11-02T09:31:37.973Z"3dc4a1b2aa3dde9a84860e0fb5e0b078"3008375STANDARDfoo.client.0Mr. foo.client.0Normal242023-11-02T09:31:37.939Z"e45e392e9df86ec9e4ea10cb44ca61c0"3011281STANDARDfoo.client.0Mr. foo.client.0Normal252023-11-02T09:31:37.886Z"717331ce6efac34d8c877ad587119113"3011210STANDARDfoo.client.0Mr. foo.client.0Normal262023-11-02T09:31:38.043Z"2d990fc14947bb6d4d8a4c0d4891bfb4"3011294STANDARDfoo.client.0Mr. foo.client.0Normal272023-11-02T09:31:38.103Z"aeedc952682f9619d55b3adc5b9a4c42"3008994STANDARDfoo.client.0Mr. foo.client.0Normal282023-11-02T09:31:38.124Z"2bd4ac247feaddfa8e1693aac5ef9d00"3008683STANDARDfoo.client.0Mr. foo.client.0Normal292023-11-02T09:31:38.162Z"5b8e4b795d7480eadd50812e8431b550"3010799STANDARDfoo.client.0Mr. foo.client.0Normal32023-11-02T09:31:36.947Z"8d58b8c16843edc4eb90dd2c7e72a9e3"3009014STANDARDfoo.client.0Mr. foo.client.0Normal302023-11-02T09:31:38.219Z"b7afca6c339a1e187d51a6cd29e9b3ef"3007538STANDARDfoo.client.0Mr. foo.client.0Normal312023-11-02T09:31:38.217Z"09ec6ff653d227bcf44b85ebd5af7d63"3011164STANDARDfoo.client.0Mr. foo.client.0Normal322023-11-02T09:31:38.204Z"1df632fb83a1198eaf43ac07ee693c2b"3012462STANDARDfoo.client.0Mr. foo.client.0Normal332023-11-02T09:31:38.196Z"775edeb1ee5864218eed62627e322539"3009725STANDARDfoo.client.0Mr. foo.client.0Normal342023-11-02T09:31:38.263Z"ac780958d54ddb92dc5b9bc11f215517"3009650STANDARDfoo.client.0Mr. foo.client.0Normal352023-11-02T09:31:38.250Z"bbe3818f0a21cd80edd02b1085935a7a"3010999STANDARDfoo.client.0Mr. foo.client.0Normal362023-11-02T09:31:38.301Z"462a7320adbe803477a7008a55824177"3013286STANDARDfoo.client.0Mr. foo.client.0Normal372023-11-02T09:31:38.345Z"b3cc45b72520d4eefacb846b8f0fe344"3008974STANDARDfoo.client.0Mr. foo.client.0Normal382023-11-02T09:31:38.287Z"d1641eab4d1287152d51112ee4a48b05"3011508STANDARDfoo.client.0Mr. foo.client.0Normal392023-11-02T09:31:38.355Z"b05b54bfbf0f202f9d3bf1f0709a386d"3009225STANDARDfoo.client.0Mr. foo.client.0Normal42023-11-02T09:31:37.025Z"72144901de7ec40642c56a25e1b1f4e7"3011482STANDARDfoo.client.0Mr. foo.client.0Normal402023-11-02T09:31:38.370Z"9217fab7df4e02245b4435a3e45d12e7"3010522STANDARDfoo.client.0Mr. foo.client.0Normal412023-11-02T09:31:38.311Z"6114a937c63d9635d66a3bbaa767d62f"3011136STANDARDfoo.client.0Mr. foo.client.0Normal422023-11-02T09:31:38.374Z"fb98808f3444e999189299c6c4510435"3011141STANDARDfoo.client.0Mr. foo.client.0Normal432023-11-02T09:31:38.320Z"68dd6d2824d5c27c41b0523ecc305fa2"3011925STANDARDfoo.client.0Mr. foo.client.0Normal442023-11-02T09:31:38.392Z"1af3b473ae9b128e46f5106920ce08e6"3008445STANDARDfoo.client.0Mr. foo.client.0Normal452023-11-02T09:31:38.366Z"5308f2250bf9b9197a64d21f7e88346f"3011930STANDARDfoo.client.0Mr. foo.client.0Normal462023-11-02T09:31:38.341Z"f2e3914f86287cd32484440cf3854d09"3009989STANDARDfoo.client.0Mr. foo.client.0Normal472023-11-02T09:31:38.417Z"5949b9b7a5f33cf7167beae396c6248f"3011031STANDARDfoo.client.0Mr. foo.client.0Normal482023-11-02T09:31:38.412Z"f6fe7e7fd2d6cd3c145da70862736dbf"3012545STANDARDfoo.client.0Mr. foo.client.0Normal492023-11-02T09:31:38.428Z"3e6ff3b6a2dce3cc1ac1a87facb83fda"3012559STANDARDfoo.client.0Mr. foo.client.0Normal52023-11-02T09:31:37.071Z"eb0f4f2642ef06a7a6bd6f03c13d37cb"3009219STANDARDfoo.client.0Mr. foo.client.0Normal502023-11-02T09:31:38.473Z"2caaa5be3752202a13fb21bee0bfca63"3008492STANDARDfoo.client.0Mr. foo.client.0Normal512023-11-02T09:31:38.454Z"56f5caa02ffd6800e4f22768ea9cea81"3009686STANDARDfoo.client.0Mr. foo.client.0Normal522023-11-02T09:31:38.453Z"09953b0dd6e36fde972d2e31f9c62b31"3011439STANDARDfoo.client.0Mr. foo.client.0Normal532023-11-02T09:31:38.466Z"9b12e42d710f5362c6e437a07020e3f1"3011494STANDARDfoo.client.0Mr. foo.client.0Normal542023-11-02T09:31:38.469Z"fc59704b37ac1f9830c0de05ace9ff04"3009484STANDARDfoo.client.0Mr. foo.client.0Normal552023-11-02T09:31:38.510Z"3789a0314813118964015d1c1fde8685"3009629STANDARDfoo.client.0Mr. foo.client.0Normal562023-11-02T09:31:38.460Z"d8d61856e443a53695553fd8ee8c07ab"3011463STANDARDfoo.client.0Mr. foo.client.0Normal572023-11-02T09:31:38.453Z"95fb2b4cb5d10419952a7ca0a10971f3"3010884STANDARDfoo.client.0Mr. foo.client.0Normal582023-11-02T09:31:38.485Z"660b7f33694722eef3268764dffb54b3"3010811STANDARDfoo.client.0Mr. foo.client.0Normal592023-11-02T09:31:38.544Z"cf797c1b2dc56c0279276f652bc19e51"3009143STANDARDfoo.client.0Mr. foo.client.0Normal62023-11-02T09:31:37.116Z"43c4d61775faada6a527ff62ba3a7fca"3012382STANDARDfoo.client.0Mr. foo.client.0Normal602023-11-02T09:31:38.527Z"abc42cbc473961051fad2a2f880acd10"3009571STANDARDfoo.client.0Mr. foo.client.0Normal612023-11-02T09:31:38.550Z"20646f1d5ae4e413f01353be79573c6b"3011233STANDARDfoo.client.0Mr. foo.client.0Normal622023-11-02T09:31:38.551Z"34347a6185d433798d2ead78c3a9f3d3"3010634STANDARDfoo.client.0Mr. foo.client.0Normal632023-11-02T09:31:38.549Z"2677106e3c8303261cc5fa06e2730376"3011316STANDARDfoo.client.0Mr. foo.client.0Normal642023-11-02T09:31:38.537Z"45f0512746d78859420c38bc03bd6170"3012154STANDARDfoo.client.0Mr. foo.client.0Normal652023-11-02T09:31:38.558Z"cdbf8b5df58320738d5976cbd1170b05"3011274STANDARDfoo.client.0Mr. foo.client.0Normal662023-11-02T09:31:38.552Z"1db8f3272e6794f9e1f0c7fe4b1e6421"3013417STANDARDfoo.client.0Mr. foo.client.0Normal672023-11-02T09:31:38.545Z"c704ae839bf7899b6ef787d79ef4133d"3011238STANDARDfoo.client.0Mr. foo.client.0Normal682023-11-02T09:31:38.529Z"710f7dddf577ade651d54dbafa6a075d"3009723STANDARDfoo.client.0Mr. foo.client.0Normal692023-11-02T09:31:38.568Z"83b03a039a7f07b11b3b17ace0e7402e"3011620STANDARDfoo.client.0Mr. foo.client.0Normal72023-11-02T09:31:37.190Z"810d70a8520012c53b8b720ad2e76680"3012420STANDARDfoo.client.0Mr. foo.client.0Normal702023-11-02T09:31:38.546Z"abc594cddbc80a3311f254f450f5b7e8"3010899STANDARDfoo.client.0Mr. foo.client.0Normal712023-11-02T09:31:38.585Z"8066ddee72e2356fea82c7f2c63b9526"3010765STANDARDfoo.client.0Mr. foo.client.0Normal722023-11-02T09:31:38.574Z"6bf0f1409fe416a8e72a67d39d8edb25"3008010STANDARDfoo.client.0Mr. foo.client.0Normal732023-11-02T09:31:38.588Z"764a5a9098c6749e2dfea0da091e0232"3010709STANDARDfoo.client.0Mr. foo.client.0Normal742023-11-02T09:31:38.580Z"9bf72120d886a549be6b51e415936234"3009999STANDARDfoo.client.0Mr. foo.client.0Normal752023-11-02T09:31:38.593Z"e43be3fa58ee3ac26ccbc4d23f2e90a1"3010941STANDARDfoo.client.0Mr. foo.client.0Normal762023-11-02T09:31:38.616Z"418456234e4dafa6fc16d32a2dafa1e2"3009946STANDARDfoo.client.0Mr. foo.client.0Normal772023-11-02T09:31:38.608Z"b6a624ae13b57d24d8618fc49e0103a5"3009958STANDARDfoo.client.0Mr. foo.client.0Normal782023-11-02T09:31:38.592Z"45e38559c863fdd09242af3ae14d3fd0"3009792STANDARDfoo.client.0Mr. foo.client.0Normal792023-11-02T09:31:38.604Z"a15713075a4aa7383f8089634b070c58"3010254STANDARDfoo.client.0Mr. foo.client.0Normal82023-11-02T09:31:37.227Z"e1b60d4315615fa34f6f7b1b86e65561"3009423STANDARDfoo.client.0Mr. foo.client.0Normal802023-11-02T09:31:38.616Z"a5961719cd4328033e6145c2aa14d23b"3012514STANDARDfoo.client.0Mr. foo.client.0Normal812023-11-02T09:31:38.619Z"e283a528ce5ffb482419cfed5dcf43fa"3010711STANDARDfoo.client.0Mr. foo.client.0Normal822023-11-02T09:31:38.597Z"c4ee709606b7993faebb971c4d164ced"3007901STANDARDfoo.client.0Mr. foo.client.0Normal832023-11-02T09:31:38.596Z"416a1a5b009a4775069041430071eb72"3011279STANDARDfoo.client.0Mr. foo.client.0Normal842023-11-02T09:31:38.623Z"cfdead437dfe0de463f1a0bc99c6413f"3011100STANDARDfoo.client.0Mr. foo.client.0Normal852023-11-02T09:31:38.630Z"0347c038cd15f5d3f6ea64fef9735daa"3011185STANDARDfoo.client.0Mr. foo.client.0Normal862023-11-02T09:31:38.642Z"e4f20a7ba9664e17f918ab1befe74f0c"3007674STANDARDfoo.client.0Mr. foo.client.0Normal872023-11-02T09:31:38.632Z"7e2d7f7a5c8970364dd1169864b41fda"3012459STANDARDfoo.client.0Mr. foo.client.0Normal882023-11-02T09:31:38.630Z"63018db242f8cbe006d4dd9f3a16a8f1"3011687STANDARDfoo.client.0Mr. foo.client.0Normal892023-11-02T09:31:38.626Z"f637ee5231e2f94bc9ecc8d85f737ddd"3013525STANDARDfoo.client.0Mr. foo.client.0Normal92023-11-02T09:31:37.351Z"86e4fe449d2d6a17efa68ee78d9e0b17"3013203STANDARDfoo.client.0Mr. foo.client.0Normal902023-11-02T09:31:38.636Z"20528154737c124fc57a442ad41a030b"3010459STANDARDfoo.client.0Mr. foo.client.0Normal912023-11-02T09:31:38.646Z"d9e04864dad09525e0cb6fa6973cea3d"3008440STANDARDfoo.client.0Mr. foo.client.0Normal922023-11-02T09:31:38.653Z"7a0451a8c298ed9b3828169dfdc0db25"3012915STANDARDfoo.client.0Mr. foo.client.0Normal932023-11-02T09:31:38.642Z"4ebc8c0c10e1c6ba3a7b80f08f88e8c2"3010473STANDARDfoo.client.0Mr. foo.client.0Normal942023-11-02T09:31:38.651Z"ec257656aa32fe292c16452a3c21694d"3010098STANDARDfoo.client.0Mr. foo.client.0Normal952023-11-02T09:31:38.648Z"7b9271f22b96df757cd12eeb67c008df"3009434STANDARDfoo.client.0Mr. foo.client.0Normal962023-11-02T09:31:38.655Z"934605bf33f861a057b0a36798cfdc80"3010750STANDARDfoo.client.0Mr. foo.client.0Normal972023-11-02T09:31:38.650Z"81f5bf79819fcb6b6ecc25b0fe74d596"3011494STANDARDfoo.client.0Mr. foo.client.0Normal982023-11-02T09:31:38.652Z"046fa941ba42ff64581d59ad7aeb1dca"3009416STANDARDfoo.client.0Mr. foo.client.0Normal992023-11-02T09:31:38.648Z"099437d78050cfdba99d9aec49908594"3010085STANDARDfoo.client.0Mr. foo.client.0Normal' 2023-11-02T09:40:50.716 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Recv would block on 2023-11-02T09:40:50.716 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.716 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:36.700284Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.11130633937890108908","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"0","size":3008193,"eTag":"4d9bfa7a659fc80c21da490b91b9e278","versionId":"","sequencer":"786C43653CB25E2A","metadata":[],"tags":[]}},"eventId":"1698917496.710849.4d9bfa7a659fc80c21da490b91b9e278","opaqueData":""}]}' 2023-11-02T09:40:50.716 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.717 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:36.758517Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.4494694752884300684","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"1","size":3010806,"eTag":"d0a091c9500f23d29c225ebdd3c70221","versionId":"","sequencer":"786C4365B457F72D","metadata":[],"tags":[]}},"eventId":"1698917496.771184.d0a091c9500f23d29c225ebdd3c70221","opaqueData":""}]}' 2023-11-02T09:40:50.717 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.717 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:36.844661Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.5128455714920522459","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"2","size":3008496,"eTag":"ab6c1c09bec3f9a3d6c9e7252b72ccf2","versionId":"","sequencer":"786C4365B2300933","metadata":[],"tags":[]}},"eventId":"1698917496.856240.ab6c1c09bec3f9a3d6c9e7252b72ccf2","opaqueData":""}]}' 2023-11-02T09:40:50.717 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.717 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:36.947574Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.1265181786386123223","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"3","size":3009014,"eTag":"8d58b8c16843edc4eb90dd2c7e72a9e3","versionId":"","sequencer":"786C43655AAC5339","metadata":[],"tags":[]}},"eventId":"1698917496.961784.8d58b8c16843edc4eb90dd2c7e72a9e3","opaqueData":""}]}' 2023-11-02T09:40:50.718 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Recv would block on 2023-11-02T09:40:50.718 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.718 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:37.025300Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.8547808415118159185","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"4","size":3011482,"eTag":"72144901de7ec40642c56a25e1b1f4e7","versionId":"","sequencer":"796C4365031A2502","metadata":[],"tags":[]}},"eventId":"1698917497.035985.72144901de7ec40642c56a25e1b1f4e7","opaqueData":""}]}' 2023-11-02T09:40:50.718 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.719 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:37.071787Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.6460261995602194405","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"5","size":3009219,"eTag":"eb0f4f2642ef06a7a6bd6f03c13d37cb","versionId":"","sequencer":"796C4365F00ED304","metadata":[],"tags":[]}},"eventId":"1698917497.080940.eb0f4f2642ef06a7a6bd6f03c13d37cb","opaqueData":""}]}' 2023-11-02T09:40:50.719 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.719 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:37.116444Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.9956044597706882916","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"6","size":3012382,"eTag":"43c4d61775faada6a527ff62ba3a7fca","versionId":"","sequencer":"796C436523CDC607","metadata":[],"tags":[]}},"eventId":"1698917497.130469.43c4d61775faada6a527ff62ba3a7fca","opaqueData":""}]}' 2023-11-02T09:40:50.719 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.719 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:37.190734Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.6943065377513207664","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"7","size":3012420,"eTag":"810d70a8520012c53b8b720ad2e76680","versionId":"","sequencer":"796C4365F0E0F70B","metadata":[],"tags":[]}},"eventId":"1698917497.200794.810d70a8520012c53b8b720ad2e76680","opaqueData":""}]}' 2023-11-02T09:40:50.720 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.720 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:37.227398Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.6638914525408620059","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"8","size":3009423,"eTag":"e1b60d4315615fa34f6f7b1b86e65561","versionId":"","sequencer":"796C4365E1C7630E","metadata":[],"tags":[]}},"eventId":"1698917497.241420.e1b60d4315615fa34f6f7b1b86e65561","opaqueData":""}]}' 2023-11-02T09:40:50.720 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.720 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:37.351164Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.11731235147859465674","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"9","size":3013203,"eTag":"86e4fe449d2d6a17efa68ee78d9e0b17","versionId":"","sequencer":"796C436537EEA015","metadata":[],"tags":[]}},"eventId":"1698917497.362868.86e4fe449d2d6a17efa68ee78d9e0b17","opaqueData":""}]}' 2023-11-02T09:40:50.720 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.721 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:37.371282Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.1110996281149838724","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"10","size":3011710,"eTag":"cfaba7ff9eeb7287c47d4400453a8998","versionId":"","sequencer":"796C43655E19F316","metadata":[],"tags":[]}},"eventId":"1698917497.385030.cfaba7ff9eeb7287c47d4400453a8998","opaqueData":""}]}' 2023-11-02T09:40:50.721 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.721 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:37.371124Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.9436653140318122452","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"11","size":3009872,"eTag":"c83720345f1301c2c0a52a7509813b31","versionId":"","sequencer":"796C436563A7F816","metadata":[],"tags":[]}},"eventId":"1698917497.385394.c83720345f1301c2c0a52a7509813b31","opaqueData":""}]}' 2023-11-02T09:40:50.721 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.721 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:37.496214Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.14961552872972468486","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"12","size":3008825,"eTag":"b4eb3a700eafb5a7ada6b121b111e210","versionId":"","sequencer":"796C43650635051F","metadata":[],"tags":[]}},"eventId":"1698917497.520434.b4eb3a700eafb5a7ada6b121b111e210","opaqueData":""}]}' 2023-11-02T09:40:50.722 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.722 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:37.497618Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.8983963682663743127","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"14","size":3013150,"eTag":"c75f0b5188c0d164f73dedae781681c5","versionId":"","sequencer":"796C4365C286061F","metadata":[],"tags":[]}},"eventId":"1698917497.520521.c75f0b5188c0d164f73dedae781681c5","opaqueData":""}]}' 2023-11-02T09:40:50.722 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.722 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:37.547830Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.18333613356846256734","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"13","size":3010407,"eTag":"75f9bdee944835dc845f562dbf3f23bb","versionId":"","sequencer":"796C436576233621","metadata":[],"tags":[]}},"eventId":"1698917497.557196.75f9bdee944835dc845f562dbf3f23bb","opaqueData":""}]}' 2023-11-02T09:40:50.722 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.723 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:37.611823Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.10033598290896024118","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"16","size":3012129,"eTag":"4a7d36f4e9e82b4c81be3c6162d4e7b5","versionId":"","sequencer":"796C436514D96B25","metadata":[],"tags":[]}},"eventId":"1698917497.627824.4a7d36f4e9e82b4c81be3c6162d4e7b5","opaqueData":""}]}' 2023-11-02T09:40:50.723 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.723 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:37.656669Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.8422573808023142893","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"15","size":3011515,"eTag":"cac889193ae8b099111cb50c070008db","versionId":"","sequencer":"796C4365A37EDE27","metadata":[],"tags":[]}},"eventId":"1698917497.668892.cac889193ae8b099111cb50c070008db","opaqueData":""}]}' 2023-11-02T09:40:50.723 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.723 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:37.691980Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.18171032308110987658","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"17","size":3010541,"eTag":"26dfc210289793613e0c3dd91bc04481","versionId":"","sequencer":"796C4365F559D929","metadata":[],"tags":[]}},"eventId":"1698917497.702110.26dfc210289793613e0c3dd91bc04481","opaqueData":""}]}' 2023-11-02T09:40:50.724 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.724 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:37.739738Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.19448840001288179","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"18","size":3011586,"eTag":"4670f56705c97bb35fc2245e568ba94c","versionId":"","sequencer":"796C4365D384922C","metadata":[],"tags":[]}},"eventId":"1698917497.747799.4670f56705c97bb35fc2245e568ba94c","opaqueData":""}]}' 2023-11-02T09:40:50.724 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.724 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:37.774839Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.12080740219536494242","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"19","size":3010832,"eTag":"57addb472990f147e57ca974ac0b9a38","versionId":"","sequencer":"796C43651EEABC2E","metadata":[],"tags":[]}},"eventId":"1698917497.784132.57addb472990f147e57ca974ac0b9a38","opaqueData":""}]}' 2023-11-02T09:40:50.724 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.725 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:37.792913Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.3429421367742189410","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"21","size":3006835,"eTag":"b96cec79851566de77af1b4b542ba2ab","versionId":"","sequencer":"796C4365CF550D30","metadata":[],"tags":[]}},"eventId":"1698917497.806180.b96cec79851566de77af1b4b542ba2ab","opaqueData":""}]}' 2023-11-02T09:40:50.725 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.725 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:37.885572Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.12243097541674569778","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"22","size":3010949,"eTag":"83110247f72fb41dc3560b7b5e40b200","versionId":"","sequencer":"796C4365FEF15835","metadata":[],"tags":[]}},"eventId":"1698917497.895021.83110247f72fb41dc3560b7b5e40b200","opaqueData":""}]}' 2023-11-02T09:40:50.725 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.726 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:37.883647Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.1871941035509861241","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"20","size":3010447,"eTag":"c49246d62c2fd4bfa19dc6803784f7c3","versionId":"","sequencer":"796C43657160BB35","metadata":[],"tags":[]}},"eventId":"1698917497.901472.c49246d62c2fd4bfa19dc6803784f7c3","opaqueData":""}]}' 2023-11-02T09:40:50.726 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.726 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:37.886282Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.5608740377302578431","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"25","size":3011210,"eTag":"717331ce6efac34d8c877ad587119113","versionId":"","sequencer":"796C43658D0EC235","metadata":[],"tags":[]}},"eventId":"1698917497.901910.717331ce6efac34d8c877ad587119113","opaqueData":""}]}' 2023-11-02T09:40:50.726 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.727 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:37.939143Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.13063533111654888300","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"24","size":3011281,"eTag":"e45e392e9df86ec9e4ea10cb44ca61c0","versionId":"","sequencer":"796C436599979738","metadata":[],"tags":[]}},"eventId":"1698917497.949458.e45e392e9df86ec9e4ea10cb44ca61c0","opaqueData":""}]}' 2023-11-02T09:40:50.727 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.727 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:37.973806Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.243518781728484774","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"23","size":3008375,"eTag":"3dc4a1b2aa3dde9a84860e0fb5e0b078","versionId":"","sequencer":"796C4365CCB8FB3A","metadata":[],"tags":[]}},"eventId":"1698917497.989575.3dc4a1b2aa3dde9a84860e0fb5e0b078","opaqueData":""}]}' 2023-11-02T09:40:50.727 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.727 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.043036Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.1943096356326424602","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"26","size":3011294,"eTag":"2d990fc14947bb6d4d8a4c0d4891bfb4","versionId":"","sequencer":"7A6C4365126E1003","metadata":[],"tags":[]}},"eventId":"1698917498.051408.2d990fc14947bb6d4d8a4c0d4891bfb4","opaqueData":""}]}' 2023-11-02T09:40:50.728 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.728 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.103817Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.16011084416215491841","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"27","size":3008994,"eTag":"aeedc952682f9619d55b3adc5b9a4c42","versionId":"","sequencer":"7A6C4365441EB406","metadata":[],"tags":[]}},"eventId":"1698917498.112467.aeedc952682f9619d55b3adc5b9a4c42","opaqueData":""}]}' 2023-11-02T09:40:50.728 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.728 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.124654Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.3466976224301422650","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"28","size":3008683,"eTag":"2bd4ac247feaddfa8e1693aac5ef9d00","versionId":"","sequencer":"7A6C43656165FA07","metadata":[],"tags":[]}},"eventId":"1698917498.133850.2bd4ac247feaddfa8e1693aac5ef9d00","opaqueData":""}]}' 2023-11-02T09:40:50.728 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.729 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.162298Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.18006772547533988575","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"29","size":3010799,"eTag":"5b8e4b795d7480eadd50812e8431b550","versionId":"","sequencer":"7A6C4365583F640A","metadata":[],"tags":[]}},"eventId":"1698917498.174341.5b8e4b795d7480eadd50812e8431b550","opaqueData":""}]}' 2023-11-02T09:40:50.729 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.729 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.196822Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.16988610037334956294","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"33","size":3009725,"eTag":"775edeb1ee5864218eed62627e322539","versionId":"","sequencer":"7A6C4365337E830C","metadata":[],"tags":[]}},"eventId":"1698917498.209944.775edeb1ee5864218eed62627e322539","opaqueData":""}]}' 2023-11-02T09:40:50.729 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.730 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.204374Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.10124391648651302217","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"32","size":3012462,"eTag":"1df632fb83a1198eaf43ac07ee693c2b","versionId":"","sequencer":"7A6C43655D34D60C","metadata":[],"tags":[]}},"eventId":"1698917498.215364.1df632fb83a1198eaf43ac07ee693c2b","opaqueData":""}]}' 2023-11-02T09:40:50.730 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.730 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.219523Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.9330628901889056889","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"30","size":3007538,"eTag":"b7afca6c339a1e187d51a6cd29e9b3ef","versionId":"","sequencer":"7A6C43658E59D30D","metadata":[],"tags":[]}},"eventId":"1698917498.231954.b7afca6c339a1e187d51a6cd29e9b3ef","opaqueData":""}]}' 2023-11-02T09:40:50.730 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.730 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.217740Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.10178736501278291293","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"31","size":3011164,"eTag":"09ec6ff653d227bcf44b85ebd5af7d63","versionId":"","sequencer":"7A6C436557ABDD0D","metadata":[],"tags":[]}},"eventId":"1698917498.232631.09ec6ff653d227bcf44b85ebd5af7d63","opaqueData":""}]}' 2023-11-02T09:40:50.731 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.731 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.250209Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.15070733894117619855","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"35","size":3010999,"eTag":"bbe3818f0a21cd80edd02b1085935a7a","versionId":"","sequencer":"7A6C43656EC7EC0F","metadata":[],"tags":[]}},"eventId":"1698917498.267175.bbe3818f0a21cd80edd02b1085935a7a","opaqueData":""}]}' 2023-11-02T09:40:50.731 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.731 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.263970Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.7120185766678855079","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"34","size":3009650,"eTag":"ac780958d54ddb92dc5b9bc11f215517","versionId":"","sequencer":"7A6C43653F20A010","metadata":[],"tags":[]}},"eventId":"1698917498.278929.ac780958d54ddb92dc5b9bc11f215517","opaqueData":""}]}' 2023-11-02T09:40:50.731 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.732 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.287177Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.16604108746366088943","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"38","size":3011508,"eTag":"d1641eab4d1287152d51112ee4a48b05","versionId":"","sequencer":"7A6C4365DD84E111","metadata":[],"tags":[]}},"eventId":"1698917498.299992.d1641eab4d1287152d51112ee4a48b05","opaqueData":""}]}' 2023-11-02T09:40:50.732 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.732 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.301288Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.12133939797286828476","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"36","size":3013286,"eTag":"462a7320adbe803477a7008a55824177","versionId":"","sequencer":"7A6C4365DFABC712","metadata":[],"tags":[]}},"eventId":"1698917498.315075.462a7320adbe803477a7008a55824177","opaqueData":""}]}' 2023-11-02T09:40:50.732 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.732 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.311986Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.17108690939697532592","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"41","size":3011136,"eTag":"6114a937c63d9635d66a3bbaa767d62f","versionId":"","sequencer":"7A6C43657ADC6D13","metadata":[],"tags":[]}},"eventId":"1698917498.325966.6114a937c63d9635d66a3bbaa767d62f","opaqueData":""}]}' 2023-11-02T09:40:50.733 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.733 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.320635Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.13829125187992999346","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"43","size":3011925,"eTag":"68dd6d2824d5c27c41b0523ecc305fa2","versionId":"","sequencer":"7A6C436587F73714","metadata":[],"tags":[]}},"eventId":"1698917498.339212.68dd6d2824d5c27c41b0523ecc305fa2","opaqueData":""}]}' 2023-11-02T09:40:50.733 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.733 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.341498Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.2607354455485149961","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"46","size":3009989,"eTag":"f2e3914f86287cd32484440cf3854d09","versionId":"","sequencer":"7A6C43650F3AF514","metadata":[],"tags":[]}},"eventId":"1698917498.351615.f2e3914f86287cd32484440cf3854d09","opaqueData":""}]}' 2023-11-02T09:40:50.733 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.734 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.345663Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.1395391432618408074","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"37","size":3008974,"eTag":"b3cc45b72520d4eefacb846b8f0fe344","versionId":"","sequencer":"7A6C4365B7D56415","metadata":[],"tags":[]}},"eventId":"1698917498.358929.b3cc45b72520d4eefacb846b8f0fe344","opaqueData":""}]}' 2023-11-02T09:40:50.734 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.734 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.355041Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.13820939650710814092","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"39","size":3009225,"eTag":"b05b54bfbf0f202f9d3bf1f0709a386d","versionId":"","sequencer":"7A6C436579174C16","metadata":[],"tags":[]}},"eventId":"1698917498.374085.b05b54bfbf0f202f9d3bf1f0709a386d","opaqueData":""}]}' 2023-11-02T09:40:50.734 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.734 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.366101Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.18422257680833076943","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"45","size":3011930,"eTag":"5308f2250bf9b9197a64d21f7e88346f","versionId":"","sequencer":"7A6C4365C9D4C316","metadata":[],"tags":[]}},"eventId":"1698917498.381932.5308f2250bf9b9197a64d21f7e88346f","opaqueData":""}]}' 2023-11-02T09:40:50.735 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.735 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.370968Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.5991966033674792481","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"40","size":3010522,"eTag":"9217fab7df4e02245b4435a3e45d12e7","versionId":"","sequencer":"7A6C4365132F0C17","metadata":[],"tags":[]}},"eventId":"1698917498.386674.9217fab7df4e02245b4435a3e45d12e7","opaqueData":""}]}' 2023-11-02T09:40:50.735 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.735 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.374082Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.10445473587603424564","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"42","size":3011141,"eTag":"fb98808f3444e999189299c6c4510435","versionId":"","sequencer":"7A6C4365DEC56A17","metadata":[],"tags":[]}},"eventId":"1698917498.392873.fb98808f3444e999189299c6c4510435","opaqueData":""}]}' 2023-11-02T09:40:50.735 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.736 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.392829Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.4318564084399995056","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"44","size":3008445,"eTag":"1af3b473ae9b128e46f5106920ce08e6","versionId":"","sequencer":"7A6C436528F23118","metadata":[],"tags":[]}},"eventId":"1698917498.405926.1af3b473ae9b128e46f5106920ce08e6","opaqueData":""}]}' 2023-11-02T09:40:50.736 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.736 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.412537Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.2950751593488366673","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"48","size":3012545,"eTag":"f6fe7e7fd2d6cd3c145da70862736dbf","versionId":"","sequencer":"7A6C43654D116919","metadata":[],"tags":[]}},"eventId":"1698917498.426316.f6fe7e7fd2d6cd3c145da70862736dbf","opaqueData":""}]}' 2023-11-02T09:40:50.736 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.737 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.417063Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.2045707741937854574","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"47","size":3011031,"eTag":"5949b9b7a5f33cf7167beae396c6248f","versionId":"","sequencer":"7A6C436524ADBB19","metadata":[],"tags":[]}},"eventId":"1698917498.431729.5949b9b7a5f33cf7167beae396c6248f","opaqueData":""}]}' 2023-11-02T09:40:50.737 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.737 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.428159Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.6358887675479281854","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"49","size":3012559,"eTag":"3e6ff3b6a2dce3cc1ac1a87facb83fda","versionId":"","sequencer":"7A6C43650AB0581A","metadata":[],"tags":[]}},"eventId":"1698917498.442019.3e6ff3b6a2dce3cc1ac1a87facb83fda","opaqueData":""}]}' 2023-11-02T09:40:50.737 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.737 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.460121Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.17381178437378527308","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"56","size":3011463,"eTag":"d8d61856e443a53695553fd8ee8c07ab","versionId":"","sequencer":"7A6C43650BD32E1C","metadata":[],"tags":[]}},"eventId":"1698917498.472830.d8d61856e443a53695553fd8ee8c07ab","opaqueData":""}]}' 2023-11-02T09:40:50.738 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.738 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.453652Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.2256045567180018224","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"57","size":3010884,"eTag":"95fb2b4cb5d10419952a7ca0a10971f3","versionId":"","sequencer":"7A6C43651A50721C","metadata":[],"tags":[]}},"eventId":"1698917498.477253.95fb2b4cb5d10419952a7ca0a10971f3","opaqueData":""}]}' 2023-11-02T09:40:50.738 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.738 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.453980Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.7521147953566040116","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"52","size":3011439,"eTag":"09953b0dd6e36fde972d2e31f9c62b31","versionId":"","sequencer":"7A6C43652B77AF1C","metadata":[],"tags":[]}},"eventId":"1698917498.481261.09953b0dd6e36fde972d2e31f9c62b31","opaqueData":""}]}' 2023-11-02T09:40:50.739 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.739 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.454025Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.6106311099767081845","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"51","size":3009686,"eTag":"56f5caa02ffd6800e4f22768ea9cea81","versionId":"","sequencer":"7A6C43652D31C41C","metadata":[],"tags":[]}},"eventId":"1698917498.482619.56f5caa02ffd6800e4f22768ea9cea81","opaqueData":""}]}' 2023-11-02T09:40:50.739 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.739 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.469257Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.2783179463787461934","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"54","size":3009484,"eTag":"fc59704b37ac1f9830c0de05ace9ff04","versionId":"","sequencer":"7A6C43654321341D","metadata":[],"tags":[]}},"eventId":"1698917498.489955.fc59704b37ac1f9830c0de05ace9ff04","opaqueData":""}]}' 2023-11-02T09:40:50.739 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.740 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.473765Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.3640484453279875191","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"50","size":3008492,"eTag":"2caaa5be3752202a13fb21bee0bfca63","versionId":"","sequencer":"7A6C43650BEC481D","metadata":[],"tags":[]}},"eventId":"1698917498.491318.2caaa5be3752202a13fb21bee0bfca63","opaqueData":""}]}' 2023-11-02T09:40:50.740 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.740 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.466915Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.876972889572444219","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"53","size":3011494,"eTag":"9b12e42d710f5362c6e437a07020e3f1","versionId":"","sequencer":"7A6C4365CBF4641D","metadata":[],"tags":[]}},"eventId":"1698917498.493155.9b12e42d710f5362c6e437a07020e3f1","opaqueData":""}]}' 2023-11-02T09:40:50.740 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.740 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.485030Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.3018207666531881457","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"58","size":3010811,"eTag":"660b7f33694722eef3268764dffb54b3","versionId":"","sequencer":"7A6C4365FCAA031E","metadata":[],"tags":[]}},"eventId":"1698917498.503556.660b7f33694722eef3268764dffb54b3","opaqueData":""}]}' 2023-11-02T09:40:50.741 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.741 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.510386Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.9013071726298160062","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"55","size":3009629,"eTag":"3789a0314813118964015d1c1fde8685","versionId":"","sequencer":"7A6C43652619051F","metadata":[],"tags":[]}},"eventId":"1698917498.520427.3789a0314813118964015d1c1fde8685","opaqueData":""}]}' 2023-11-02T09:40:50.741 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.741 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.529295Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.9828983790586525030","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"68","size":3009723,"eTag":"710f7dddf577ade651d54dbafa6a075d","versionId":"","sequencer":"7A6C436536732E20","metadata":[],"tags":[]}},"eventId":"1698917498.539915.710f7dddf577ade651d54dbafa6a075d","opaqueData":""}]}' 2023-11-02T09:40:50.741 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.742 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.527469Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.2763156236134977139","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"60","size":3009571,"eTag":"abc42cbc473961051fad2a2f880acd10","versionId":"","sequencer":"7A6C43654E515320","metadata":[],"tags":[]}},"eventId":"1698917498.542331.abc42cbc473961051fad2a2f880acd10","opaqueData":""}]}' 2023-11-02T09:40:50.742 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.742 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.544220Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.16084575635552447693","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"59","size":3009143,"eTag":"cf797c1b2dc56c0279276f652bc19e51","versionId":"","sequencer":"7A6C43655B203A21","metadata":[],"tags":[]}},"eventId":"1698917498.557457.cf797c1b2dc56c0279276f652bc19e51","opaqueData":""}]}' 2023-11-02T09:40:50.742 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.743 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.537678Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.1616201812257821477","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"64","size":3012154,"eTag":"45f0512746d78859420c38bc03bd6170","versionId":"","sequencer":"7A6C436520F71721","metadata":[],"tags":[]}},"eventId":"1698917498.555218.45f0512746d78859420c38bc03bd6170","opaqueData":""}]}' 2023-11-02T09:40:50.743 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.743 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.550537Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.4201634127847290116","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"61","size":3011233,"eTag":"20646f1d5ae4e413f01353be79573c6b","versionId":"","sequencer":"7A6C4365CBD4B421","metadata":[],"tags":[]}},"eventId":"1698917498.565499.20646f1d5ae4e413f01353be79573c6b","opaqueData":""}]}' 2023-11-02T09:40:50.743 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.743 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.568175Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.8425187670412186698","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"69","size":3011620,"eTag":"83b03a039a7f07b11b3b17ace0e7402e","versionId":"","sequencer":"7A6C4365BC227922","metadata":[],"tags":[]}},"eventId":"1698917498.578364.83b03a039a7f07b11b3b17ace0e7402e","opaqueData":""}]}' 2023-11-02T09:40:50.744 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.744 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.551051Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.10377377443459857706","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"62","size":3010634,"eTag":"34347a6185d433798d2ead78c3a9f3d3","versionId":"","sequencer":"7A6C4365D3187523","metadata":[],"tags":[]}},"eventId":"1698917498.594876.34347a6185d433798d2ead78c3a9f3d3","opaqueData":""}]}' 2023-11-02T09:40:50.744 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.744 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.545657Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.15704890715649845384","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"67","size":3011238,"eTag":"c704ae839bf7899b6ef787d79ef4133d","versionId":"","sequencer":"7A6C436507117823","metadata":[],"tags":[]}},"eventId":"1698917498.595071.c704ae839bf7899b6ef787d79ef4133d","opaqueData":""}]}' 2023-11-02T09:40:50.745 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.745 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.546081Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.12584294629888567132","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"70","size":3010899,"eTag":"abc594cddbc80a3311f254f450f5b7e8","versionId":"","sequencer":"7A6C4365A5E79423","metadata":[],"tags":[]}},"eventId":"1698917498.596961.abc594cddbc80a3311f254f450f5b7e8","opaqueData":""}]}' 2023-11-02T09:40:50.745 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.745 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.549339Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.8223312506648182493","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"63","size":3011316,"eTag":"2677106e3c8303261cc5fa06e2730376","versionId":"","sequencer":"7A6C4365402A8623","metadata":[],"tags":[]}},"eventId":"1698917498.595995.2677106e3c8303261cc5fa06e2730376","opaqueData":""}]}' 2023-11-02T09:40:50.745 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.746 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.552969Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.9838816787136314170","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"66","size":3013417,"eTag":"1db8f3272e6794f9e1f0c7fe4b1e6421","versionId":"","sequencer":"7A6C43650D6DFE23","metadata":[],"tags":[]}},"eventId":"1698917498.603876.1db8f3272e6794f9e1f0c7fe4b1e6421","opaqueData":""}]}' 2023-11-02T09:40:50.746 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.746 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.558017Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.12263317005770949260","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"65","size":3011274,"eTag":"cdbf8b5df58320738d5976cbd1170b05","versionId":"","sequencer":"7A6C43655EC8FF23","metadata":[],"tags":[]}},"eventId":"1698917498.603965.cdbf8b5df58320738d5976cbd1170b05","opaqueData":""}]}' 2023-11-02T09:40:50.749 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.749 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.588376Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.7055196735713396590","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"73","size":3010709,"eTag":"764a5a9098c6749e2dfea0da091e0232","versionId":"","sequencer":"7A6C4365895CF423","metadata":[],"tags":[]}},"eventId":"1698917498.603217.764a5a9098c6749e2dfea0da091e0232","opaqueData":""}]}' 2023-11-02T09:40:50.749 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.750 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.585151Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.15156344500049313876","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"71","size":3010765,"eTag":"8066ddee72e2356fea82c7f2c63b9526","versionId":"","sequencer":"7A6C4365F7996324","metadata":[],"tags":[]}},"eventId":"1698917498.610507.8066ddee72e2356fea82c7f2c63b9526","opaqueData":""}]}' 2023-11-02T09:40:50.750 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.750 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.592356Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.4390734258095701663","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"78","size":3009792,"eTag":"45e38559c863fdd09242af3ae14d3fd0","versionId":"","sequencer":"7A6C4365F4869E25","metadata":[],"tags":[]}},"eventId":"1698917498.631146.45e38559c863fdd09242af3ae14d3fd0","opaqueData":""}]}' 2023-11-02T09:40:50.750 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.750 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.596429Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.5815104403281245201","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"83","size":3011279,"eTag":"416a1a5b009a4775069041430071eb72","versionId":"","sequencer":"7A6C4365433A4726","metadata":[],"tags":[]}},"eventId":"1698917498.642202.416a1a5b009a4775069041430071eb72","opaqueData":""}]}' 2023-11-02T09:40:50.751 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.751 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.574470Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.14293733571664814296","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"72","size":3008010,"eTag":"6bf0f1409fe416a8e72a67d39d8edb25","versionId":"","sequencer":"7A6C4365C7545626","metadata":[],"tags":[]}},"eventId":"1698917498.643192.6bf0f1409fe416a8e72a67d39d8edb25","opaqueData":""}]}' 2023-11-02T09:40:50.751 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.751 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.593592Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.16921318449941155398","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"75","size":3010941,"eTag":"e43be3fa58ee3ac26ccbc4d23f2e90a1","versionId":"","sequencer":"7A6C4365F26E8426","metadata":[],"tags":[]}},"eventId":"1698917498.646213.e43be3fa58ee3ac26ccbc4d23f2e90a1","opaqueData":""}]}' 2023-11-02T09:40:50.752 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.752 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.580862Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.16198141833295389881","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"74","size":3009999,"eTag":"9bf72120d886a549be6b51e415936234","versionId":"","sequencer":"7A6C43650EBBA326","metadata":[],"tags":[]}},"eventId":"1698917498.648264.9bf72120d886a549be6b51e415936234","opaqueData":""}]}' 2023-11-02T09:40:50.752 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.752 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.597357Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.14844993643717982648","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"82","size":3007901,"eTag":"c4ee709606b7993faebb971c4d164ced","versionId":"","sequencer":"7A6C43654A4BAF26","metadata":[],"tags":[]}},"eventId":"1698917498.649022.c4ee709606b7993faebb971c4d164ced","opaqueData":""}]}' 2023-11-02T09:40:50.752 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.753 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.608303Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.12222092163279840021","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"77","size":3009958,"eTag":"b6a624ae13b57d24d8618fc49e0103a5","versionId":"","sequencer":"7A6C43651C83A526","metadata":[],"tags":[]}},"eventId":"1698917498.648381.b6a624ae13b57d24d8618fc49e0103a5","opaqueData":""}]}' 2023-11-02T09:40:50.753 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.753 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.626163Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.2012371362253731222","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"89","size":3013525,"eTag":"f637ee5231e2f94bc9ecc8d85f737ddd","versionId":"","sequencer":"7A6C4365422DF526","metadata":[],"tags":[]}},"eventId":"1698917498.653602.f637ee5231e2f94bc9ecc8d85f737ddd","opaqueData":""}]}' 2023-11-02T09:40:50.753 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.753 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.630196Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.9958401399996668103","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"85","size":3011185,"eTag":"0347c038cd15f5d3f6ea64fef9735daa","versionId":"","sequencer":"7A6C4365461AD927","metadata":[],"tags":[]}},"eventId":"1698917498.668539.0347c038cd15f5d3f6ea64fef9735daa","opaqueData":""}]}' 2023-11-02T09:40:50.754 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.754 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.619270Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.1318058193235770040","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"81","size":3010711,"eTag":"e283a528ce5ffb482419cfed5dcf43fa","versionId":"","sequencer":"7A6C4365FD18AC27","metadata":[],"tags":[]}},"eventId":"1698917498.665590.e283a528ce5ffb482419cfed5dcf43fa","opaqueData":""}]}' 2023-11-02T09:40:50.754 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.754 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.630753Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.3298310598107268546","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"88","size":3011687,"eTag":"63018db242f8cbe006d4dd9f3a16a8f1","versionId":"","sequencer":"7A6C436534CAEC27","metadata":[],"tags":[]}},"eventId":"1698917498.669829.63018db242f8cbe006d4dd9f3a16a8f1","opaqueData":""}]}' 2023-11-02T09:40:50.754 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.755 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.616526Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.148194610337194755","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"76","size":3009946,"eTag":"418456234e4dafa6fc16d32a2dafa1e2","versionId":"","sequencer":"7A6C43652D240229","metadata":[],"tags":[]}},"eventId":"1698917498.688006.418456234e4dafa6fc16d32a2dafa1e2","opaqueData":""}]}' 2023-11-02T09:40:50.755 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.755 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.648115Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.3386763064403600929","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"95","size":3009434,"eTag":"7b9271f22b96df757cd12eeb67c008df","versionId":"","sequencer":"7A6C4365BD8F3929","metadata":[],"tags":[]}},"eventId":"1698917498.691638.7b9271f22b96df757cd12eeb67c008df","opaqueData":""}]}' 2023-11-02T09:40:50.755 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.756 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.632691Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.5160144259524429038","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"87","size":3012459,"eTag":"7e2d7f7a5c8970364dd1169864b41fda","versionId":"","sequencer":"7A6C4365F5412929","metadata":[],"tags":[]}},"eventId":"1698917498.690569.7e2d7f7a5c8970364dd1169864b41fda","opaqueData":""}]}' 2023-11-02T09:40:50.756 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.756 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.616859Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.15680347744726183884","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"80","size":3012514,"eTag":"a5961719cd4328033e6145c2aa14d23b","versionId":"","sequencer":"7A6C436563203729","metadata":[],"tags":[]}},"eventId":"1698917498.691478.a5961719cd4328033e6145c2aa14d23b","opaqueData":""}]}' 2023-11-02T09:40:50.756 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.757 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.642028Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.288711732606890443","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"86","size":3007674,"eTag":"e4f20a7ba9664e17f918ab1befe74f0c","versionId":"","sequencer":"7A6C4365499E5429","metadata":[],"tags":[]}},"eventId":"1698917498.693411.e4f20a7ba9664e17f918ab1befe74f0c","opaqueData":""}]}' 2023-11-02T09:40:50.757 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.757 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.655128Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.5388643474623718354","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"96","size":3010750,"eTag":"934605bf33f861a057b0a36798cfdc80","versionId":"","sequencer":"7A6C43659D35BE29","metadata":[],"tags":[]}},"eventId":"1698917498.700331.934605bf33f861a057b0a36798cfdc80","opaqueData":""}]}' 2023-11-02T09:40:50.757 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.757 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.623938Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.12827591950632819475","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"84","size":3011100,"eTag":"cfdead437dfe0de463f1a0bc99c6413f","versionId":"","sequencer":"7A6C436596BB0C29","metadata":[],"tags":[]}},"eventId":"1698917498.688700.cfdead437dfe0de463f1a0bc99c6413f","opaqueData":""}]}' 2023-11-02T09:40:50.758 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.758 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.636863Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.3587016206042850227","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"90","size":3010459,"eTag":"20528154737c124fc57a442ad41a030b","versionId":"","sequencer":"7A6C43655E423129","metadata":[],"tags":[]}},"eventId":"1698917498.691094.20528154737c124fc57a442ad41a030b","opaqueData":""}]}' 2023-11-02T09:40:50.758 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.758 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.604520Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.18204735811587569978","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"79","size":3010254,"eTag":"a15713075a4aa7383f8089634b070c58","versionId":"","sequencer":"7A6C43650EF02829","metadata":[],"tags":[]}},"eventId":"1698917498.690548.a15713075a4aa7383f8089634b070c58","opaqueData":""}]}' 2023-11-02T09:40:50.759 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.759 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.646084Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.2037552069944469191","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"91","size":3008440,"eTag":"d9e04864dad09525e0cb6fa6973cea3d","versionId":"","sequencer":"7A6C43658C7D3429","metadata":[],"tags":[]}},"eventId":"1698917498.691305.d9e04864dad09525e0cb6fa6973cea3d","opaqueData":""}]}' 2023-11-02T09:40:50.759 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.759 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.642370Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.6673632886059329725","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"93","size":3010473,"eTag":"4ebc8c0c10e1c6ba3a7b80f08f88e8c2","versionId":"","sequencer":"7A6C43656B003429","metadata":[],"tags":[]}},"eventId":"1698917498.691273.4ebc8c0c10e1c6ba3a7b80f08f88e8c2","opaqueData":""}]}' 2023-11-02T09:40:50.759 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.760 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.652161Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.9291098480205474546","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"98","size":3009416,"eTag":"046fa941ba42ff64581d59ad7aeb1dca","versionId":"","sequencer":"7A6C43659830DB2A","metadata":[],"tags":[]}},"eventId":"1698917498.719007.046fa941ba42ff64581d59ad7aeb1dca","opaqueData":""}]}' 2023-11-02T09:40:50.760 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.760 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.648119Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.11411761660976735727","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"99","size":3010085,"eTag":"099437d78050cfdba99d9aec49908594","versionId":"","sequencer":"7A6C4365EAE4F22A","metadata":[],"tags":[]}},"eventId":"1698917498.720561.099437d78050cfdba99d9aec49908594","opaqueData":""}]}' 2023-11-02T09:40:50.760 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.760 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.653117Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.16861354402531000889","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"92","size":3012915,"eTag":"7a0451a8c298ed9b3828169dfdc0db25","versionId":"","sequencer":"7A6C4365DAC2F42A","metadata":[],"tags":[]}},"eventId":"1698917498.720683.7a0451a8c298ed9b3828169dfdc0db25","opaqueData":""}]}' 2023-11-02T09:40:50.761 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.761 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.651340Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.16374839489144331087","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"94","size":3010098,"eTag":"ec257656aa32fe292c16452a3c21694d","versionId":"","sequencer":"7A6C436571E3F52A","metadata":[],"tags":[]}},"eventId":"1698917498.720757.ec257656aa32fe292c16452a3c21694d","opaqueData":""}]}' 2023-11-02T09:40:50.761 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:50.761 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:31:38.650510Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.2895062332562700165","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"97","size":3011494,"eTag":"81f5bf79819fcb6b6ecc25b0fe74d596","versionId":"","sequencer":"7A6C436571C0F82A","metadata":[],"tags":[]}},"eventId":"1698917498.720945.81f5bf79819fcb6b6ecc25b0fe74d596","opaqueData":""}]}' 2023-11-02T09:40:50.761 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Received heartbeat frame 2023-11-02T09:40:50.762 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Recv would block on 2023-11-02T09:40:50.762 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Sending heartbeat frame 2023-11-02T09:40:50.762 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Sending heartbeat frame 2023-11-02T09:40:50.762 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.set_writer(19, >) 2023-11-02T09:40:50.763 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: set_writer(19, _) updated handler RdWr 2023-11-02T09:40:50.763 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned on writability watcher: 2023-11-02T09:40:50.763 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: call_later: added timeout with deadline=910.89585604 and callback=>; now=880.89585604; delay=30.0 2023-11-02T09:40:50.763 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.remove_writer(19) 2023-11-02T09:40:50.764 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: remove_writer(19) updated handler Rd 2023-11-02T09:40:50.764 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned off writability watcher: 2023-11-02T09:40:50.764 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/ 2023-11-02T09:40:50.764 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/ 2023-11-02T09:40:50.764 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: GET 2023-11-02T09:40:50.765 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/ 2023-11-02T09:40:50.765 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.765 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:50.765 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.765 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.766 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.766 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.766 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.766 INFO:teuthology.orchestra.run.smithi156.stderr:GET 2023-11-02T09:40:50.766 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.767 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.767 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:50.767 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/ 2023-11-02T09:40:50.767 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.767 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:3a3whbKmrdQaKsthHztUyKqRCdk= 2023-11-02T09:40:50.768 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:3a3whbKmrdQaKsthHztUyKqRCdk=', 'Content-Length': '0'} 2023-11-02T09:40:50.768 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000028fc98fb9b4d9889-0065436ca2-117b-default'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.768 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: b'uicwqr-111000false02023-11-02T09:31:36.700Z"4d9bfa7a659fc80c21da490b91b9e278"3008193STANDARDfoo.client.0Mr. foo.client.0Normal12023-11-02T09:31:36.758Z"d0a091c9500f23d29c225ebdd3c70221"3010806STANDARDfoo.client.0Mr. foo.client.0Normal102023-11-02T09:31:37.371Z"cfaba7ff9eeb7287c47d4400453a8998"3011710STANDARDfoo.client.0Mr. foo.client.0Normal112023-11-02T09:31:37.371Z"c83720345f1301c2c0a52a7509813b31"3009872STANDARDfoo.client.0Mr. foo.client.0Normal122023-11-02T09:31:37.496Z"b4eb3a700eafb5a7ada6b121b111e210"3008825STANDARDfoo.client.0Mr. foo.client.0Normal132023-11-02T09:31:37.547Z"75f9bdee944835dc845f562dbf3f23bb"3010407STANDARDfoo.client.0Mr. foo.client.0Normal142023-11-02T09:31:37.497Z"c75f0b5188c0d164f73dedae781681c5"3013150STANDARDfoo.client.0Mr. foo.client.0Normal152023-11-02T09:31:37.656Z"cac889193ae8b099111cb50c070008db"3011515STANDARDfoo.client.0Mr. foo.client.0Normal162023-11-02T09:31:37.611Z"4a7d36f4e9e82b4c81be3c6162d4e7b5"3012129STANDARDfoo.client.0Mr. foo.client.0Normal172023-11-02T09:31:37.691Z"26dfc210289793613e0c3dd91bc04481"3010541STANDARDfoo.client.0Mr. foo.client.0Normal182023-11-02T09:31:37.739Z"4670f56705c97bb35fc2245e568ba94c"3011586STANDARDfoo.client.0Mr. foo.client.0Normal192023-11-02T09:31:37.774Z"57addb472990f147e57ca974ac0b9a38"3010832STANDARDfoo.client.0Mr. foo.client.0Normal22023-11-02T09:31:36.844Z"ab6c1c09bec3f9a3d6c9e7252b72ccf2"3008496STANDARDfoo.client.0Mr. foo.client.0Normal202023-11-02T09:31:37.883Z"c49246d62c2fd4bfa19dc6803784f7c3"3010447STANDARDfoo.client.0Mr. foo.client.0Normal212023-11-02T09:31:37.792Z"b96cec79851566de77af1b4b542ba2ab"3006835STANDARDfoo.client.0Mr. foo.client.0Normal222023-11-02T09:31:37.885Z"83110247f72fb41dc3560b7b5e40b200"3010949STANDARDfoo.client.0Mr. foo.client.0Normal232023-11-02T09:31:37.973Z"3dc4a1b2aa3dde9a84860e0fb5e0b078"3008375STANDARDfoo.client.0Mr. foo.client.0Normal242023-11-02T09:31:37.939Z"e45e392e9df86ec9e4ea10cb44ca61c0"3011281STANDARDfoo.client.0Mr. foo.client.0Normal252023-11-02T09:31:37.886Z"717331ce6efac34d8c877ad587119113"3011210STANDARDfoo.client.0Mr. foo.client.0Normal262023-11-02T09:31:38.043Z"2d990fc14947bb6d4d8a4c0d4891bfb4"3011294STANDARDfoo.client.0Mr. foo.client.0Normal272023-11-02T09:31:38.103Z"aeedc952682f9619d55b3adc5b9a4c42"3008994STANDARDfoo.client.0Mr. foo.client.0Normal282023-11-02T09:31:38.124Z"2bd4ac247feaddfa8e1693aac5ef9d00"3008683STANDARDfoo.client.0Mr. foo.client.0Normal292023-11-02T09:31:38.162Z"5b8e4b795d7480eadd50812e8431b550"3010799STANDARDfoo.client.0Mr. foo.client.0Normal32023-11-02T09:31:36.947Z"8d58b8c16843edc4eb90dd2c7e72a9e3"3009014STANDARDfoo.client.0Mr. foo.client.0Normal302023-11-02T09:31:38.219Z"b7afca6c339a1e187d51a6cd29e9b3ef"3007538STANDARDfoo.client.0Mr. foo.client.0Normal312023-11-02T09:31:38.217Z"09ec6ff653d227bcf44b85ebd5af7d63"3011164STANDARDfoo.client.0Mr. foo.client.0Normal322023-11-02T09:31:38.204Z"1df632fb83a1198eaf43ac07ee693c2b"3012462STANDARDfoo.client.0Mr. foo.client.0Normal332023-11-02T09:31:38.196Z"775edeb1ee5864218eed62627e322539"3009725STANDARDfoo.client.0Mr. foo.client.0Normal342023-11-02T09:31:38.263Z"ac780958d54ddb92dc5b9bc11f215517"3009650STANDARDfoo.client.0Mr. foo.client.0Normal352023-11-02T09:31:38.250Z"bbe3818f0a21cd80edd02b1085935a7a"3010999STANDARDfoo.client.0Mr. foo.client.0Normal362023-11-02T09:31:38.301Z"462a7320adbe803477a7008a55824177"3013286STANDARDfoo.client.0Mr. foo.client.0Normal372023-11-02T09:31:38.345Z"b3cc45b72520d4eefacb846b8f0fe344"3008974STANDARDfoo.client.0Mr. foo.client.0Normal382023-11-02T09:31:38.287Z"d1641eab4d1287152d51112ee4a48b05"3011508STANDARDfoo.client.0Mr. foo.client.0Normal392023-11-02T09:31:38.355Z"b05b54bfbf0f202f9d3bf1f0709a386d"3009225STANDARDfoo.client.0Mr. foo.client.0Normal42023-11-02T09:31:37.025Z"72144901de7ec40642c56a25e1b1f4e7"3011482STANDARDfoo.client.0Mr. foo.client.0Normal402023-11-02T09:31:38.370Z"9217fab7df4e02245b4435a3e45d12e7"3010522STANDARDfoo.client.0Mr. foo.client.0Normal412023-11-02T09:31:38.311Z"6114a937c63d9635d66a3bbaa767d62f"3011136STANDARDfoo.client.0Mr. foo.client.0Normal422023-11-02T09:31:38.374Z"fb98808f3444e999189299c6c4510435"3011141STANDARDfoo.client.0Mr. foo.client.0Normal432023-11-02T09:31:38.320Z"68dd6d2824d5c27c41b0523ecc305fa2"3011925STANDARDfoo.client.0Mr. foo.client.0Normal442023-11-02T09:31:38.392Z"1af3b473ae9b128e46f5106920ce08e6"3008445STANDARDfoo.client.0Mr. foo.client.0Normal452023-11-02T09:31:38.366Z"5308f2250bf9b9197a64d21f7e88346f"3011930STANDARDfoo.client.0Mr. foo.client.0Normal462023-11-02T09:31:38.341Z"f2e3914f86287cd32484440cf3854d09"3009989STANDARDfoo.client.0Mr. foo.client.0Normal472023-11-02T09:31:38.417Z"5949b9b7a5f33cf7167beae396c6248f"3011031STANDARDfoo.client.0Mr. foo.client.0Normal482023-11-02T09:31:38.412Z"f6fe7e7fd2d6cd3c145da70862736dbf"3012545STANDARDfoo.client.0Mr. foo.client.0Normal492023-11-02T09:31:38.428Z"3e6ff3b6a2dce3cc1ac1a87facb83fda"3012559STANDARDfoo.client.0Mr. foo.client.0Normal52023-11-02T09:31:37.071Z"eb0f4f2642ef06a7a6bd6f03c13d37cb"3009219STANDARDfoo.client.0Mr. foo.client.0Normal502023-11-02T09:31:38.473Z"2caaa5be3752202a13fb21bee0bfca63"3008492STANDARDfoo.client.0Mr. foo.client.0Normal512023-11-02T09:31:38.454Z"56f5caa02ffd6800e4f22768ea9cea81"3009686STANDARDfoo.client.0Mr. foo.client.0Normal522023-11-02T09:31:38.453Z"09953b0dd6e36fde972d2e31f9c62b31"3011439STANDARDfoo.client.0Mr. foo.client.0Normal532023-11-02T09:31:38.466Z"9b12e42d710f5362c6e437a07020e3f1"3011494STANDARDfoo.client.0Mr. foo.client.0Normal542023-11-02T09:31:38.469Z"fc59704b37ac1f9830c0de05ace9ff04"3009484STANDARDfoo.client.0Mr. foo.client.0Normal552023-11-02T09:31:38.510Z"3789a0314813118964015d1c1fde8685"3009629STANDARDfoo.client.0Mr. foo.client.0Normal562023-11-02T09:31:38.460Z"d8d61856e443a53695553fd8ee8c07ab"3011463STANDARDfoo.client.0Mr. foo.client.0Normal572023-11-02T09:31:38.453Z"95fb2b4cb5d10419952a7ca0a10971f3"3010884STANDARDfoo.client.0Mr. foo.client.0Normal582023-11-02T09:31:38.485Z"660b7f33694722eef3268764dffb54b3"3010811STANDARDfoo.client.0Mr. foo.client.0Normal592023-11-02T09:31:38.544Z"cf797c1b2dc56c0279276f652bc19e51"3009143STANDARDfoo.client.0Mr. foo.client.0Normal62023-11-02T09:31:37.116Z"43c4d61775faada6a527ff62ba3a7fca"3012382STANDARDfoo.client.0Mr. foo.client.0Normal602023-11-02T09:31:38.527Z"abc42cbc473961051fad2a2f880acd10"3009571STANDARDfoo.client.0Mr. foo.client.0Normal612023-11-02T09:31:38.550Z"20646f1d5ae4e413f01353be79573c6b"3011233STANDARDfoo.client.0Mr. foo.client.0Normal622023-11-02T09:31:38.551Z"34347a6185d433798d2ead78c3a9f3d3"3010634STANDARDfoo.client.0Mr. foo.client.0Normal632023-11-02T09:31:38.549Z"2677106e3c8303261cc5fa06e2730376"3011316STANDARDfoo.client.0Mr. foo.client.0Normal642023-11-02T09:31:38.537Z"45f0512746d78859420c38bc03bd6170"3012154STANDARDfoo.client.0Mr. foo.client.0Normal652023-11-02T09:31:38.558Z"cdbf8b5df58320738d5976cbd1170b05"3011274STANDARDfoo.client.0Mr. foo.client.0Normal662023-11-02T09:31:38.552Z"1db8f3272e6794f9e1f0c7fe4b1e6421"3013417STANDARDfoo.client.0Mr. foo.client.0Normal672023-11-02T09:31:38.545Z"c704ae839bf7899b6ef787d79ef4133d"3011238STANDARDfoo.client.0Mr. foo.client.0Normal682023-11-02T09:31:38.529Z"710f7dddf577ade651d54dbafa6a075d"3009723STANDARDfoo.client.0Mr. foo.client.0Normal692023-11-02T09:31:38.568Z"83b03a039a7f07b11b3b17ace0e7402e"3011620STANDARDfoo.client.0Mr. foo.client.0Normal72023-11-02T09:31:37.190Z"810d70a8520012c53b8b720ad2e76680"3012420STANDARDfoo.client.0Mr. foo.client.0Normal702023-11-02T09:31:38.546Z"abc594cddbc80a3311f254f450f5b7e8"3010899STANDARDfoo.client.0Mr. foo.client.0Normal712023-11-02T09:31:38.585Z"8066ddee72e2356fea82c7f2c63b9526"3010765STANDARDfoo.client.0Mr. foo.client.0Normal722023-11-02T09:31:38.574Z"6bf0f1409fe416a8e72a67d39d8edb25"3008010STANDARDfoo.client.0Mr. foo.client.0Normal732023-11-02T09:31:38.588Z"764a5a9098c6749e2dfea0da091e0232"3010709STANDARDfoo.client.0Mr. foo.client.0Normal742023-11-02T09:31:38.580Z"9bf72120d886a549be6b51e415936234"3009999STANDARDfoo.client.0Mr. foo.client.0Normal752023-11-02T09:31:38.593Z"e43be3fa58ee3ac26ccbc4d23f2e90a1"3010941STANDARDfoo.client.0Mr. foo.client.0Normal762023-11-02T09:31:38.616Z"418456234e4dafa6fc16d32a2dafa1e2"3009946STANDARDfoo.client.0Mr. foo.client.0Normal772023-11-02T09:31:38.608Z"b6a624ae13b57d24d8618fc49e0103a5"3009958STANDARDfoo.client.0Mr. foo.client.0Normal782023-11-02T09:31:38.592Z"45e38559c863fdd09242af3ae14d3fd0"3009792STANDARDfoo.client.0Mr. foo.client.0Normal792023-11-02T09:31:38.604Z"a15713075a4aa7383f8089634b070c58"3010254STANDARDfoo.client.0Mr. foo.client.0Normal82023-11-02T09:31:37.227Z"e1b60d4315615fa34f6f7b1b86e65561"3009423STANDARDfoo.client.0Mr. foo.client.0Normal802023-11-02T09:31:38.616Z"a5961719cd4328033e6145c2aa14d23b"3012514STANDARDfoo.client.0Mr. foo.client.0Normal812023-11-02T09:31:38.619Z"e283a528ce5ffb482419cfed5dcf43fa"3010711STANDARDfoo.client.0Mr. foo.client.0Normal822023-11-02T09:31:38.597Z"c4ee709606b7993faebb971c4d164ced"3007901STANDARDfoo.client.0Mr. foo.client.0Normal832023-11-02T09:31:38.596Z"416a1a5b009a4775069041430071eb72"3011279STANDARDfoo.client.0Mr. foo.client.0Normal842023-11-02T09:31:38.623Z"cfdead437dfe0de463f1a0bc99c6413f"3011100STANDARDfoo.client.0Mr. foo.client.0Normal852023-11-02T09:31:38.630Z"0347c038cd15f5d3f6ea64fef9735daa"3011185STANDARDfoo.client.0Mr. foo.client.0Normal862023-11-02T09:31:38.642Z"e4f20a7ba9664e17f918ab1befe74f0c"3007674STANDARDfoo.client.0Mr. foo.client.0Normal872023-11-02T09:31:38.632Z"7e2d7f7a5c8970364dd1169864b41fda"3012459STANDARDfoo.client.0Mr. foo.client.0Normal882023-11-02T09:31:38.630Z"63018db242f8cbe006d4dd9f3a16a8f1"3011687STANDARDfoo.client.0Mr. foo.client.0Normal892023-11-02T09:31:38.626Z"f637ee5231e2f94bc9ecc8d85f737ddd"3013525STANDARDfoo.client.0Mr. foo.client.0Normal92023-11-02T09:31:37.351Z"86e4fe449d2d6a17efa68ee78d9e0b17"3013203STANDARDfoo.client.0Mr. foo.client.0Normal902023-11-02T09:31:38.636Z"20528154737c124fc57a442ad41a030b"3010459STANDARDfoo.client.0Mr. foo.client.0Normal912023-11-02T09:31:38.646Z"d9e04864dad09525e0cb6fa6973cea3d"3008440STANDARDfoo.client.0Mr. foo.client.0Normal922023-11-02T09:31:38.653Z"7a0451a8c298ed9b3828169dfdc0db25"3012915STANDARDfoo.client.0Mr. foo.client.0Normal932023-11-02T09:31:38.642Z"4ebc8c0c10e1c6ba3a7b80f08f88e8c2"3010473STANDARDfoo.client.0Mr. foo.client.0Normal942023-11-02T09:31:38.651Z"ec257656aa32fe292c16452a3c21694d"3010098STANDARDfoo.client.0Mr. foo.client.0Normal952023-11-02T09:31:38.648Z"7b9271f22b96df757cd12eeb67c008df"3009434STANDARDfoo.client.0Mr. foo.client.0Normal962023-11-02T09:31:38.655Z"934605bf33f861a057b0a36798cfdc80"3010750STANDARDfoo.client.0Mr. foo.client.0Normal972023-11-02T09:31:38.650Z"81f5bf79819fcb6b6ecc25b0fe74d596"3011494STANDARDfoo.client.0Mr. foo.client.0Normal982023-11-02T09:31:38.652Z"046fa941ba42ff64581d59ad7aeb1dca"3009416STANDARDfoo.client.0Mr. foo.client.0Normal992023-11-02T09:31:38.648Z"099437d78050cfdba99d9aec49908594"3010085STANDARDfoo.client.0Mr. foo.client.0Normal' 2023-11-02T09:40:50.769 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/0 2023-11-02T09:40:50.769 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/0 2023-11-02T09:40:50.769 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:50.769 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/0 2023-11-02T09:40:50.769 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.770 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:50.770 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.770 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.770 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.770 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.771 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.771 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:50.771 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.771 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.771 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:50.772 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/0 2023-11-02T09:40:50.772 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.772 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:KXy3YufvOPSCVgCv+3SMsSCfamE= 2023-11-02T09:40:50.772 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:KXy3YufvOPSCVgCv+3SMsSCfamE=', 'Content-Length': '0'} 2023-11-02T09:40:50.772 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/1 2023-11-02T09:40:50.773 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/1 2023-11-02T09:40:50.773 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:50.773 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/1 2023-11-02T09:40:50.773 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.774 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:50.774 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.774 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.774 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.775 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.775 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.775 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:50.775 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.775 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.776 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:50.776 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/1 2023-11-02T09:40:50.776 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.776 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:ejnWPAQzBNKY2tgNO6lUyHxQDOA= 2023-11-02T09:40:50.776 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:ejnWPAQzBNKY2tgNO6lUyHxQDOA=', 'Content-Length': '0'} 2023-11-02T09:40:50.777 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/10 2023-11-02T09:40:50.777 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/10 2023-11-02T09:40:50.777 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:50.777 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/10 2023-11-02T09:40:50.777 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.777 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:50.778 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.778 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.778 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.778 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.778 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.779 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:50.779 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.779 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.779 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:50.779 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/10 2023-11-02T09:40:50.780 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.780 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:tg3lF437qXNNTfNoN3ccqTaOCWA= 2023-11-02T09:40:50.780 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:tg3lF437qXNNTfNoN3ccqTaOCWA=', 'Content-Length': '0'} 2023-11-02T09:40:50.780 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/11 2023-11-02T09:40:50.780 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/11 2023-11-02T09:40:50.781 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:50.781 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/11 2023-11-02T09:40:50.781 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.781 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:50.781 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.782 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.782 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.782 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.783 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.783 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:50.783 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.783 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.783 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:50.784 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/11 2023-11-02T09:40:50.784 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.784 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:y5dFImHJ8ZeWdOB/yOD6ejZVWws= 2023-11-02T09:40:50.784 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:y5dFImHJ8ZeWdOB/yOD6ejZVWws=', 'Content-Length': '0'} 2023-11-02T09:40:50.784 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/12 2023-11-02T09:40:50.785 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/12 2023-11-02T09:40:50.785 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:50.786 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/12 2023-11-02T09:40:50.786 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.786 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:50.786 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.786 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.787 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.787 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.787 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.787 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:50.787 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.788 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.788 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:50.788 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/12 2023-11-02T09:40:50.788 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.788 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:xdMrAA7GBujk4n6KeyhOR8g72Q4= 2023-11-02T09:40:50.789 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:xdMrAA7GBujk4n6KeyhOR8g72Q4=', 'Content-Length': '0'} 2023-11-02T09:40:50.789 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/13 2023-11-02T09:40:50.789 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/13 2023-11-02T09:40:50.789 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:50.789 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/13 2023-11-02T09:40:50.790 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.790 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:50.790 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.790 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.790 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.791 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.791 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.791 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:50.791 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.791 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.792 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:50.792 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/13 2023-11-02T09:40:50.792 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.792 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:ndQ8+a4D0lu0msBZ/SLVNiZD1IQ= 2023-11-02T09:40:50.792 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:ndQ8+a4D0lu0msBZ/SLVNiZD1IQ=', 'Content-Length': '0'} 2023-11-02T09:40:50.793 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/14 2023-11-02T09:40:50.793 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/14 2023-11-02T09:40:50.793 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:50.794 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/14 2023-11-02T09:40:50.794 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.794 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:50.794 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.794 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.795 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.795 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.795 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.795 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:50.795 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.796 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.796 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:50.796 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/14 2023-11-02T09:40:50.796 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.796 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:kZxWv6DLX1cAh1dz/UXqyDJVGq8= 2023-11-02T09:40:50.797 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:kZxWv6DLX1cAh1dz/UXqyDJVGq8=', 'Content-Length': '0'} 2023-11-02T09:40:50.797 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/15 2023-11-02T09:40:50.797 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/15 2023-11-02T09:40:50.798 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:50.798 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/15 2023-11-02T09:40:50.798 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.798 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:50.798 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.799 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.799 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.799 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.799 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.799 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:50.800 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.800 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.800 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:50.800 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/15 2023-11-02T09:40:50.800 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.801 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:fmwbinAiqq25W61KwZmDL2JHe48= 2023-11-02T09:40:50.801 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:fmwbinAiqq25W61KwZmDL2JHe48=', 'Content-Length': '0'} 2023-11-02T09:40:50.801 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/16 2023-11-02T09:40:50.801 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/16 2023-11-02T09:40:50.801 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:50.802 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/16 2023-11-02T09:40:50.802 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.802 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:50.802 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.802 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.802 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.803 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.803 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.803 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:50.803 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.804 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.804 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:50.804 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/16 2023-11-02T09:40:50.804 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.804 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:Uosmg7gsIpLV1O7Ed9fAMEmrGf0= 2023-11-02T09:40:50.805 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:Uosmg7gsIpLV1O7Ed9fAMEmrGf0=', 'Content-Length': '0'} 2023-11-02T09:40:50.805 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/17 2023-11-02T09:40:50.805 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/17 2023-11-02T09:40:50.805 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:50.805 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/17 2023-11-02T09:40:50.806 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.806 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:50.806 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.806 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.806 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.807 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.807 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.807 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:50.807 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.807 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.808 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:50.808 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/17 2023-11-02T09:40:50.808 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.808 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:SDN75p4EToezl0cYtTX1WA8vxbQ= 2023-11-02T09:40:50.808 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:SDN75p4EToezl0cYtTX1WA8vxbQ=', 'Content-Length': '0'} 2023-11-02T09:40:50.809 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/18 2023-11-02T09:40:50.809 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/18 2023-11-02T09:40:50.809 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:50.809 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/18 2023-11-02T09:40:50.809 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.810 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:50.810 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.810 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.810 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.811 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.811 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.811 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:50.811 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.811 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.812 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:50.812 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/18 2023-11-02T09:40:50.812 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.812 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:yo9DfPR/ZngjX1QENtcm3Wra2dQ= 2023-11-02T09:40:50.812 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:yo9DfPR/ZngjX1QENtcm3Wra2dQ=', 'Content-Length': '0'} 2023-11-02T09:40:50.813 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/19 2023-11-02T09:40:50.813 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/19 2023-11-02T09:40:50.813 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:50.813 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/19 2023-11-02T09:40:50.813 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.814 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:50.814 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.814 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.814 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.814 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.815 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.815 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:50.815 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.815 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.815 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:50.815 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/19 2023-11-02T09:40:50.816 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.816 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:tlXloGAAGjPmGWIu7GDWSpTfS4w= 2023-11-02T09:40:50.816 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:tlXloGAAGjPmGWIu7GDWSpTfS4w=', 'Content-Length': '0'} 2023-11-02T09:40:50.816 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/2 2023-11-02T09:40:50.816 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/2 2023-11-02T09:40:50.817 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:50.817 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/2 2023-11-02T09:40:50.817 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.817 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:50.817 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.818 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.818 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.818 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.818 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.818 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:50.819 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.819 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.819 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:50.819 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/2 2023-11-02T09:40:50.819 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.820 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:C1BvAqN0Q2NoJV5y63CCPyZgeAw= 2023-11-02T09:40:50.820 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:C1BvAqN0Q2NoJV5y63CCPyZgeAw=', 'Content-Length': '0'} 2023-11-02T09:40:50.820 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/20 2023-11-02T09:40:50.820 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/20 2023-11-02T09:40:50.820 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:50.821 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/20 2023-11-02T09:40:50.821 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.821 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:50.821 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.821 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.822 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.822 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.822 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.823 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:50.823 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.823 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.823 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:50.823 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/20 2023-11-02T09:40:50.824 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.824 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:usNQn3jdH/2lpJdUUR9EGLtMJyA= 2023-11-02T09:40:50.824 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:usNQn3jdH/2lpJdUUR9EGLtMJyA=', 'Content-Length': '0'} 2023-11-02T09:40:50.824 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/21 2023-11-02T09:40:50.824 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/21 2023-11-02T09:40:50.825 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:50.825 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/21 2023-11-02T09:40:50.825 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.825 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:50.825 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.825 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.826 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.826 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.826 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.826 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:50.826 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.827 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.827 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:50.827 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/21 2023-11-02T09:40:50.827 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.828 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:u5btB1osHlmjgZZ5Wc4b6lBW3Yk= 2023-11-02T09:40:50.828 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:u5btB1osHlmjgZZ5Wc4b6lBW3Yk=', 'Content-Length': '0'} 2023-11-02T09:40:50.828 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx00000adf5118bb0d43472-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.828 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/22 2023-11-02T09:40:50.828 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/22 2023-11-02T09:40:50.829 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:50.829 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/22 2023-11-02T09:40:50.829 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.829 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:50.829 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.830 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.830 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.830 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.830 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.831 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:50.831 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.831 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.831 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:50.831 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/22 2023-11-02T09:40:50.832 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.832 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:2WsQ7rHm/SRZhjyNuGUa/5/7Lqg= 2023-11-02T09:40:50.832 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:2WsQ7rHm/SRZhjyNuGUa/5/7Lqg=', 'Content-Length': '0'} 2023-11-02T09:40:50.832 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/23 2023-11-02T09:40:50.832 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/23 2023-11-02T09:40:50.833 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:50.833 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/23 2023-11-02T09:40:50.833 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.833 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:50.833 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.834 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.834 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.834 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.834 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.835 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:50.835 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.835 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.835 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:50.836 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/23 2023-11-02T09:40:50.836 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.836 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:7dwunAZc4/EMZkjqFoxEyMDqA7I= 2023-11-02T09:40:50.836 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:7dwunAZc4/EMZkjqFoxEyMDqA7I=', 'Content-Length': '0'} 2023-11-02T09:40:50.836 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/24 2023-11-02T09:40:50.837 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/24 2023-11-02T09:40:50.837 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:50.837 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/24 2023-11-02T09:40:50.837 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.837 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:50.837 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.838 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.838 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.838 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.838 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.838 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:50.839 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.839 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.839 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:50.839 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/24 2023-11-02T09:40:50.839 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.840 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:sAQHw7lMt9S6trFRamK99JX4EUY= 2023-11-02T09:40:50.840 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:sAQHw7lMt9S6trFRamK99JX4EUY=', 'Content-Length': '0'} 2023-11-02T09:40:50.840 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/25 2023-11-02T09:40:50.840 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/25 2023-11-02T09:40:50.840 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:50.841 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/25 2023-11-02T09:40:50.841 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.841 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:50.841 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.841 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.842 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.842 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.842 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.842 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:50.842 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.843 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.843 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:50.843 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/25 2023-11-02T09:40:50.843 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.843 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:GQY6E0BJBKv4LM1lIwPg70sz3jI= 2023-11-02T09:40:50.844 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:GQY6E0BJBKv4LM1lIwPg70sz3jI=', 'Content-Length': '0'} 2023-11-02T09:40:50.844 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/26 2023-11-02T09:40:50.844 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/26 2023-11-02T09:40:50.844 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:50.844 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/26 2023-11-02T09:40:50.845 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.845 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:50.845 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.845 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.845 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.846 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.846 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.846 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:50.847 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.847 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.847 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:50.847 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/26 2023-11-02T09:40:50.848 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.848 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:0pRbT/8pPj8hA5Lzzk7PXgwS62E= 2023-11-02T09:40:50.848 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:0pRbT/8pPj8hA5Lzzk7PXgwS62E=', 'Content-Length': '0'} 2023-11-02T09:40:50.848 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/27 2023-11-02T09:40:50.848 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/27 2023-11-02T09:40:50.849 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:50.849 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/27 2023-11-02T09:40:50.849 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.849 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:50.849 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.850 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.850 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.850 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.850 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.850 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:50.851 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.851 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.851 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:50.851 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/27 2023-11-02T09:40:50.852 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.852 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:pHiv8E7mD+LbUwjIV5oLPIGFiKA= 2023-11-02T09:40:50.852 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:pHiv8E7mD+LbUwjIV5oLPIGFiKA=', 'Content-Length': '0'} 2023-11-02T09:40:50.852 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx00000ea2865155b6afb09-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.852 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx000008b39d0f654a6e51b-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.853 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx00000634e9de66f880496-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.853 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx0000001d79285584aacfb-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.853 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx00000eb1130bbbeebcbf3-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.853 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/28 2023-11-02T09:40:50.854 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/28 2023-11-02T09:40:50.854 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:50.854 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/28 2023-11-02T09:40:50.854 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.855 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:50.855 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.855 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.855 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.855 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.856 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.856 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:50.856 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.856 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.856 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:50.857 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/28 2023-11-02T09:40:50.857 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.857 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:wZk3ZQ/7dfiwqtcqvRHqid0hq6Q= 2023-11-02T09:40:50.858 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:wZk3ZQ/7dfiwqtcqvRHqid0hq6Q=', 'Content-Length': '0'} 2023-11-02T09:40:50.858 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx00000548d231d29c55ab4-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.858 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/29 2023-11-02T09:40:50.859 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/29 2023-11-02T09:40:50.859 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:50.859 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/29 2023-11-02T09:40:50.859 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.859 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:50.860 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.860 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.860 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.860 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.860 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.861 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:50.861 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.861 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.861 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:50.861 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/29 2023-11-02T09:40:50.861 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.862 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:yA+Ri9HGpZBulzU9vZNNGeCh5HE= 2023-11-02T09:40:50.862 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:yA+Ri9HGpZBulzU9vZNNGeCh5HE=', 'Content-Length': '0'} 2023-11-02T09:40:50.862 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/3 2023-11-02T09:40:50.862 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/3 2023-11-02T09:40:50.863 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:50.863 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/3 2023-11-02T09:40:50.863 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.863 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:50.863 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.863 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.864 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.864 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.864 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.864 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:50.864 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.865 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.865 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:50.865 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/3 2023-11-02T09:40:50.865 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.865 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:z/95H54aGTsuGb22dnd0LtjBZYs= 2023-11-02T09:40:50.866 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:z/95H54aGTsuGb22dnd0LtjBZYs=', 'Content-Length': '0'} 2023-11-02T09:40:50.866 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/30 2023-11-02T09:40:50.866 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/30 2023-11-02T09:40:50.866 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:50.866 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/30 2023-11-02T09:40:50.867 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.867 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:50.867 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.867 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.867 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.868 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.868 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.868 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:50.868 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.869 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.869 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:50.869 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/30 2023-11-02T09:40:50.869 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.869 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:oDhqL2ROao+ErCwkxP/ttb/UeT8= 2023-11-02T09:40:50.870 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:oDhqL2ROao+ErCwkxP/ttb/UeT8=', 'Content-Length': '0'} 2023-11-02T09:40:50.870 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx00000f32c953c9b44e48e-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.870 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/31 2023-11-02T09:40:50.870 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/31 2023-11-02T09:40:50.871 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:50.871 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/31 2023-11-02T09:40:50.871 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.871 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:50.871 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.872 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.872 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.872 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.872 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.872 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:50.873 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.873 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.873 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:50.873 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/31 2023-11-02T09:40:50.873 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.873 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:WR+JwOiFTSIjAg1c5InMpg9sjG0= 2023-11-02T09:40:50.874 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:WR+JwOiFTSIjAg1c5InMpg9sjG0=', 'Content-Length': '0'} 2023-11-02T09:40:50.874 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/32 2023-11-02T09:40:50.874 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/32 2023-11-02T09:40:50.874 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:50.875 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/32 2023-11-02T09:40:50.875 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.875 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:50.875 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.875 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.875 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.876 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.876 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.876 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:50.876 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.876 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.877 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:50.877 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/32 2023-11-02T09:40:50.877 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.877 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:a8TpDfREbALmHKH7MzmcN8+6AW8= 2023-11-02T09:40:50.877 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:a8TpDfREbALmHKH7MzmcN8+6AW8=', 'Content-Length': '0'} 2023-11-02T09:40:50.878 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx0000059f2b19d310c52e3-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.878 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/33 2023-11-02T09:40:50.878 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/33 2023-11-02T09:40:50.878 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:50.878 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/33 2023-11-02T09:40:50.879 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.879 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:50.879 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.879 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.879 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.880 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.880 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.880 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:50.880 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.880 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.881 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:50.881 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/33 2023-11-02T09:40:50.881 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.881 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:rgh10fXZsNf6c+FBkCv83Uk2G84= 2023-11-02T09:40:50.881 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:rgh10fXZsNf6c+FBkCv83Uk2G84=', 'Content-Length': '0'} 2023-11-02T09:40:50.882 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/34 2023-11-02T09:40:50.882 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/34 2023-11-02T09:40:50.882 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:50.883 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/34 2023-11-02T09:40:50.883 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.883 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:50.883 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.884 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.884 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.884 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.884 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.884 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:50.885 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.885 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.885 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:50.885 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/34 2023-11-02T09:40:50.885 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.886 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:kiRfzryn/EySa3ikLNvYMpu7cfU= 2023-11-02T09:40:50.886 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:kiRfzryn/EySa3ikLNvYMpu7cfU=', 'Content-Length': '0'} 2023-11-02T09:40:50.886 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/35 2023-11-02T09:40:50.886 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/35 2023-11-02T09:40:50.886 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:50.887 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/35 2023-11-02T09:40:50.887 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.887 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:50.887 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.887 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.888 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.888 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.888 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.888 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:50.888 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.889 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.889 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:50.889 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/35 2023-11-02T09:40:50.889 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.889 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:5pcpdzkhGUN93twCM6URCMFD+/Y= 2023-11-02T09:40:50.889 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:5pcpdzkhGUN93twCM6URCMFD+/Y=', 'Content-Length': '0'} 2023-11-02T09:40:50.890 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/36 2023-11-02T09:40:50.890 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/36 2023-11-02T09:40:50.890 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:50.890 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/36 2023-11-02T09:40:50.891 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.891 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:50.891 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.891 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.891 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.892 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.892 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.892 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:50.892 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.892 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.893 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:50.893 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/36 2023-11-02T09:40:50.893 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.893 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:CnCt2UeUWiIGV8J7FZPtW+lO5pU= 2023-11-02T09:40:50.893 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:CnCt2UeUWiIGV8J7FZPtW+lO5pU=', 'Content-Length': '0'} 2023-11-02T09:40:50.894 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx0000004bbe9b386e8aee4-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.894 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx00000b738686653bd6a41-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.894 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/37 2023-11-02T09:40:50.895 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/37 2023-11-02T09:40:50.895 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:50.895 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/37 2023-11-02T09:40:50.895 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.895 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:50.896 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.896 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.896 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.896 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.896 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.897 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:50.897 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.897 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.897 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:50.897 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/37 2023-11-02T09:40:50.897 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.898 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:RtLGrTaHj+0y5PGoAvH66fLLgc4= 2023-11-02T09:40:50.898 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:RtLGrTaHj+0y5PGoAvH66fLLgc4=', 'Content-Length': '0'} 2023-11-02T09:40:50.898 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx00000ee98078f43d42334-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.898 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx000000677833b06b36856-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.899 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx00000027a4267c7526c9b-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.899 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/38 2023-11-02T09:40:50.899 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/38 2023-11-02T09:40:50.899 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:50.899 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/38 2023-11-02T09:40:50.900 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.900 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:50.900 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.900 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.900 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.901 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.901 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.901 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:50.901 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.901 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.902 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:50.902 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/38 2023-11-02T09:40:50.902 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.902 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:rkR1y4J9DaelPtyMRVTNUhMas+I= 2023-11-02T09:40:50.903 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:rkR1y4J9DaelPtyMRVTNUhMas+I=', 'Content-Length': '0'} 2023-11-02T09:40:50.903 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx00000b0162ba63ec151ca-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.903 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx00000592e03a5d32c620e-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.903 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/39 2023-11-02T09:40:50.904 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/39 2023-11-02T09:40:50.904 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:50.904 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/39 2023-11-02T09:40:50.904 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.905 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:50.905 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.905 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.905 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.905 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.906 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.906 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:50.906 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.907 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.907 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:50.907 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/39 2023-11-02T09:40:50.907 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.908 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:3YBAuOgF1u6bRuamwTGvoK8+yBE= 2023-11-02T09:40:50.908 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:3YBAuOgF1u6bRuamwTGvoK8+yBE=', 'Content-Length': '0'} 2023-11-02T09:40:50.908 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/4 2023-11-02T09:40:50.908 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/4 2023-11-02T09:40:50.908 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:50.909 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/4 2023-11-02T09:40:50.909 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.909 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:50.909 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.910 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.910 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.910 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.910 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.910 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:50.911 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.911 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.911 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:50.911 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/4 2023-11-02T09:40:50.911 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.912 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:qp9rhtDyfAhxNcfQld9L451En50= 2023-11-02T09:40:50.912 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:qp9rhtDyfAhxNcfQld9L451En50=', 'Content-Length': '0'} 2023-11-02T09:40:50.912 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx00000ca66db6924058773-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.912 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/40 2023-11-02T09:40:50.913 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/40 2023-11-02T09:40:50.913 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:50.913 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/40 2023-11-02T09:40:50.913 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.913 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:50.914 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.914 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.914 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.914 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.914 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.915 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:50.915 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.915 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.915 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:50.915 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/40 2023-11-02T09:40:50.916 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.916 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:XLqHyR8fa+JbwkuSOh5FAB/rBvc= 2023-11-02T09:40:50.916 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:XLqHyR8fa+JbwkuSOh5FAB/rBvc=', 'Content-Length': '0'} 2023-11-02T09:40:50.916 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/41 2023-11-02T09:40:50.916 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/41 2023-11-02T09:40:50.917 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:50.917 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/41 2023-11-02T09:40:50.917 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.917 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:50.917 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.918 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.918 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.918 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.918 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.919 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:50.919 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.919 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.920 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:50.920 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/41 2023-11-02T09:40:50.920 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.920 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:dMWzDn+8jM0yCTf/w14APR3arjw= 2023-11-02T09:40:50.920 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:dMWzDn+8jM0yCTf/w14APR3arjw=', 'Content-Length': '0'} 2023-11-02T09:40:50.921 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/42 2023-11-02T09:40:50.921 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/42 2023-11-02T09:40:50.921 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:50.921 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/42 2023-11-02T09:40:50.921 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.922 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:50.922 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.922 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.922 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.923 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.923 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.923 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:50.923 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.923 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.924 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:50.924 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/42 2023-11-02T09:40:50.924 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.924 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:5ysWR+vn7S26QwB3UJ6t1Xu2RYg= 2023-11-02T09:40:50.924 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:5ysWR+vn7S26QwB3UJ6t1Xu2RYg=', 'Content-Length': '0'} 2023-11-02T09:40:50.925 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx00000a5378223a9a67f6b-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.925 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx0000062578dac3acfa4d5-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.925 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx000008695e89d1d5fe9f9-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.925 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/43 2023-11-02T09:40:50.925 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/43 2023-11-02T09:40:50.926 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:50.926 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/43 2023-11-02T09:40:50.926 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.926 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:50.926 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.927 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.927 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.927 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.927 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.927 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:50.927 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.928 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.928 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:50.928 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/43 2023-11-02T09:40:50.928 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.928 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:l0+4eRARPOGlccZvntRBl3HRn7A= 2023-11-02T09:40:50.929 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:l0+4eRARPOGlccZvntRBl3HRn7A=', 'Content-Length': '0'} 2023-11-02T09:40:50.929 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/44 2023-11-02T09:40:50.929 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/44 2023-11-02T09:40:50.929 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:50.929 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/44 2023-11-02T09:40:50.930 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.930 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:50.930 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.930 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.930 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.931 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.931 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.931 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:50.931 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.932 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.932 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:50.932 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/44 2023-11-02T09:40:50.932 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.932 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:QDHbPem1ZeC3Q5fTC1yiWIlLVUk= 2023-11-02T09:40:50.932 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:QDHbPem1ZeC3Q5fTC1yiWIlLVUk=', 'Content-Length': '0'} 2023-11-02T09:40:50.933 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/45 2023-11-02T09:40:50.933 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/45 2023-11-02T09:40:50.933 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:50.933 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/45 2023-11-02T09:40:50.933 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.934 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:50.934 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.934 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.934 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.934 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.935 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.935 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:50.935 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.935 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.935 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:50.936 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/45 2023-11-02T09:40:50.936 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.936 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:5xuBIJP9dAm5I3s+SQuewE1iY1E= 2023-11-02T09:40:50.936 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:5xuBIJP9dAm5I3s+SQuewE1iY1E=', 'Content-Length': '0'} 2023-11-02T09:40:50.936 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/46 2023-11-02T09:40:50.937 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/46 2023-11-02T09:40:50.937 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:50.937 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/46 2023-11-02T09:40:50.937 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.937 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:50.937 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.938 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.938 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.938 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.938 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.938 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:50.939 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.939 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.939 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:50.939 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/46 2023-11-02T09:40:50.939 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.940 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:hu6qTktL3ILnlE/9CDhF3MY1hOQ= 2023-11-02T09:40:50.940 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:hu6qTktL3ILnlE/9CDhF3MY1hOQ=', 'Content-Length': '0'} 2023-11-02T09:40:50.940 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/47 2023-11-02T09:40:50.940 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/47 2023-11-02T09:40:50.940 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:50.941 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/47 2023-11-02T09:40:50.941 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.941 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:50.941 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.941 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.942 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.942 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.942 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.942 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:50.942 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.943 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.943 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:50.943 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/47 2023-11-02T09:40:50.944 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.944 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:fd3Qq+vYQMGmL4mr9tEJb8Onu+4= 2023-11-02T09:40:50.944 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:fd3Qq+vYQMGmL4mr9tEJb8Onu+4=', 'Content-Length': '0'} 2023-11-02T09:40:50.944 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx00000d2bb4e25c32571a1-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.944 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx000009b3a3cd1abf77578-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.945 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/48 2023-11-02T09:40:50.945 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/48 2023-11-02T09:40:50.945 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:50.945 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/48 2023-11-02T09:40:50.945 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.946 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:50.946 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.946 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.946 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.946 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.947 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.947 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:50.947 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.947 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.947 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:50.948 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/48 2023-11-02T09:40:50.948 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.948 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:d7rwXiSfTB2tTQX0LRUdPJsIov0= 2023-11-02T09:40:50.948 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:d7rwXiSfTB2tTQX0LRUdPJsIov0=', 'Content-Length': '0'} 2023-11-02T09:40:50.948 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/49 2023-11-02T09:40:50.949 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/49 2023-11-02T09:40:50.949 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:50.949 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/49 2023-11-02T09:40:50.949 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.949 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:50.950 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.950 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.950 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.950 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.950 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.951 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:50.951 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.951 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.951 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:50.951 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/49 2023-11-02T09:40:50.953 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.954 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:gfH/OC/LD5kv7+G00tFXh2A5fkU= 2023-11-02T09:40:50.954 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:gfH/OC/LD5kv7+G00tFXh2A5fkU=', 'Content-Length': '0'} 2023-11-02T09:40:50.954 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/5 2023-11-02T09:40:50.954 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/5 2023-11-02T09:40:50.955 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:50.955 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/5 2023-11-02T09:40:50.955 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.956 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:50.956 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.956 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.956 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.956 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.957 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.957 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:50.957 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.957 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.958 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:50.958 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/5 2023-11-02T09:40:50.958 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.958 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:fFuc5K7tRCNGlu7yDm6mD4I5cgo= 2023-11-02T09:40:50.958 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:fFuc5K7tRCNGlu7yDm6mD4I5cgo=', 'Content-Length': '0'} 2023-11-02T09:40:50.959 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/50 2023-11-02T09:40:50.959 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/50 2023-11-02T09:40:50.959 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:50.959 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/50 2023-11-02T09:40:50.959 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.960 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:50.960 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.960 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.960 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.960 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.961 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.961 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:50.961 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.961 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.961 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:50.962 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/50 2023-11-02T09:40:50.962 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.962 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:DzIWLlHaU/QaXTiEI12nTi+DoHY= 2023-11-02T09:40:50.962 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:DzIWLlHaU/QaXTiEI12nTi+DoHY=', 'Content-Length': '0'} 2023-11-02T09:40:50.962 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/51 2023-11-02T09:40:50.963 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/51 2023-11-02T09:40:50.963 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:50.963 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/51 2023-11-02T09:40:50.963 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.963 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:50.964 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.964 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.964 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.964 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.965 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.965 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:50.965 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.965 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.965 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:50.966 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/51 2023-11-02T09:40:50.966 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.966 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:g7AlSLSXltYDiou8OoPrROegc+A= 2023-11-02T09:40:50.966 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:g7AlSLSXltYDiou8OoPrROegc+A=', 'Content-Length': '0'} 2023-11-02T09:40:50.966 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/52 2023-11-02T09:40:50.967 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/52 2023-11-02T09:40:50.967 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:50.967 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/52 2023-11-02T09:40:50.967 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.968 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:50.968 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.968 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.968 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.968 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.969 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.969 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:50.969 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.969 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.969 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:50.970 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/52 2023-11-02T09:40:50.970 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.970 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:VU1vZJL11mqk3xJ2MOYzqe3wWrc= 2023-11-02T09:40:50.970 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:VU1vZJL11mqk3xJ2MOYzqe3wWrc=', 'Content-Length': '0'} 2023-11-02T09:40:50.970 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/53 2023-11-02T09:40:50.971 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/53 2023-11-02T09:40:50.971 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:50.971 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/53 2023-11-02T09:40:50.971 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.971 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:50.972 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.972 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.972 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.972 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.972 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.973 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:50.973 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.973 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.973 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:50.973 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/53 2023-11-02T09:40:50.974 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.974 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:AMJMt9x+QJYLfTvMASMhT7pW09s= 2023-11-02T09:40:50.974 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:AMJMt9x+QJYLfTvMASMhT7pW09s=', 'Content-Length': '0'} 2023-11-02T09:40:50.974 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx00000db7072f379574676-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.974 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/54 2023-11-02T09:40:50.975 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/54 2023-11-02T09:40:50.975 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:50.975 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/54 2023-11-02T09:40:50.975 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.975 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:50.976 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.976 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.976 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.976 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.977 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.977 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:50.977 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.977 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.977 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:50.977 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/54 2023-11-02T09:40:50.978 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.978 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:gPWImjnK9fJXSee4hoRXnWCn3X4= 2023-11-02T09:40:50.978 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:gPWImjnK9fJXSee4hoRXnWCn3X4=', 'Content-Length': '0'} 2023-11-02T09:40:50.978 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx00000587df54388ebd160-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.979 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/55 2023-11-02T09:40:50.979 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/55 2023-11-02T09:40:50.979 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:50.979 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/55 2023-11-02T09:40:50.980 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.980 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:50.980 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.980 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.980 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.981 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.981 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.981 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:50.981 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.981 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.982 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:50.982 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/55 2023-11-02T09:40:50.982 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.982 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:HvpLrqNYXyn4MkQbLAT2MORHfWo= 2023-11-02T09:40:50.982 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:HvpLrqNYXyn4MkQbLAT2MORHfWo=', 'Content-Length': '0'} 2023-11-02T09:40:50.983 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx0000066209db0b6209784-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.983 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx00000d99e2ee4d9bc2ce7-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.983 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx00000b326e0512e090f5d-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.984 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/56 2023-11-02T09:40:50.984 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/56 2023-11-02T09:40:50.984 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:50.984 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/56 2023-11-02T09:40:50.984 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.985 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:50.985 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.985 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.985 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.985 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.986 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.986 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:50.986 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.986 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.986 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:50.987 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/56 2023-11-02T09:40:50.987 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.987 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:erV+wvX9KrvuV3LqqlgK2Q6Y6HY= 2023-11-02T09:40:50.987 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:erV+wvX9KrvuV3LqqlgK2Q6Y6HY=', 'Content-Length': '0'} 2023-11-02T09:40:50.987 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/57 2023-11-02T09:40:50.988 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/57 2023-11-02T09:40:50.988 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:50.988 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/57 2023-11-02T09:40:50.988 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.988 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:50.989 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.989 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.989 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.989 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.990 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.990 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:50.990 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.990 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.990 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:50.991 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/57 2023-11-02T09:40:50.991 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.991 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:+ADrLzJoDCyGfBxGUb1SE1Vadh8= 2023-11-02T09:40:50.991 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:+ADrLzJoDCyGfBxGUb1SE1Vadh8=', 'Content-Length': '0'} 2023-11-02T09:40:50.992 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx000001fca2b7224ac88db-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:50.992 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/58 2023-11-02T09:40:50.992 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/58 2023-11-02T09:40:50.992 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:50.992 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/58 2023-11-02T09:40:50.993 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.993 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:50.993 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.993 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.993 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.994 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.994 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.995 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:50.995 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.995 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.995 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:50.995 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/58 2023-11-02T09:40:50.996 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:50.996 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:nOq1kWfV98hvA8e8eBwxHEyNYuw= 2023-11-02T09:40:50.996 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:nOq1kWfV98hvA8e8eBwxHEyNYuw=', 'Content-Length': '0'} 2023-11-02T09:40:50.996 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/59 2023-11-02T09:40:50.996 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/59 2023-11-02T09:40:50.997 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:50.997 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/59 2023-11-02T09:40:50.997 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:50.997 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:50.997 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:50.998 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:50.998 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:50.998 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:50.998 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:50.998 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:50.999 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.999 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:50.999 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:50.999 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/59 2023-11-02T09:40:50.999 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:51.000 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:xEvxLJqTEYf2VF3ZcUrl4qn070A= 2023-11-02T09:40:51.000 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:xEvxLJqTEYf2VF3ZcUrl4qn070A=', 'Content-Length': '0'} 2023-11-02T09:40:51.000 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/6 2023-11-02T09:40:51.000 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/6 2023-11-02T09:40:51.000 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:51.001 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/6 2023-11-02T09:40:51.001 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:51.001 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:51.001 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:51.001 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:51.002 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:51.002 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:51.002 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:51.002 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:51.003 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.003 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.003 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:51.003 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/6 2023-11-02T09:40:51.003 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:51.004 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:q4gjhYT1DW62PovOQMD2VpQaUYM= 2023-11-02T09:40:51.004 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:q4gjhYT1DW62PovOQMD2VpQaUYM=', 'Content-Length': '0'} 2023-11-02T09:40:51.004 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx0000067ad21130ff9fb14-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.004 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx000002dbfc1ee59abccaa-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.004 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/60 2023-11-02T09:40:51.005 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/60 2023-11-02T09:40:51.005 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:51.005 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/60 2023-11-02T09:40:51.005 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:51.006 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:51.006 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:51.006 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:51.006 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:51.007 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:51.007 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:51.007 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:51.007 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.007 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.008 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:51.008 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/60 2023-11-02T09:40:51.008 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:51.008 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:m8geAuagEgMJexSBj1zrWeeH1W0= 2023-11-02T09:40:51.008 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:m8geAuagEgMJexSBj1zrWeeH1W0=', 'Content-Length': '0'} 2023-11-02T09:40:51.009 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/61 2023-11-02T09:40:51.009 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/61 2023-11-02T09:40:51.009 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:51.009 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/61 2023-11-02T09:40:51.009 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:51.010 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:51.010 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:51.010 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:51.010 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:51.010 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:51.011 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:51.011 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:51.011 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.011 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.011 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:51.011 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/61 2023-11-02T09:40:51.012 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:51.012 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:gpydiA+lzH3wkW5aDBwwgUkYQBU= 2023-11-02T09:40:51.012 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:gpydiA+lzH3wkW5aDBwwgUkYQBU=', 'Content-Length': '0'} 2023-11-02T09:40:51.012 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx000002173ce85ee28a8b2-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.012 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/62 2023-11-02T09:40:51.013 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/62 2023-11-02T09:40:51.013 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:51.013 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/62 2023-11-02T09:40:51.013 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:51.013 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:51.014 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:51.014 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:51.014 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:51.014 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:51.014 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:51.015 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:51.015 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.015 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.015 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:51.026 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/62 2023-11-02T09:40:51.026 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:51.027 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:Y5xb9BU5ejq0ntQwASozqQqpbck= 2023-11-02T09:40:51.027 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:Y5xb9BU5ejq0ntQwASozqQqpbck=', 'Content-Length': '0'} 2023-11-02T09:40:51.027 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/63 2023-11-02T09:40:51.027 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/63 2023-11-02T09:40:51.027 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:51.028 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/63 2023-11-02T09:40:51.028 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:51.028 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:51.028 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:51.029 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:51.029 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:51.029 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:51.029 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:51.029 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:51.029 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.030 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.030 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:51.030 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/63 2023-11-02T09:40:51.030 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:51.030 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:xltGX1KlCwrpj5hY7O3GV5ZrFtM= 2023-11-02T09:40:51.031 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:xltGX1KlCwrpj5hY7O3GV5ZrFtM=', 'Content-Length': '0'} 2023-11-02T09:40:51.031 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx000002116915d9ce982c3-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.031 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/64 2023-11-02T09:40:51.031 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/64 2023-11-02T09:40:51.031 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:51.032 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/64 2023-11-02T09:40:51.032 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:51.032 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:51.032 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:51.032 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:51.033 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:51.033 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:51.033 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:51.033 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:51.033 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.034 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.034 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:51.034 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/64 2023-11-02T09:40:51.034 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:51.034 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:wCrgODnm/E6wsGW0KXL47NxoyBQ= 2023-11-02T09:40:51.035 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:wCrgODnm/E6wsGW0KXL47NxoyBQ=', 'Content-Length': '0'} 2023-11-02T09:40:51.035 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/65 2023-11-02T09:40:51.035 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/65 2023-11-02T09:40:51.035 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:51.036 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/65 2023-11-02T09:40:51.036 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:51.036 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:51.036 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:51.036 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:51.037 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:51.037 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:51.037 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:51.037 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:51.037 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.037 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.038 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:51.038 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/65 2023-11-02T09:40:51.038 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:51.038 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:InF5wAdwMoM7uLAwwiuQMpz3Joc= 2023-11-02T09:40:51.039 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:InF5wAdwMoM7uLAwwiuQMpz3Joc=', 'Content-Length': '0'} 2023-11-02T09:40:51.039 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/66 2023-11-02T09:40:51.039 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/66 2023-11-02T09:40:51.039 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:51.039 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/66 2023-11-02T09:40:51.040 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:51.040 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:51.040 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:51.040 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:51.041 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:51.041 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:51.041 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:51.041 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:51.041 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.042 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.042 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:51.042 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/66 2023-11-02T09:40:51.042 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:51.042 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:n13uiG1JbKncZ6ezzVaZFvdF4L0= 2023-11-02T09:40:51.043 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:n13uiG1JbKncZ6ezzVaZFvdF4L0=', 'Content-Length': '0'} 2023-11-02T09:40:51.043 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx00000d4c529a365501e7f-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.043 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/67 2023-11-02T09:40:51.043 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/67 2023-11-02T09:40:51.043 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:51.044 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/67 2023-11-02T09:40:51.044 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:51.044 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:51.044 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:51.044 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:51.045 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:51.045 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:51.045 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:51.045 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:51.045 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.046 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.046 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:51.046 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/67 2023-11-02T09:40:51.046 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:51.046 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:yfguTEW6rsDva8Sr60wuvzWSOoM= 2023-11-02T09:40:51.047 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:yfguTEW6rsDva8Sr60wuvzWSOoM=', 'Content-Length': '0'} 2023-11-02T09:40:51.047 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx00000bedcf26a3bed6340-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.047 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/68 2023-11-02T09:40:51.047 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/68 2023-11-02T09:40:51.047 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:51.048 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/68 2023-11-02T09:40:51.048 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:51.048 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:51.048 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:51.048 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:51.049 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:51.049 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:51.049 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:51.049 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:51.049 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.050 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.050 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:51.050 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/68 2023-11-02T09:40:51.050 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:51.050 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:6wAq+NEFx8nq7jl00Tv7De04F4Q= 2023-11-02T09:40:51.051 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:6wAq+NEFx8nq7jl00Tv7De04F4Q=', 'Content-Length': '0'} 2023-11-02T09:40:51.051 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/69 2023-11-02T09:40:51.051 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/69 2023-11-02T09:40:51.051 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:51.051 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/69 2023-11-02T09:40:51.051 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:51.052 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:51.052 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:51.052 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:51.052 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:51.053 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:51.053 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:51.053 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:51.053 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.053 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.054 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:51.054 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/69 2023-11-02T09:40:51.054 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:51.054 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:XFtnP4INeNXb4CdAQBguFnrO0n4= 2023-11-02T09:40:51.054 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:XFtnP4INeNXb4CdAQBguFnrO0n4=', 'Content-Length': '0'} 2023-11-02T09:40:51.055 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/7 2023-11-02T09:40:51.055 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/7 2023-11-02T09:40:51.055 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:51.055 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/7 2023-11-02T09:40:51.055 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:51.056 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:51.056 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:51.056 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:51.056 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:51.056 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:51.057 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:51.057 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:51.057 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.057 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.057 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:51.058 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/7 2023-11-02T09:40:51.058 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:51.058 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:XQTYvJqGn2UMNQfUbK9kKVWDevI= 2023-11-02T09:40:51.059 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:XQTYvJqGn2UMNQfUbK9kKVWDevI=', 'Content-Length': '0'} 2023-11-02T09:40:51.059 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx00000dd5ef456947e99b5-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.059 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx0000078894a3098a80766-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.059 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx00000c65ca1dbbd9d77e7-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.059 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/70 2023-11-02T09:40:51.060 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/70 2023-11-02T09:40:51.060 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:51.060 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/70 2023-11-02T09:40:51.060 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:51.060 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:51.061 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:51.061 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:51.061 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:51.061 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:51.061 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:51.062 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:51.062 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.062 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.062 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:51.062 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/70 2023-11-02T09:40:51.063 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:51.063 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:srUhMOtQoFD3ZYBWkuqbif7Oxgw= 2023-11-02T09:40:51.063 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:srUhMOtQoFD3ZYBWkuqbif7Oxgw=', 'Content-Length': '0'} 2023-11-02T09:40:51.063 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx000007772dd384e699e99-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.063 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx00000a70bb12045074bc8-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.064 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/71 2023-11-02T09:40:51.064 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/71 2023-11-02T09:40:51.064 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:51.065 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/71 2023-11-02T09:40:51.065 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:51.065 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:51.065 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:51.065 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:51.066 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:51.066 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:51.066 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:51.066 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:51.066 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.067 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.067 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:51.067 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/71 2023-11-02T09:40:51.067 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:51.068 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:oLYeL/dSmUoTNrzOaBewwVE6ftQ= 2023-11-02T09:40:51.068 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:oLYeL/dSmUoTNrzOaBewwVE6ftQ=', 'Content-Length': '0'} 2023-11-02T09:40:51.068 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/72 2023-11-02T09:40:51.068 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/72 2023-11-02T09:40:51.068 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:51.069 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/72 2023-11-02T09:40:51.069 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:51.069 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:51.069 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:51.069 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:51.070 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:51.070 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:51.070 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:51.070 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:51.071 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.071 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.071 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:51.071 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/72 2023-11-02T09:40:51.071 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:51.072 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:3SoNGPi7jqbadVvbQvhoB/Qe3NQ= 2023-11-02T09:40:51.072 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:3SoNGPi7jqbadVvbQvhoB/Qe3NQ=', 'Content-Length': '0'} 2023-11-02T09:40:51.072 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx0000074abe04b2d77383e-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.072 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx000009aeaa511da4e57a6-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.072 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx000001aaf28ae58736af6-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.073 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/73 2023-11-02T09:40:51.073 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/73 2023-11-02T09:40:51.073 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:51.073 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/73 2023-11-02T09:40:51.074 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:51.074 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:51.074 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:51.074 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:51.074 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:51.075 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:51.075 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:51.075 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:51.075 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.075 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.076 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:51.076 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/73 2023-11-02T09:40:51.076 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:51.076 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:FwRffiuGM6sL7G0UxxwYR13ZU7U= 2023-11-02T09:40:51.077 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:FwRffiuGM6sL7G0UxxwYR13ZU7U=', 'Content-Length': '0'} 2023-11-02T09:40:51.077 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx00000f5e4b1c99b194f1a-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.077 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/74 2023-11-02T09:40:51.077 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/74 2023-11-02T09:40:51.077 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:51.078 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/74 2023-11-02T09:40:51.078 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:51.078 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:51.078 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:51.078 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:51.079 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:51.079 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:51.079 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:51.079 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:51.080 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.080 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.080 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:51.080 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/74 2023-11-02T09:40:51.080 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:51.081 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:WJrRU7d8c5Gx3vq4HcoE2QX9Z24= 2023-11-02T09:40:51.081 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:WJrRU7d8c5Gx3vq4HcoE2QX9Z24=', 'Content-Length': '0'} 2023-11-02T09:40:51.081 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/75 2023-11-02T09:40:51.081 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/75 2023-11-02T09:40:51.081 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:51.082 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/75 2023-11-02T09:40:51.082 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:51.082 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:51.082 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:51.083 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:51.083 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:51.083 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:51.084 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:51.084 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:51.084 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.084 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.084 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:51.085 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/75 2023-11-02T09:40:51.085 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:51.085 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:QyNGXeJefsS94GOg3iXVkvsQuxc= 2023-11-02T09:40:51.085 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:QyNGXeJefsS94GOg3iXVkvsQuxc=', 'Content-Length': '0'} 2023-11-02T09:40:51.086 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/76 2023-11-02T09:40:51.087 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/76 2023-11-02T09:40:51.087 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:51.087 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/76 2023-11-02T09:40:51.087 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:51.087 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:51.088 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:51.088 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:51.088 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:51.088 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:51.088 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:51.089 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:51.089 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.089 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.089 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:51.089 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/76 2023-11-02T09:40:51.090 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:51.090 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:aho0vuMSCv+tX0lNPWPOcJoHKZc= 2023-11-02T09:40:51.090 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:aho0vuMSCv+tX0lNPWPOcJoHKZc=', 'Content-Length': '0'} 2023-11-02T09:40:51.090 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/77 2023-11-02T09:40:51.090 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/77 2023-11-02T09:40:51.091 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:51.091 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/77 2023-11-02T09:40:51.091 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:51.091 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:51.092 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:51.092 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:51.092 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:51.092 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:51.092 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:51.093 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:51.093 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.093 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.093 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:51.093 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/77 2023-11-02T09:40:51.094 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:51.094 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:ctxzftVOBymH0ABPIJFdtrKe2fc= 2023-11-02T09:40:51.094 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:ctxzftVOBymH0ABPIJFdtrKe2fc=', 'Content-Length': '0'} 2023-11-02T09:40:51.094 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/78 2023-11-02T09:40:51.095 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/78 2023-11-02T09:40:51.095 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:51.095 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/78 2023-11-02T09:40:51.095 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:51.095 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:51.096 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:51.096 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:51.096 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:51.096 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:51.097 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:51.097 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:51.097 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.097 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.097 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:51.098 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/78 2023-11-02T09:40:51.098 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:51.098 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:bGCb6S0XfyTO5imddKhROU6JCoA= 2023-11-02T09:40:51.098 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:bGCb6S0XfyTO5imddKhROU6JCoA=', 'Content-Length': '0'} 2023-11-02T09:40:51.098 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/79 2023-11-02T09:40:51.099 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/79 2023-11-02T09:40:51.099 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:51.099 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/79 2023-11-02T09:40:51.099 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:51.100 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:51.100 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:51.100 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:51.100 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:51.100 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:51.101 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:51.101 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:51.101 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.101 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.101 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:51.102 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/79 2023-11-02T09:40:51.102 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:51.102 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:TOLoo8iEIeBJgtVakVEZ8uIu3qE= 2023-11-02T09:40:51.102 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:TOLoo8iEIeBJgtVakVEZ8uIu3qE=', 'Content-Length': '0'} 2023-11-02T09:40:51.102 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx000009a6c59ff1561eaa6-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.103 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/8 2023-11-02T09:40:51.103 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/8 2023-11-02T09:40:51.103 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:51.103 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/8 2023-11-02T09:40:51.103 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:51.104 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:51.104 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:51.104 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:51.104 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:51.104 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:51.105 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:51.105 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:51.105 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.105 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.105 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:51.106 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/8 2023-11-02T09:40:51.106 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:51.106 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:5bZrrC51iKwtGkKFPZeMPNvYRxk= 2023-11-02T09:40:51.106 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:5bZrrC51iKwtGkKFPZeMPNvYRxk=', 'Content-Length': '0'} 2023-11-02T09:40:51.106 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx0000040c0996bc62fa496-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.107 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/80 2023-11-02T09:40:51.107 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/80 2023-11-02T09:40:51.107 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:51.107 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/80 2023-11-02T09:40:51.107 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:51.108 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:51.108 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:51.108 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:51.108 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:51.108 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:51.109 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:51.109 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:51.109 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.109 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.109 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:51.110 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/80 2023-11-02T09:40:51.110 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:51.110 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:OUJCG67idKPq0QxM+bRJFFDay+s= 2023-11-02T09:40:51.110 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:OUJCG67idKPq0QxM+bRJFFDay+s=', 'Content-Length': '0'} 2023-11-02T09:40:51.111 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/81 2023-11-02T09:40:51.111 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/81 2023-11-02T09:40:51.111 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:51.111 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/81 2023-11-02T09:40:51.111 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:51.112 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:51.112 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:51.112 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:51.112 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:51.112 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:51.113 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:51.113 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:51.113 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.113 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.113 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:51.114 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/81 2023-11-02T09:40:51.114 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:51.114 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:ZXzuZTW7dhY/8KPXMX0WjqSq/f0= 2023-11-02T09:40:51.114 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:ZXzuZTW7dhY/8KPXMX0WjqSq/f0=', 'Content-Length': '0'} 2023-11-02T09:40:51.114 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx00000d9cfac19bb1c7d6c-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.115 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/82 2023-11-02T09:40:51.115 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/82 2023-11-02T09:40:51.115 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:51.115 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/82 2023-11-02T09:40:51.115 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:51.116 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:51.116 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:51.116 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:51.116 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:51.116 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:51.117 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:51.117 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:51.117 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.117 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.117 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:51.118 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/82 2023-11-02T09:40:51.118 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:51.118 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:G+PmgNYFxR3YUEllspOTwSKN9ck= 2023-11-02T09:40:51.118 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:G+PmgNYFxR3YUEllspOTwSKN9ck=', 'Content-Length': '0'} 2023-11-02T09:40:51.118 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx000004048836630347604-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.119 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx00000c5bed497cff6559d-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.119 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx00000de6c9d8d6008680a-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.119 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/83 2023-11-02T09:40:51.119 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/83 2023-11-02T09:40:51.119 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:51.120 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/83 2023-11-02T09:40:51.120 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:51.120 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:51.120 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:51.120 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:51.121 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:51.121 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:51.121 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:51.121 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:51.121 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.122 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.122 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:51.122 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/83 2023-11-02T09:40:51.122 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:51.122 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:RLlhBpJyhGBFWVtR/ATBbUoqzK0= 2023-11-02T09:40:51.123 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:RLlhBpJyhGBFWVtR/ATBbUoqzK0=', 'Content-Length': '0'} 2023-11-02T09:40:51.123 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/84 2023-11-02T09:40:51.123 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/84 2023-11-02T09:40:51.123 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:51.123 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/84 2023-11-02T09:40:51.124 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:51.124 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:51.124 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:51.124 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:51.124 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:51.125 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:51.125 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:51.125 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:51.125 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.125 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.126 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:51.126 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/84 2023-11-02T09:40:51.126 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:51.126 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:aoVAJCSLASmQS+Uvzi62/6pF4KI= 2023-11-02T09:40:51.126 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:aoVAJCSLASmQS+Uvzi62/6pF4KI=', 'Content-Length': '0'} 2023-11-02T09:40:51.127 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx0000060cd90cb2c856737-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.127 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx00000a4ad83f664b1bd36-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.127 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/85 2023-11-02T09:40:51.127 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/85 2023-11-02T09:40:51.127 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:51.128 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/85 2023-11-02T09:40:51.128 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:51.128 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:51.128 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:51.128 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:51.129 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:51.129 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:51.129 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:51.129 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:51.129 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.130 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.130 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:51.130 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/85 2023-11-02T09:40:51.130 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:51.130 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:4G1C4f4PxSPfxSzlBDdGihoi1Kg= 2023-11-02T09:40:51.131 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:4G1C4f4PxSPfxSzlBDdGihoi1Kg=', 'Content-Length': '0'} 2023-11-02T09:40:51.131 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/86 2023-11-02T09:40:51.131 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/86 2023-11-02T09:40:51.131 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:51.131 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/86 2023-11-02T09:40:51.132 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:51.132 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:51.132 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:51.132 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:51.132 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:51.133 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:51.133 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:51.133 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:51.133 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.133 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.133 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:51.134 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/86 2023-11-02T09:40:51.134 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:51.134 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:3MW5UDljfRljvK/xwFoT5IR9Jl0= 2023-11-02T09:40:51.134 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:3MW5UDljfRljvK/xwFoT5IR9Jl0=', 'Content-Length': '0'} 2023-11-02T09:40:51.134 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/87 2023-11-02T09:40:51.135 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/87 2023-11-02T09:40:51.135 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:51.135 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/87 2023-11-02T09:40:51.135 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:51.135 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:51.136 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:51.136 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:51.136 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:51.136 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:51.136 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:51.137 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:51.137 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.137 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.137 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:51.137 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/87 2023-11-02T09:40:51.138 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:51.138 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:RpLcUlJ4LVckdNQKZzDumqPbnhY= 2023-11-02T09:40:51.138 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:RpLcUlJ4LVckdNQKZzDumqPbnhY=', 'Content-Length': '0'} 2023-11-02T09:40:51.138 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/88 2023-11-02T09:40:51.138 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/88 2023-11-02T09:40:51.139 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:51.139 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/88 2023-11-02T09:40:51.139 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:51.139 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:51.139 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:51.140 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:51.140 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:51.140 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:51.140 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:51.140 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:51.141 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.141 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.141 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:51.141 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/88 2023-11-02T09:40:51.141 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:51.142 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:0B8zyt7HdJt+XOJjXH+4EPJDXME= 2023-11-02T09:40:51.142 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:0B8zyt7HdJt+XOJjXH+4EPJDXME=', 'Content-Length': '0'} 2023-11-02T09:40:51.142 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/89 2023-11-02T09:40:51.142 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/89 2023-11-02T09:40:51.142 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:51.143 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/89 2023-11-02T09:40:51.143 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:51.143 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:51.143 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:51.143 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:51.144 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:51.144 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:51.144 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:51.144 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:51.144 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.145 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.145 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:51.145 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/89 2023-11-02T09:40:51.145 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:51.146 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:vigiwijSyVVQKzDJ4HvyzRrbraE= 2023-11-02T09:40:51.146 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:vigiwijSyVVQKzDJ4HvyzRrbraE=', 'Content-Length': '0'} 2023-11-02T09:40:51.146 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx00000c675680c7231d52b-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.146 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/9 2023-11-02T09:40:51.146 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/9 2023-11-02T09:40:51.147 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:51.147 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/9 2023-11-02T09:40:51.147 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:51.147 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:51.147 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:51.148 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:51.148 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:51.148 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:51.148 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:51.148 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:51.149 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.149 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.149 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:51.149 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/9 2023-11-02T09:40:51.149 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:51.150 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:QEtE9MR8afZ3QZQS5g1CbhMR6mI= 2023-11-02T09:40:51.151 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:QEtE9MR8afZ3QZQS5g1CbhMR6mI=', 'Content-Length': '0'} 2023-11-02T09:40:51.151 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx00000b9e93427131bd428-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.151 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/90 2023-11-02T09:40:51.151 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/90 2023-11-02T09:40:51.152 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:51.152 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/90 2023-11-02T09:40:51.152 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:51.152 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:51.152 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:51.153 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:51.153 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:51.153 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:51.153 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:51.153 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:51.154 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.154 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.154 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:51.154 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/90 2023-11-02T09:40:51.154 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:51.155 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:PJov/V+VYllNBskgx7wlBRKsJX8= 2023-11-02T09:40:51.155 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:PJov/V+VYllNBskgx7wlBRKsJX8=', 'Content-Length': '0'} 2023-11-02T09:40:51.155 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/91 2023-11-02T09:40:51.155 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/91 2023-11-02T09:40:51.156 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:51.157 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/91 2023-11-02T09:40:51.157 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:51.158 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:51.158 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:51.158 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:51.158 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:51.159 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:51.159 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:51.159 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:51.159 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.160 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.160 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:51.160 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/91 2023-11-02T09:40:51.160 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:51.160 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:SZHXboRbgR/ylouBke4MukrA5uU= 2023-11-02T09:40:51.161 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:SZHXboRbgR/ylouBke4MukrA5uU=', 'Content-Length': '0'} 2023-11-02T09:40:51.161 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx0000062c6c35d436ebd71-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.161 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx00000e7ff3137a5f760a5-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.161 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx0000015fe13b65f886e76-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.161 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx00000018c365732567d62-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.162 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/92 2023-11-02T09:40:51.162 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/92 2023-11-02T09:40:51.162 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:51.162 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/92 2023-11-02T09:40:51.162 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:51.163 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:51.163 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:51.163 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:51.163 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:51.163 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:51.163 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:51.164 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:51.164 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.164 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.164 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:51.164 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/92 2023-11-02T09:40:51.165 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:51.165 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:Gr+GyJtMwAn6ssdUWGuXUKHd57o= 2023-11-02T09:40:51.165 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:Gr+GyJtMwAn6ssdUWGuXUKHd57o=', 'Content-Length': '0'} 2023-11-02T09:40:51.165 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx000007dd6845725bcd11d-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.165 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/93 2023-11-02T09:40:51.166 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/93 2023-11-02T09:40:51.166 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:51.166 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/93 2023-11-02T09:40:51.166 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:51.166 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:51.167 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:51.167 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:51.167 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:51.167 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:51.167 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:51.168 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:51.168 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.168 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.168 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:51.168 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/93 2023-11-02T09:40:51.168 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:51.169 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:xpXKHIjzkBlF6REZsNA1G1e7sn8= 2023-11-02T09:40:51.169 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:xpXKHIjzkBlF6REZsNA1G1e7sn8=', 'Content-Length': '0'} 2023-11-02T09:40:51.169 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/94 2023-11-02T09:40:51.169 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/94 2023-11-02T09:40:51.169 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:51.170 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/94 2023-11-02T09:40:51.170 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:51.170 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:51.170 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:51.171 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:51.171 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:51.171 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:51.171 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:51.171 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:51.172 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.172 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.172 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:51.172 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/94 2023-11-02T09:40:51.172 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:51.173 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:MX2Z3eMC7hShZbrwHXHYLLTLFPs= 2023-11-02T09:40:51.173 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:MX2Z3eMC7hShZbrwHXHYLLTLFPs=', 'Content-Length': '0'} 2023-11-02T09:40:51.173 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx00000838bd37b93a5a6ac-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.173 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx0000041e2f1fd2d6fb44f-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.173 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx00000c17a5478069929a2-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.174 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/95 2023-11-02T09:40:51.174 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/95 2023-11-02T09:40:51.174 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:51.174 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/95 2023-11-02T09:40:51.175 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:51.175 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:51.175 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:51.175 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:51.175 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:51.176 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:51.176 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:51.176 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:51.176 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.176 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.177 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:51.177 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/95 2023-11-02T09:40:51.177 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:51.177 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:TQ83wjoFBoJjYO7Fs3ABL62lZOw= 2023-11-02T09:40:51.177 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:TQ83wjoFBoJjYO7Fs3ABL62lZOw=', 'Content-Length': '0'} 2023-11-02T09:40:51.178 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/96 2023-11-02T09:40:51.178 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/96 2023-11-02T09:40:51.178 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:51.178 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/96 2023-11-02T09:40:51.178 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:51.178 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:51.179 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:51.179 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:51.179 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:51.179 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:51.179 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:51.180 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:51.180 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.180 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.180 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:51.180 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/96 2023-11-02T09:40:51.181 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:51.181 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:EfrHGA/IGnMI8/WNKdynNkMNYG0= 2023-11-02T09:40:51.181 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:EfrHGA/IGnMI8/WNKdynNkMNYG0=', 'Content-Length': '0'} 2023-11-02T09:40:51.181 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/97 2023-11-02T09:40:51.182 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/97 2023-11-02T09:40:51.182 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:51.182 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/97 2023-11-02T09:40:51.182 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:51.182 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:51.183 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:51.183 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:51.183 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:51.183 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:51.183 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:51.184 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:51.184 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.184 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.184 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:51.184 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/97 2023-11-02T09:40:51.185 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:51.185 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:2B3dWOeGb98u+ZTOpXjPyf5bWis= 2023-11-02T09:40:51.185 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:2B3dWOeGb98u+ZTOpXjPyf5bWis=', 'Content-Length': '0'} 2023-11-02T09:40:51.185 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx00000118ff3b0bd5057d4-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.185 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/98 2023-11-02T09:40:51.186 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/98 2023-11-02T09:40:51.186 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:51.186 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/98 2023-11-02T09:40:51.186 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:51.186 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:51.187 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:51.187 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:51.187 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:51.187 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:51.188 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:51.188 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:51.188 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.188 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.188 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:51.189 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/98 2023-11-02T09:40:51.189 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:51.189 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:xXMaJF8NH18gyotNhhASZcUgNMM= 2023-11-02T09:40:51.189 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:xXMaJF8NH18gyotNhhASZcUgNMM=', 'Content-Length': '0'} 2023-11-02T09:40:51.190 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: path=/uicwqr-11/99 2023-11-02T09:40:51.190 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: auth_path=/uicwqr-11/99 2023-11-02T09:40:51.190 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Method: DELETE 2023-11-02T09:40:51.190 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Path: /uicwqr-11/99 2023-11-02T09:40:51.190 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Data: 2023-11-02T09:40:51.190 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Headers: {} 2023-11-02T09:40:51.191 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Host: smithi156.front.sepia.ceph.com 2023-11-02T09:40:51.191 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Port: 80 2023-11-02T09:40:51.191 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Params: {} 2023-11-02T09:40:51.191 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Token: None 2023-11-02T09:40:51.192 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: StringToSign: 2023-11-02T09:40:51.192 INFO:teuthology.orchestra.run.smithi156.stderr:DELETE 2023-11-02T09:40:51.192 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.192 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.192 INFO:teuthology.orchestra.run.smithi156.stderr:Thu, 02 Nov 2023 09:32:18 GMT 2023-11-02T09:40:51.193 INFO:teuthology.orchestra.run.smithi156.stderr:/uicwqr-11/99 2023-11-02T09:40:51.193 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Signature: 2023-11-02T09:40:51.193 INFO:teuthology.orchestra.run.smithi156.stderr:AWS HXZDMROXJJZZSFNUKJXB:qFV92Mu7VrueYULpUZeFzQq0srw= 2023-11-02T09:40:51.193 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.17 Linux/5.14.0-378.el9.x86_64', 'Date': 'Thu, 02 Nov 2023 09:32:18 GMT', 'Authorization': 'AWS HXZDMROXJJZZSFNUKJXB:qFV92Mu7VrueYULpUZeFzQq0srw=', 'Content-Length': '0'} 2023-11-02T09:40:51.193 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx00000ba9d7fec09ff8ad3-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.194 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx00000b1f5f991cfd29def-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.194 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx00000c17ee3ab5d31a764-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.194 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx00000827ab3ae016c4bad-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.194 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx00000102868f6d9650e9f-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.195 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx000001558c9a49ad9ce98-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.195 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx00000e873ba46e9c9ee18-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.195 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx0000037cc9f6856b94a3d-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.195 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx000005d07a3624cd207fe-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.196 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx0000001b11b591e30b61c-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.196 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx000006973a635a97d205f-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.196 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx00000eeeed023c58e5da0-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.196 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx00000482cbf5642d9a17c-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.196 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx00000e864f000d4016227-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.197 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx0000050f118ecc573d521-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.197 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx00000e377e0329864618e-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.197 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx00000e57dea77456468ee-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.197 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Recv would block on 2023-11-02T09:40:51.198 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:51.198 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:32:18.792720Z","eventName":"ObjectRemoved:Delete","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.12534944429520467058","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"0","size":3008193,"eTag":"4d9bfa7a659fc80c21da490b91b9e278","versionId":"","sequencer":"A26C4365A308402F","metadata":[],"tags":[]}},"eventId":"1698917538.792725.4d9bfa7a659fc80c21da490b91b9e278","opaqueData":""}]}' 2023-11-02T09:40:51.198 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:51.198 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:32:18.798503Z","eventName":"ObjectRemoved:Delete","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.16872847146346019593","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"13","size":3010407,"eTag":"75f9bdee944835dc845f562dbf3f23bb","versionId":"","sequencer":"A26C43655747982F","metadata":[],"tags":[]}},"eventId":"1698917538.798508.75f9bdee944835dc845f562dbf3f23bb","opaqueData":""}]}' 2023-11-02T09:40:51.198 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:51.199 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:32:18.798771Z","eventName":"ObjectRemoved:Delete","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.10032279401345246491","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"11","size":3009872,"eTag":"c83720345f1301c2c0a52a7509813b31","versionId":"","sequencer":"A26C43653A5B9C2F","metadata":[],"tags":[]}},"eventId":"1698917538.798776.c83720345f1301c2c0a52a7509813b31","opaqueData":""}]}' 2023-11-02T09:40:51.199 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:51.199 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:32:18.799664Z","eventName":"ObjectRemoved:Delete","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.132735815440313595","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"10","size":3011710,"eTag":"cfaba7ff9eeb7287c47d4400453a8998","versionId":"","sequencer":"A26C43652FF9A92F","metadata":[],"tags":[]}},"eventId":"1698917538.799668.cfaba7ff9eeb7287c47d4400453a8998","opaqueData":""}]}' 2023-11-02T09:40:51.199 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:51.200 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:32:18.801065Z","eventName":"ObjectRemoved:Delete","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.7155830470977520790","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"12","size":3008825,"eTag":"b4eb3a700eafb5a7ada6b121b111e210","versionId":"","sequencer":"A26C4365A459BF2F","metadata":[],"tags":[]}},"eventId":"1698917538.801069.b4eb3a700eafb5a7ada6b121b111e210","opaqueData":""}]}' 2023-11-02T09:40:51.200 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:51.200 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:32:18.801267Z","eventName":"ObjectRemoved:Delete","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.16938373256437287923","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"1","size":3010806,"eTag":"d0a091c9500f23d29c225ebdd3c70221","versionId":"","sequencer":"A26C4365276FC22F","metadata":[],"tags":[]}},"eventId":"1698917538.801271.d0a091c9500f23d29c225ebdd3c70221","opaqueData":""}]}' 2023-11-02T09:40:51.200 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:51.200 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:32:18.804587Z","eventName":"ObjectRemoved:Delete","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.6092564479063972532","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"16","size":3012129,"eTag":"4a7d36f4e9e82b4c81be3c6162d4e7b5","versionId":"","sequencer":"A26C43654A19F52F","metadata":[],"tags":[]}},"eventId":"1698917538.804591.4a7d36f4e9e82b4c81be3c6162d4e7b5","opaqueData":""}]}' 2023-11-02T09:40:51.201 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:51.201 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:32:18.804887Z","eventName":"ObjectRemoved:Delete","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.17522544337727317134","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"15","size":3011515,"eTag":"cac889193ae8b099111cb50c070008db","versionId":"","sequencer":"A26C43655DABF92F","metadata":[],"tags":[]}},"eventId":"1698917538.804891.cac889193ae8b099111cb50c070008db","opaqueData":""}]}' 2023-11-02T09:40:51.201 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:51.201 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:32:18.807743Z","eventName":"ObjectRemoved:Delete","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.6481438102430438115","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"14","size":3013150,"eTag":"c75f0b5188c0d164f73dedae781681c5","versionId":"","sequencer":"A26C4365AD3D2530","metadata":[],"tags":[]}},"eventId":"1698917538.807746.c75f0b5188c0d164f73dedae781681c5","opaqueData":""}]}' 2023-11-02T09:40:51.202 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:51.202 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:32:18.811246Z","eventName":"ObjectRemoved:Delete","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.341123154068418276","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"18","size":3011586,"eTag":"4670f56705c97bb35fc2245e568ba94c","versionId":"","sequencer":"A26C43652EB75A30","metadata":[],"tags":[]}},"eventId":"1698917538.811251.4670f56705c97bb35fc2245e568ba94c","opaqueData":""}]}' 2023-11-02T09:40:51.202 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:51.202 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:32:18.811819Z","eventName":"ObjectRemoved:Delete","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.13202417096337484353","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"19","size":3010832,"eTag":"57addb472990f147e57ca974ac0b9a38","versionId":"","sequencer":"A26C4365A3726330","metadata":[],"tags":[]}},"eventId":"1698917538.811823.57addb472990f147e57ca974ac0b9a38","opaqueData":""}]}' 2023-11-02T09:40:51.202 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:51.203 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:32:18.812272Z","eventName":"ObjectRemoved:Delete","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.17192499889386562356","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"2","size":3008496,"eTag":"ab6c1c09bec3f9a3d6c9e7252b72ccf2","versionId":"","sequencer":"A26C436537596A30","metadata":[],"tags":[]}},"eventId":"1698917538.812276.ab6c1c09bec3f9a3d6c9e7252b72ccf2","opaqueData":""}]}' 2023-11-02T09:40:51.203 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:51.203 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:32:18.812802Z","eventName":"ObjectRemoved:Delete","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.465985375994865750","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"17","size":3010541,"eTag":"26dfc210289793613e0c3dd91bc04481","versionId":"","sequencer":"A26C4365E7707230","metadata":[],"tags":[]}},"eventId":"1698917538.812806.26dfc210289793613e0c3dd91bc04481","opaqueData":""}]}' 2023-11-02T09:40:51.203 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:51.204 INFO:teuthology.orchestra.run.smithi156.stdout:reply: 'HTTP/1.1 200 OK\r\n' 2023-11-02T09:40:51.204 INFO:teuthology.orchestra.run.smithi156.stdout:header: x-amz-request-id: tx00000c9ab2ec7e46f3d29-0065436c78-117b-default 2023-11-02T09:40:51.204 INFO:teuthology.orchestra.run.smithi156.stdout:header: Server: Ceph Object Gateway (reef) 2023-11-02T09:40:51.205 INFO:teuthology.orchestra.run.smithi156.stdout:header: Content-Length: 0 2023-11-02T09:40:51.205 INFO:teuthology.orchestra.run.smithi156.stdout:header: Date: Thu, 02 Nov 2023 09:31:36 GMT 2023-11-02T09:40:51.205 INFO:teuthology.orchestra.run.smithi156.stdout:header: Connection: Keep-Alive 2023-11-02T09:40:51.205 INFO:teuthology.orchestra.run.smithi156.stdout:average time for creation + async http notification is: 21.243090629577637 milliseconds 2023-11-02T09:40:51.205 INFO:teuthology.orchestra.run.smithi156.stdout:wait for 40sec for the messages... 2023-11-02T09:40:51.206 INFO:teuthology.orchestra.run.smithi156.stdout:average time for deletion + async http notification is: 1.8824458122253418 milliseconds 2023-11-02T09:40:51.206 INFO:teuthology.orchestra.run.smithi156.stdout:wait for 40sec for the messages... 2023-11-02T09:40:51.206 INFO:teuthology.orchestra.run.smithi156.stdout:Error: [Errno 111] Connection refused 2023-11-02T09:40:51.206 INFO:teuthology.orchestra.run.smithi156.stdout:average time for creation + async http notification is: 4126.389985084534 milliseconds 2023-11-02T09:40:51.207 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-02T09:40:51.208 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:32:18.814461Z","eventName":"ObjectRemoved:Delete","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.6426077729051664910","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"20","size":3010447,"eTag":"c49246d62c2fd4bfa19dc6803784f7c3","versionId":"","sequencer":"A26C4365CFC38B30","metadata":[],"tags":[]}},"eventId":"1698917538.814465.c49246d62c2fd4bfa19dc6803784f7c3","opaqueData":""}]}' 2023-11-02T09:40:51.208 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:51.208 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:32:18.814791Z","eventName":"ObjectRemoved:Delete","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.178528148727688347","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"21","size":3006835,"eTag":"b96cec79851566de77af1b4b542ba2ab","versionId":"","sequencer":"A26C4365EEC89030","metadata":[],"tags":[]}},"eventId":"1698917538.814794.b96cec79851566de77af1b4b542ba2ab","opaqueData":""}]}' 2023-11-02T09:40:51.208 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:51.209 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:32:18.816952Z","eventName":"ObjectRemoved:Delete","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.12688376993180373450","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"22","size":3010949,"eTag":"83110247f72fb41dc3560b7b5e40b200","versionId":"","sequencer":"A26C436581C6B130","metadata":[],"tags":[]}},"eventId":"1698917538.816957.83110247f72fb41dc3560b7b5e40b200","opaqueData":""}]}' 2023-11-02T09:40:51.209 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:51.209 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:32:18.821825Z","eventName":"ObjectRemoved:Delete","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.14584585687908321139","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"23","size":3008375,"eTag":"3dc4a1b2aa3dde9a84860e0fb5e0b078","versionId":"","sequencer":"A26C43651E1BFC30","metadata":[],"tags":[]}},"eventId":"1698917538.821828.3dc4a1b2aa3dde9a84860e0fb5e0b078","opaqueData":""}]}' 2023-11-02T09:40:51.209 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:51.209 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:32:18.824865Z","eventName":"ObjectRemoved:Delete","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.11905127229658922859","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"27","size":3008994,"eTag":"aeedc952682f9619d55b3adc5b9a4c42","versionId":"","sequencer":"A26C4365F0822A31","metadata":[],"tags":[]}},"eventId":"1698917538.824869.aeedc952682f9619d55b3adc5b9a4c42","opaqueData":""}]}' 2023-11-02T09:40:51.210 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:51.210 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:32:18.825060Z","eventName":"ObjectRemoved:Delete","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.9697913134112565753","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"26","size":3011294,"eTag":"2d990fc14947bb6d4d8a4c0d4891bfb4","versionId":"","sequencer":"A26C4365797A2D31","metadata":[],"tags":[]}},"eventId":"1698917538.825064.2d990fc14947bb6d4d8a4c0d4891bfb4","opaqueData":""}]}' 2023-11-02T09:40:51.210 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:51.210 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:32:18.826991Z","eventName":"ObjectRemoved:Delete","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.7086288309551342805","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"25","size":3011210,"eTag":"717331ce6efac34d8c877ad587119113","versionId":"","sequencer":"A26C43651CEF4A31","metadata":[],"tags":[]}},"eventId":"1698917538.826994.717331ce6efac34d8c877ad587119113","opaqueData":""}]}' 2023-11-02T09:40:51.210 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:51.211 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:32:18.827460Z","eventName":"ObjectRemoved:Delete","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.15184816492704526753","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"24","size":3011281,"eTag":"e45e392e9df86ec9e4ea10cb44ca61c0","versionId":"","sequencer":"A26C4365421B5231","metadata":[],"tags":[]}},"eventId":"1698917538.827464.e45e392e9df86ec9e4ea10cb44ca61c0","opaqueData":""}]}' 2023-11-02T09:40:51.211 INFO:teuthology.orchestra.run.smithi156.stderr:bucket_notification.test_bn: INFO: AMQP received event for topic uicwqr-11_topic: 2023-11-02T09:40:51.211 INFO:teuthology.orchestra.run.smithi156.stderr: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"default","eventTime":"2023-11-02T09:32:18.830000Z","eventName":"ObjectRemoved:Delete","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4475.11185319495759000952","x-amz-id-2":"117b-default-default"},"s3":{"s3SchemaVersion":"1.0","configurationId":"uicwqr-11_notif","bucket":{"name":"uicwqr-11","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:default::uicwqr-11","id":"8100026f-34ce-4e78-9bac-c57f344b7c64.4578.11"},"object":{"key":"28","size":3008683,"eTag":"2bd4ac247feaddfa8e1693aac5ef9d00","versionId":"","sequencer":"A26C436543E17831","metadata":[],"tags":[]}},"eventId":"1698917538.830005.2bd4ac247feaddfa8e1693aac5ef9d00","opaqueData":""}]}' 2023-11-02T09:40:51.212 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx000000dfa04ae7aaaf5ed-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.212 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx00000a430078f89c35395-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.212 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx000008c1bf9a650d8b8e3-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.212 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx000006b635f43e47b0c0d-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.212 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx000007818a2edd280a63a-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.213 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx000008c8380f369023c8f-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.213 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx00000e90fbb146b4b529f-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.213 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx000007ad21f2506aeb5eb-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.213 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx0000055d0eca7b77fbf2f-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.213 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx00000b2abde9118954d5f-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.214 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx000002abb52a935730efa-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.214 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx00000cc6fb86ec3af3da0-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.214 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx000009c02c7d60512b16d-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.214 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx00000ebb08fc67a9fe6c5-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.214 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx0000031c711bec1a09491-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.215 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx00000c3b3b29f065c5830-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.215 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx0000016e5bff9afa6c567-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.215 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx000005dace85b0ee363a2-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.215 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx0000087956565241454cf-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.215 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx00000d5f4c2c1186c7abd-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.216 INFO:teuthology.orchestra.run.smithi156.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx000003f66f744044c4ba2-0065436ca2-117b-default'), ('Server', 'Ceph Object Gateway (reef)'), ('Date', 'Thu, 02 Nov 2023 09:32:18 GMT'), ('Connection', 'Keep-Alive')] 2023-11-02T09:40:51.216 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Sending heartbeat frame 2023-11-02T09:40:51.216 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Sending heartbeat frame 2023-11-02T09:40:51.216 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.set_writer(19, >) 2023-11-02T09:40:51.216 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: set_writer(19, _) updated handler RdWr 2023-11-02T09:40:51.217 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned on writability watcher: 2023-11-02T09:40:51.217 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: call_later: added timeout with deadline=940.899292825 and callback=>; now=910.899292825; delay=30.0 2023-11-02T09:40:51.217 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: SelectorIOServicesAdapter.remove_writer(19) 2023-11-02T09:40:51.217 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.selector_ioloop_adapter: DEBUG: remove_writer(19) updated handler Rd 2023-11-02T09:40:51.217 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.utils.io_services_utils: DEBUG: Turned off writability watcher: 2023-11-02T09:40:51.218 INFO:teuthology.orchestra.run.smithi156.stderr:pika.heartbeat: DEBUG: Received 1 heartbeat frames, sent 2, idle intervals 0 2023-11-02T09:40:51.218 INFO:teuthology.orchestra.run.smithi156.stderr:pika.adapters.select_connection: DEBUG: call_later: added timeout with deadline=980.899949067 and callback=>; now=915.899949067; delay=65 2023-11-02T09:40:51.218 INFO:teuthology.orchestra.run.smithi156.stderr:--------------------- >> end captured logging << --------------------- 2023-11-02T09:40:51.218 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.218 INFO:teuthology.orchestra.run.smithi156.stderr:---------------------------------------------------------------------- 2023-11-02T09:40:51.219 INFO:teuthology.orchestra.run.smithi156.stderr:Ran 12 tests in 636.928s 2023-11-02T09:40:51.219 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:40:51.219 INFO:teuthology.orchestra.run.smithi156.stderr:FAILED (errors=1, failures=1) 2023-11-02T09:40:51.219 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 30, in nested vars.append(enter()) File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/notification_tests.py", line 238, in run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (bucket notification tests against different endpoints) on smithi156 with status 1: 'BNTESTS_CONF=/home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/bn-tests.client.0.conf /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/virtualenv/bin/python -m nose -s /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/test_bn.py -v -a amqp_test' 2023-11-02T09:40:51.220 INFO:tasks.notification_tests:Removing bn-tests.conf file... 2023-11-02T09:40:51.220 DEBUG:teuthology.orchestra.run.smithi156:> rm -f /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/bn-tests.client.0.conf 2023-11-02T09:40:51.257 DEBUG:teuthology.orchestra.run.smithi156:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid foo.client.0 --purge-data --cluster ceph 2023-11-02T09:40:51.362 INFO:teuthology.orchestra.run.smithi156.stderr:ignoring --setuser ceph since I am not root 2023-11-02T09:40:51.362 INFO:teuthology.orchestra.run.smithi156.stderr:ignoring --setgroup ceph since I am not root 2023-11-02T09:45:51.363 INFO:teuthology.orchestra.run.smithi156.stderr:failed to fetch mon config (--no-mon-config to skip) 2023-11-02T09:45:51.364 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-02T09:45:51.365 INFO:tasks.notification_tests:Pre-processing completed... 2023-11-02T09:45:51.366 DEBUG:teuthology.orchestra.run.smithi156:> rm -rf /home/ubuntu/.aws/models/s3/2006-03-01/service-2.sdk-extras.json 2023-11-02T09:45:51.399 DEBUG:teuthology.orchestra.run.smithi156:> cd /home/ubuntu/ && rmdir -p .aws/models/s3/2006-03-01/ 2023-11-02T09:45:51.480 INFO:tasks.notification_tests:Removing bucket-notifications-tests... 2023-11-02T09:45:51.480 DEBUG:teuthology.orchestra.run.smithi156:> rm -rf /home/ubuntu/cephtest/ceph 2023-11-02T09:45:51.872 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/notification_tests.py", line 151, in create_users yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 30, in nested vars.append(enter()) File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/notification_tests.py", line 238, in run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (bucket notification tests against different endpoints) on smithi156 with status 1: 'BNTESTS_CONF=/home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/bn-tests.client.0.conf /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/virtualenv/bin/python -m nose -s /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/test_bn.py -v -a amqp_test' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/notification_tests.py", line 306, in task with contextutil.nested( File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/notification_tests.py", line 45, in download yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/notification_tests.py", line 158, in create_users ctx.cluster.only(client).run( File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi156 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid foo.client.0 --purge-data --cluster ceph' 2023-11-02T09:45:51.954 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=4ea5b41b06a842e9b3c14c228d71796e Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/notification_tests.py", line 151, in create_users yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 30, in nested vars.append(enter()) File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/notification_tests.py", line 238, in run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (bucket notification tests against different endpoints) on smithi156 with status 1: 'BNTESTS_CONF=/home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/bn-tests.client.0.conf /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/virtualenv/bin/python -m nose -s /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/test_bn.py -v -a amqp_test' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/notification_tests.py", line 306, in task with contextutil.nested( File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/notification_tests.py", line 45, in download yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/notification_tests.py", line 158, in create_users ctx.cluster.only(client).run( File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi156 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid foo.client.0 --purge-data --cluster ceph' 2023-11-02T09:45:51.959 DEBUG:teuthology.run_tasks:Unwinding manager notification-tests 2023-11-02T09:45:51.971 DEBUG:teuthology.run_tasks:Unwinding manager rabbitmq 2023-11-02T09:45:51.990 INFO:tasks.rabbitmq:Stopping RabbitMQ Service... 2023-11-02T09:45:51.991 DEBUG:teuthology.orchestra.run.smithi156:> sudo /sbin/service rabbitmq-server stop 2023-11-02T09:45:52.040 INFO:teuthology.orchestra.run.smithi156.stderr:Redirecting to /bin/systemctl stop rabbitmq-server.service 2023-11-02T09:45:54.596 INFO:tasks.rabbitmq:Removing packaged dependencies of RabbitMQ... 2023-11-02T09:45:54.596 DEBUG:teuthology.orchestra.run.smithi156:> sudo dnf -y remove rabbitmq-server.noarch 2023-11-02T09:45:55.052 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-11-02T09:45:55.053 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-02T09:45:55.053 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repository Size 2023-11-02T09:45:55.054 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-02T09:45:55.054 INFO:teuthology.orchestra.run.smithi156.stdout:Removing: 2023-11-02T09:45:55.054 INFO:teuthology.orchestra.run.smithi156.stdout: rabbitmq-server noarch 3.12.8-1.el8 @rabbitmq_rabbitmq-server 22 M 2023-11-02T09:45:55.055 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:45:55.055 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-11-02T09:45:55.055 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-02T09:45:55.055 INFO:teuthology.orchestra.run.smithi156.stdout:Remove 1 Package 2023-11-02T09:45:55.056 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:45:55.056 INFO:teuthology.orchestra.run.smithi156.stdout:Freed space: 22 M 2023-11-02T09:45:55.056 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-11-02T09:45:55.058 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-11-02T09:45:55.059 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-11-02T09:45:55.094 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-11-02T09:45:55.095 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-11-02T09:45:55.200 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-11-02T09:45:55.269 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: rabbitmq-server-3.12.8-1.el8.noarch 1/1 2023-11-02T09:45:55.269 INFO:teuthology.orchestra.run.smithi156.stdout: Erasing : rabbitmq-server-3.12.8-1.el8.noarch 1/1 2023-11-02T09:45:55.976 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: rabbitmq-server-3.12.8-1.el8.noarch 1/1 2023-11-02T09:45:56.262 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : rabbitmq-server-3.12.8-1.el8.noarch 1/1 2023-11-02T09:45:56.262 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:45:56.263 INFO:teuthology.orchestra.run.smithi156.stdout:Removed: 2023-11-02T09:45:56.263 INFO:teuthology.orchestra.run.smithi156.stdout: rabbitmq-server-3.12.8-1.el8.noarch 2023-11-02T09:45:56.263 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-02T09:45:56.264 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-11-02T09:45:56.648 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2023-11-02T09:45:56.658 DEBUG:tasks.rgw.client.0:waiting for process to exit 2023-11-02T09:45:56.659 INFO:teuthology.orchestra.run:waiting for 300 2023-11-02T09:45:56.659 INFO:tasks.rgw.client.0:Stopped 2023-11-02T09:45:56.660 DEBUG:teuthology.orchestra.run.smithi156:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2023-11-02T09:45:56.689 DEBUG:teuthology.orchestra.run.smithi156:> sudo rm -f /etc/ceph/vault-root-token 2023-11-02T09:45:56.772 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2023-11-02T09:45:56.772 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2023-11-02T09:45:56.773 DEBUG:teuthology.orchestra.run.smithi156:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2023-11-02T09:45:56.868 INFO:teuthology.orchestra.run.smithi156.stderr:ignoring --setuser ceph since I am not root 2023-11-02T09:45:56.869 INFO:teuthology.orchestra.run.smithi156.stderr:ignoring --setgroup ceph since I am not root 2023-11-02T09:50:56.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-02T09:50:56.867+0000 7f5ccda8b880 0 monclient(hunting): authenticate timed out after 300 2023-11-02T09:50:56.871 INFO:teuthology.orchestra.run.smithi156.stderr:failed to fetch mon config (--no-mon-config to skip) 2023-11-02T09:50:56.872 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-02T09:50:56.873 ERROR:teuthology.run_tasks:Manager failed: rgw Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/rgw.py", line 473, in task yield File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/rgw.py", line 300, in create_pools yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/rgw.py", line 242, in start_rgw rgwadmin(ctx, client, cmd=['gc', 'process', '--include-all'], check_status=True) File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/util/rgw.py", line 34, in rgwadmin proc = remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi156 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all' 2023-11-02T09:50:56.881 DEBUG:teuthology.run_tasks:Unwinding manager openssl_keys 2023-11-02T09:50:56.891 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-11-02T09:50:56.901 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-02T09:50:56.902 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-02T09:52:56.970 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-11-02T09:52:56.972 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/ceph.py", line 1940, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/rgw.py", line 473, in task yield File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/rgw.py", line 300, in create_pools yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/rgw.py", line 242, in start_rgw rgwadmin(ctx, client, cmd=['gc', 'process', '--include-all'], check_status=True) File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/util/rgw.py", line 34, in rgwadmin proc = remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi156 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi156 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-11-02T09:52:56.992 INFO:teuthology.misc:Shutting down mds daemons... 2023-11-02T09:52:56.993 INFO:teuthology.misc:Shutting down osd daemons... 2023-11-02T09:52:56.994 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-11-02T09:52:56.994 INFO:teuthology.orchestra.run:waiting for 300 2023-11-02T09:52:56.999 INFO:tasks.ceph.osd.0:Stopped 2023-11-02T09:52:57.000 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-11-02T09:52:57.000 INFO:teuthology.orchestra.run:waiting for 300 2023-11-02T09:52:57.001 INFO:tasks.ceph.osd.1:Stopped 2023-11-02T09:52:57.002 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-11-02T09:52:57.002 INFO:teuthology.orchestra.run:waiting for 300 2023-11-02T09:52:57.003 INFO:tasks.ceph.osd.2:Stopped 2023-11-02T09:52:57.004 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-11-02T09:52:57.004 INFO:teuthology.orchestra.run:waiting for 300 2023-11-02T09:52:57.005 INFO:tasks.ceph.osd.3:Stopped 2023-11-02T09:52:57.006 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-11-02T09:52:57.006 INFO:teuthology.orchestra.run:waiting for 300 2023-11-02T09:52:57.007 INFO:tasks.ceph.osd.4:Stopped 2023-11-02T09:52:57.008 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-11-02T09:52:57.008 INFO:teuthology.orchestra.run:waiting for 300 2023-11-02T09:52:57.009 INFO:tasks.ceph.osd.5:Stopped 2023-11-02T09:52:57.010 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-11-02T09:52:57.010 INFO:teuthology.orchestra.run:waiting for 300 2023-11-02T09:52:57.011 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-02T09:52:57.011 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/ceph.py", line 1940, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/rgw.py", line 473, in task yield File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/rgw.py", line 300, in create_pools yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/rgw.py", line 242, in start_rgw rgwadmin(ctx, client, cmd=['gc', 'process', '--include-all'], check_status=True) File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/util/rgw.py", line 34, in rgwadmin proc = remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi156 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi156 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi186 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6' 2023-11-02T09:52:57.028 INFO:tasks.ceph.osd.6:Stopped 2023-11-02T09:52:57.029 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-11-02T09:52:57.029 INFO:teuthology.orchestra.run:waiting for 300 2023-11-02T09:52:57.030 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-02T09:52:57.031 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/ceph.py", line 1940, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/rgw.py", line 473, in task yield File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/rgw.py", line 300, in create_pools yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/rgw.py", line 242, in start_rgw rgwadmin(ctx, client, cmd=['gc', 'process', '--include-all'], check_status=True) File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/util/rgw.py", line 34, in rgwadmin proc = remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi156 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi156 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi186 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7' 2023-11-02T09:52:57.048 INFO:tasks.ceph.osd.7:Stopped 2023-11-02T09:52:57.048 INFO:teuthology.misc:Shutting down mgr daemons... 2023-11-02T09:52:57.049 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-11-02T09:52:57.050 INFO:teuthology.orchestra.run:waiting for 300 2023-11-02T09:52:57.050 INFO:tasks.ceph.mgr.y:Stopped 2023-11-02T09:52:57.051 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-11-02T09:52:57.052 INFO:teuthology.orchestra.run:waiting for 300 2023-11-02T09:52:57.052 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-02T09:52:57.053 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/ceph.py", line 1940, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/rgw.py", line 473, in task yield File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/rgw.py", line 300, in create_pools yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/rgw.py", line 242, in start_rgw rgwadmin(ctx, client, cmd=['gc', 'process', '--include-all'], check_status=True) File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/util/rgw.py", line 34, in rgwadmin proc = remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi156 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi156 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi186 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x' 2023-11-02T09:52:57.070 INFO:tasks.ceph.mgr.x:Stopped 2023-11-02T09:52:57.070 INFO:teuthology.misc:Shutting down mon daemons... 2023-11-02T09:52:57.071 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-11-02T09:52:57.072 INFO:teuthology.orchestra.run:waiting for 300 2023-11-02T09:52:57.072 INFO:tasks.ceph.mon.a:Stopped 2023-11-02T09:52:57.073 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-11-02T09:52:57.073 INFO:teuthology.orchestra.run:waiting for 300 2023-11-02T09:52:57.074 INFO:tasks.ceph.mon.c:Stopped 2023-11-02T09:52:57.075 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-11-02T09:52:57.075 INFO:teuthology.orchestra.run:waiting for 300 2023-11-02T09:52:57.076 INFO:tasks.ceph.mon.b:Stopped 2023-11-02T09:52:57.077 INFO:tasks.ceph:Checking cluster log for badness... 2023-11-02T09:52:57.078 DEBUG:teuthology.orchestra.run.smithi156:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | head -n 1 2023-11-02T09:52:57.128 INFO:teuthology.orchestra.run.smithi156.stdout:2023-11-02T09:32:20.056483+0000 mon.a (mon.0) 245 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2023-11-02T09:52:57.129 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-11-02T09:52:57.130 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi156.front.sepia.ceph.com 2023-11-02T09:52:57.130 DEBUG:teuthology.orchestra.run.smithi156:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-11-02T09:52:57.250 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi156.front.sepia.ceph.com 2023-11-02T09:52:57.251 DEBUG:teuthology.orchestra.run.smithi156:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-11-02T09:52:57.325 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi156.front.sepia.ceph.com 2023-11-02T09:52:57.326 DEBUG:teuthology.orchestra.run.smithi156:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-11-02T09:52:57.392 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi156.front.sepia.ceph.com 2023-11-02T09:52:57.392 DEBUG:teuthology.orchestra.run.smithi156:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-11-02T09:52:57.458 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi186.front.sepia.ceph.com 2023-11-02T09:52:57.459 DEBUG:teuthology.orchestra.run.smithi186:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-11-02T09:52:57.607 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi186.front.sepia.ceph.com 2023-11-02T09:52:57.608 DEBUG:teuthology.orchestra.run.smithi186:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-11-02T09:52:57.681 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi186.front.sepia.ceph.com 2023-11-02T09:52:57.682 DEBUG:teuthology.orchestra.run.smithi186:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-11-02T09:52:57.745 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi186.front.sepia.ceph.com 2023-11-02T09:52:57.746 DEBUG:teuthology.orchestra.run.smithi186:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-11-02T09:52:57.803 INFO:tasks.ceph:Archiving mon data... 2023-11-02T09:52:57.805 DEBUG:teuthology.misc:Transferring archived files from smithi156:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/alimasa-2023-11-02_07:21:35-rgw:notifications-wip-alimasa-2pc-remove-issue-distro-default-smithi/7444142/data/mon.a.tgz 2023-11-02T09:52:57.806 DEBUG:teuthology.orchestra.run.smithi156:> mktemp 2023-11-02T09:52:57.836 INFO:teuthology.orchestra.run.smithi156.stdout:/tmp/tmp.BwR2XYfBpR 2023-11-02T09:52:57.836 DEBUG:teuthology.orchestra.run.smithi156:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.BwR2XYfBpR 2023-11-02T09:52:57.994 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod 0666 /tmp/tmp.BwR2XYfBpR 2023-11-02T09:52:58.109 DEBUG:teuthology.orchestra.remote:smithi156:/tmp/tmp.BwR2XYfBpR is 276KB 2023-11-02T09:52:58.206 DEBUG:teuthology.orchestra.run.smithi156:> rm -fr /tmp/tmp.BwR2XYfBpR 2023-11-02T09:52:58.233 DEBUG:teuthology.misc:Transferring archived files from smithi156:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/alimasa-2023-11-02_07:21:35-rgw:notifications-wip-alimasa-2pc-remove-issue-distro-default-smithi/7444142/data/mon.c.tgz 2023-11-02T09:52:58.234 DEBUG:teuthology.orchestra.run.smithi156:> mktemp 2023-11-02T09:52:58.300 INFO:teuthology.orchestra.run.smithi156.stdout:/tmp/tmp.wzZAgy3EKd 2023-11-02T09:52:58.301 DEBUG:teuthology.orchestra.run.smithi156:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.wzZAgy3EKd 2023-11-02T09:52:58.443 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod 0666 /tmp/tmp.wzZAgy3EKd 2023-11-02T09:52:58.553 DEBUG:teuthology.orchestra.remote:smithi156:/tmp/tmp.wzZAgy3EKd is 283KB 2023-11-02T09:52:58.650 DEBUG:teuthology.orchestra.run.smithi156:> rm -fr /tmp/tmp.wzZAgy3EKd 2023-11-02T09:52:58.677 DEBUG:teuthology.misc:Transferring archived files from smithi186:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/alimasa-2023-11-02_07:21:35-rgw:notifications-wip-alimasa-2pc-remove-issue-distro-default-smithi/7444142/data/mon.b.tgz 2023-11-02T09:52:58.677 DEBUG:teuthology.orchestra.run.smithi186:> mktemp 2023-11-02T09:52:58.711 INFO:teuthology.orchestra.run.smithi186.stdout:/tmp/tmp.49pe5grjpO 2023-11-02T09:52:58.711 DEBUG:teuthology.orchestra.run.smithi186:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.49pe5grjpO 2023-11-02T09:52:58.872 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod 0666 /tmp/tmp.49pe5grjpO 2023-11-02T09:52:58.981 DEBUG:teuthology.orchestra.remote:smithi186:/tmp/tmp.49pe5grjpO is 283KB 2023-11-02T09:52:59.076 DEBUG:teuthology.orchestra.run.smithi186:> rm -fr /tmp/tmp.49pe5grjpO 2023-11-02T09:52:59.103 INFO:tasks.ceph:Cleaning ceph cluster... 2023-11-02T09:52:59.104 DEBUG:teuthology.orchestra.run.smithi156:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-02T09:52:59.107 DEBUG:teuthology.orchestra.run.smithi186:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-02T09:52:59.182 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-11-02T09:52:59.183 DEBUG:teuthology.orchestra.run.smithi156:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-02T09:52:59.186 DEBUG:teuthology.orchestra.run.smithi186:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-02T09:52:59.225 INFO:teuthology.orchestra.run.smithi156.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-02T09:52:59.263 INFO:teuthology.orchestra.run.smithi186.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-02T09:52:59.267 INFO:tasks.ceph:Archiving crash dumps... 2023-11-02T09:52:59.270 DEBUG:teuthology.misc:Transferring archived files from smithi156:/var/lib/ceph/crash to /home/teuthworker/archive/alimasa-2023-11-02_07:21:35-rgw:notifications-wip-alimasa-2pc-remove-issue-distro-default-smithi/7444142/remote/smithi156/crash 2023-11-02T09:52:59.271 DEBUG:teuthology.orchestra.run.smithi156:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-02T09:52:59.311 DEBUG:teuthology.misc:Transferring archived files from smithi186:/var/lib/ceph/crash to /home/teuthworker/archive/alimasa-2023-11-02_07:21:35-rgw:notifications-wip-alimasa-2pc-remove-issue-distro-default-smithi/7444142/remote/smithi186/crash 2023-11-02T09:52:59.312 DEBUG:teuthology.orchestra.run.smithi186:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-02T09:52:59.448 INFO:tasks.ceph:Compressing logs... 2023-11-02T09:52:59.448 DEBUG:teuthology.orchestra.run.smithi156:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-02T09:52:59.451 DEBUG:teuthology.orchestra.run.smithi186:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-02T09:52:59.487 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-11-02T09:52:59.488 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90123.log 2023-11-02T09:52:59.503 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91305.log 2023-11-02T09:52:59.504 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.90123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90889.log 2023-11-02T09:52:59.504 INFO:teuthology.orchestra.run.smithi156.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90123.log.gz 2023-11-02T09:52:59.504 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.91305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91082.log 2023-11-02T09:52:59.505 INFO:teuthology.orchestra.run.smithi156.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.91305.log.gz 2023-11-02T09:52:59.505 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91854.log 2023-11-02T09:52:59.505 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.90889.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90889.log.gz 2023-11-02T09:52:59.505 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90948.log 2023-11-02T09:52:59.506 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.91082.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.91082.log.gz 2023-11-02T09:52:59.506 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.91854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91389.log 2023-11-02T09:52:59.506 INFO:teuthology.orchestra.run.smithi156.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.91854.log.gz 2023-11-02T09:52:59.506 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.90948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84897.log 2023-11-02T09:52:59.507 INFO:teuthology.orchestra.run.smithi156.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90948.log.gz 2023-11-02T09:52:59.507 INFO:teuthology.orchestra.run.smithi156.stderr:gzip/var/log/ceph/ceph-client.admin.91389.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.90580.log 2023-11-02T09:52:59.507 INFO:teuthology.orchestra.run.smithi156.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.91389.log.gz 2023-11-02T09:52:59.507 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.84897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91877.log 2023-11-02T09:52:59.508 INFO:teuthology.orchestra.run.smithi156.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.84897.log.gz 2023-11-02T09:52:59.508 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.90580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91674.log 2023-11-02T09:52:59.508 INFO:teuthology.orchestra.run.smithi156.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90580.log.gz 2023-11-02T09:52:59.509 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.0.91877.log: -- /var/log/ceph/ceph-client.admin.91306.log 2023-11-02T09:52:59.509 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.91674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90582.log 2023-11-02T09:52:59.509 INFO:teuthology.orchestra.run.smithi156.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.91674.log.gz 2023-11-02T09:52:59.509 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.91306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.96352.log 2023-11-02T09:52:59.510 INFO:teuthology.orchestra.run.smithi156.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.91306.log.gz 2023-11-02T09:52:59.510 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.90582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.92179.log 2023-11-02T09:52:59.510 INFO:teuthology.orchestra.run.smithi156.stderr: 96.0% -- replaced with /var/log/ceph/ceph-client.0.91877.log.gz 2023-11-02T09:52:59.511 INFO:teuthology.orchestra.run.smithi156.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90582.log.gz 2023-11-02T09:52:59.511 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.0.96352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90581.log 2023-11-02T09:52:59.511 INFO:teuthology.orchestra.run.smithi156.stderr: 6.1% -- replaced with /var/log/ceph/ceph-client.0.96352.log.gz 2023-11-02T09:52:59.511 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90327.log 2023-11-02T09:52:59.512 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.0.92179.log: 43.3% -- replaced with /var/log/ceph/ceph-client.0.92179.log.gz 2023-11-02T09:52:59.512 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.90581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.94056.log 2023-11-02T09:52:59.512 INFO:teuthology.orchestra.run.smithi156.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90581.log.gz 2023-11-02T09:52:59.513 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.90327.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.91238.log 2023-11-02T09:52:59.513 INFO:teuthology.orchestra.run.smithi156.stderr: -- replaced with /var/log/ceph/ceph-client.admin.90327.log.gz 2023-11-02T09:52:59.514 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90577.log 2023-11-02T09:52:59.514 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.0.94056.log: /var/log/ceph/ceph-client.admin.91238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84569.log 2023-11-02T09:52:59.514 INFO:teuthology.orchestra.run.smithi156.stderr: 82.8% -- replaced with /var/log/ceph/ceph-client.0.94056.log.gz 2023-11-02T09:52:59.514 INFO:teuthology.orchestra.run.smithi156.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.91238.log.gz 2023-11-02T09:52:59.515 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.90577.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-02T09:52:59.515 INFO:teuthology.orchestra.run.smithi156.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90577.log.gz 2023-11-02T09:52:59.515 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97055.log 2023-11-02T09:52:59.516 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.84569.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.84569.log.gz 2023-11-02T09:52:59.516 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.92275.log 2023-11-02T09:52:59.516 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.97055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91388.log 2023-11-02T09:52:59.516 INFO:teuthology.orchestra.run.smithi156.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.97055.log.gz 2023-11-02T09:52:59.517 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.0.92275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90373.log 2023-11-02T09:52:59.517 INFO:teuthology.orchestra.run.smithi156.stderr: 43.3% -- replaced with /var/log/ceph/ceph-client.0.92275.log.gz 2023-11-02T09:52:59.517 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.91388.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.91388.log.gz 2023-11-02T09:52:59.518 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-11-02T09:52:59.518 INFO:teuthology.orchestra.run.smithi156.stderr: 94.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-02T09:52:59.518 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.90373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90588.log 2023-11-02T09:52:59.518 INFO:teuthology.orchestra.run.smithi156.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90373.log.gz 2023-11-02T09:52:59.519 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91718.log 2023-11-02T09:52:59.519 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.90588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90187.log 2023-11-02T09:52:59.519 INFO:teuthology.orchestra.run.smithi156.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90588.log.gz 2023-11-02T09:52:59.520 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.91718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90890.log 2023-11-02T09:52:59.520 INFO:teuthology.orchestra.run.smithi156.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.91718.log.gz 2023-11-02T09:52:59.520 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.90187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91582.log 2023-11-02T09:52:59.520 INFO:teuthology.orchestra.run.smithi156.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90187.log.gz 2023-11-02T09:52:59.521 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.90890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91432.log 2023-11-02T09:52:59.521 INFO:teuthology.orchestra.run.smithi156.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90890.log.gz 2023-11-02T09:52:59.521 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.91582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91628.log 2023-11-02T09:52:59.522 INFO:teuthology.orchestra.run.smithi156.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.91582.log.gz 2023-11-02T09:52:59.522 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.91432.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.91432.log.gz 2023-11-02T09:52:59.522 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90574.log 2023-11-02T09:52:59.523 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.91628.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-11-02T09:52:59.523 INFO:teuthology.orchestra.run.smithi156.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.91628.log.gz 2023-11-02T09:52:59.523 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.90574.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90574.log.gz 2023-11-02T09:52:59.524 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90233.log 2023-11-02T09:52:59.524 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91214.log 2023-11-02T09:52:59.525 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.90233.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90233.log.gz 2023-11-02T09:52:59.525 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90897.log 2023-11-02T09:52:59.525 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91764.log 2023-11-02T09:52:59.526 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.91214.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.91214.log.gz 2023-11-02T09:52:59.526 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.90897.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90897.log.gz 2023-11-02T09:52:59.526 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91462.log 2023-11-02T09:52:59.527 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85019.log 2023-11-02T09:52:59.527 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.91764.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.91764.log.gz 2023-11-02T09:52:59.527 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.91462.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-11-02T09:52:59.528 INFO:teuthology.orchestra.run.smithi156.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.91462.log.gz 2023-11-02T09:52:59.529 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.85019.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.78449.log 2023-11-02T09:52:59.529 INFO:teuthology.orchestra.run.smithi156.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.85019.log.gz 2023-11-02T09:52:59.529 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90882.log 2023-11-02T09:52:59.529 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph.tmp-client.admin.78449.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.78449.log.gz 2023-11-02T09:52:59.530 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91808.log 2023-11-02T09:52:59.530 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90587.log 2023-11-02T09:52:59.530 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.90882.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90882.log.gz 2023-11-02T09:52:59.531 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.91808.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.91808.log.gz 2023-11-02T09:52:59.531 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90281.log 2023-11-02T09:52:59.531 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.92083.log 2023-11-02T09:52:59.531 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.90587.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90587.log.gz 2023-11-02T09:52:59.532 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.90281.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-11-02T09:52:59.532 INFO:teuthology.orchestra.run.smithi156.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90281.log.gz 2023-11-02T09:52:59.532 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.0.92083.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2023-11-02T09:52:59.533 INFO:teuthology.orchestra.run.smithi156.stderr: 43.3% -- replaced with /var/log/ceph/ceph-client.0.92083.log.gz 2023-11-02T09:52:59.533 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90578.log 2023-11-02T09:52:59.533 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91987.log 2023-11-02T09:52:59.533 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.90578.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90578.log.gzgzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-02T09:52:59.534 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:52:59.535 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.0.91987.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-11-02T09:52:59.535 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph.log: 43.7% -- replaced with /var/log/ceph/ceph-client.0.91987.log.gz 2023-11-02T09:52:59.535 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2023-11-02T09:52:59.544 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-osd.2.log: 94.4% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-02T09:52:59.544 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90947.log 2023-11-02T09:52:59.545 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/rgw.ceph.client.0.log: 92.4% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2023-11-02T09:52:59.545 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90896.log 2023-11-02T09:52:59.545 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.90947.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90947.log.gz 2023-11-02T09:52:59.545 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.96966.log 2023-11-02T09:52:59.546 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.90896.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90896.log.gz 2023-11-02T09:52:59.546 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-11-02T09:52:59.546 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.0.96966.log: 9.2% -- replaced with /var/log/ceph/ceph-client.0.96966.log.gz 2023-11-02T09:52:59.548 INFO:teuthology.orchestra.run.smithi186.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-11-02T09:52:59.548 INFO:teuthology.orchestra.run.smithi186.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84438.log 2023-11-02T09:52:59.548 INFO:teuthology.orchestra.run.smithi186.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84658.log 2023-11-02T09:52:59.549 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-client.admin.84438.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-02T09:52:59.549 INFO:teuthology.orchestra.run.smithi186.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.84438.log.gz 2023-11-02T09:52:59.549 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph-client.admin.84658.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-11-02T09:52:59.550 INFO:teuthology.orchestra.run.smithi186.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.84658.log.gz 2023-11-02T09:52:59.550 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84482.log 2023-11-02T09:52:59.550 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-11-02T09:52:59.550 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph-client.admin.84482.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.84482.log.gz 2023-11-02T09:52:59.551 INFO:teuthology.orchestra.run.smithi186.stderr: -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-11-02T09:52:59.551 INFO:teuthology.orchestra.run.smithi186.stderr: 89.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-02T09:52:59.551 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84702.log 2023-11-02T09:52:59.552 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84526.log 2023-11-02T09:52:59.552 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph-client.admin.84702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84614.log 2023-11-02T09:52:59.552 INFO:teuthology.orchestra.run.smithi186.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.84702.log.gz 2023-11-02T09:52:59.552 INFO:teuthology.orchestra.run.smithi186.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84570.log 2023-11-02T09:52:59.553 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph-client.admin.84526.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.84526.log.gz 2023-11-02T09:52:59.553 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph-client.admin.84614.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-11-02T09:52:59.553 INFO:teuthology.orchestra.run.smithi186.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.84614.log.gz 2023-11-02T09:52:59.553 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph-client.admin.84570.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-02T09:52:59.554 INFO:teuthology.orchestra.run.smithi186.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.84570.log.gz 2023-11-02T09:52:59.554 INFO:teuthology.orchestra.run.smithi186.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-11-02T09:52:59.554 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84394.log 2023-11-02T09:52:59.555 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-client.admin.84394.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.84394.log.gz 2023-11-02T09:52:59.555 INFO:teuthology.orchestra.run.smithi186.stderr: 90.1% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-02T09:52:59.555 INFO:teuthology.orchestra.run.smithi186.stderr: 94.2% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-11-02T09:52:59.608 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-mon.c.log: 92.3% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-11-02T09:52:59.630 INFO:teuthology.orchestra.run.smithi156.stderr: 92.9% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2023-11-02T09:52:59.643 INFO:teuthology.orchestra.run.smithi186.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-11-02T09:52:59.707 INFO:teuthology.orchestra.run.smithi156.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-11-02T09:52:59.905 INFO:teuthology.orchestra.run.smithi156.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-11-02T09:52:59.916 INFO:teuthology.orchestra.run.smithi186.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-11-02T09:53:00.073 INFO:teuthology.orchestra.run.smithi156.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-11-02T09:53:00.097 INFO:teuthology.orchestra.run.smithi156.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-11-02T09:53:00.101 INFO:teuthology.orchestra.run.smithi186.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-11-02T09:53:00.149 INFO:teuthology.orchestra.run.smithi186.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-11-02T09:53:00.156 INFO:teuthology.orchestra.run.smithi186.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-11-02T09:53:00.158 INFO:teuthology.orchestra.run.smithi186.stderr: 2023-11-02T09:53:00.159 INFO:teuthology.orchestra.run.smithi186.stderr:real 0m0.659s 2023-11-02T09:53:00.159 INFO:teuthology.orchestra.run.smithi186.stderr:user 0m2.333s 2023-11-02T09:53:00.159 INFO:teuthology.orchestra.run.smithi186.stderr:sys 0m0.109s 2023-11-02T09:53:00.205 INFO:teuthology.orchestra.run.smithi156.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-11-02T09:53:00.301 INFO:teuthology.orchestra.run.smithi156.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-11-02T09:53:00.303 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-02T09:53:00.304 INFO:teuthology.orchestra.run.smithi156.stderr:real 0m0.828s 2023-11-02T09:53:00.304 INFO:teuthology.orchestra.run.smithi156.stderr:user 0m3.445s 2023-11-02T09:53:00.304 INFO:teuthology.orchestra.run.smithi156.stderr:sys 0m0.154s 2023-11-02T09:53:00.305 INFO:tasks.ceph:Archiving logs... 2023-11-02T09:53:00.305 DEBUG:teuthology.misc:Transferring archived files from smithi156:/var/log/ceph to /home/teuthworker/archive/alimasa-2023-11-02_07:21:35-rgw:notifications-wip-alimasa-2pc-remove-issue-distro-default-smithi/7444142/remote/smithi156/log 2023-11-02T09:53:00.307 DEBUG:teuthology.orchestra.run.smithi156:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-02T09:53:00.894 DEBUG:teuthology.misc:Transferring archived files from smithi186:/var/log/ceph to /home/teuthworker/archive/alimasa-2023-11-02_07:21:35-rgw:notifications-wip-alimasa-2pc-remove-issue-distro-default-smithi/7444142/remote/smithi186/log 2023-11-02T09:53:00.896 DEBUG:teuthology.orchestra.run.smithi186:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-02T09:53:01.294 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/ceph.py", line 1940, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/rgw.py", line 473, in task yield File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/rgw.py", line 300, in create_pools yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/rgw.py", line 242, in start_rgw rgwadmin(ctx, client, cmd=['gc', 'process', '--include-all'], check_status=True) File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/util/rgw.py", line 34, in rgwadmin proc = remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi156 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi156 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-11-02T09:53:01.312 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-11-02T09:53:01.321 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/rgw.py", line 473, in task yield File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/rgw.py", line 300, in create_pools yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/rgw.py", line 242, in start_rgw rgwadmin(ctx, client, cmd=['gc', 'process', '--include-all'], check_status=True) File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/util/rgw.py", line 34, in rgwadmin proc = remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi156 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all' 2023-11-02T09:53:01.336 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-11-02T09:53:01.336 DEBUG:teuthology.orchestra.run.smithi156:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-02T09:53:01.339 DEBUG:teuthology.orchestra.run.smithi186:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-02T09:53:01.429 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-11-02T09:53:01.440 INFO:teuthology.task.clock:Checking final clock skew... 2023-11-02T09:53:01.440 DEBUG:teuthology.orchestra.run.smithi156:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-02T09:53:01.443 DEBUG:teuthology.orchestra.run.smithi186:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-02T09:53:01.468 INFO:teuthology.orchestra.run.smithi156.stderr:bash: line 1: ntpq: command not found 2023-11-02T09:53:01.470 INFO:teuthology.orchestra.run.smithi186.stderr:bash: line 1: ntpq: command not found 2023-11-02T09:53:01.473 INFO:teuthology.orchestra.run.smithi156.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-02T09:53:01.473 INFO:teuthology.orchestra.run.smithi156.stdout:=============================================================================== 2023-11-02T09:53:01.473 INFO:teuthology.orchestra.run.smithi156.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 34 +775us[ +773us] +/- 72ms 2023-11-02T09:53:01.473 INFO:teuthology.orchestra.run.smithi156.stdout:^* hv02.front.sepia.ceph.com 3 6 377 32 -806us[ -807us] +/- 60ms 2023-11-02T09:53:01.474 INFO:teuthology.orchestra.run.smithi156.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 33 +256us[ +254us] +/- 68ms 2023-11-02T09:53:01.474 INFO:teuthology.orchestra.run.smithi156.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-11-02T09:53:01.476 INFO:teuthology.orchestra.run.smithi186.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-02T09:53:01.476 INFO:teuthology.orchestra.run.smithi186.stdout:=============================================================================== 2023-11-02T09:53:01.476 INFO:teuthology.orchestra.run.smithi186.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 30 +791us[ +791us] +/- 72ms 2023-11-02T09:53:01.477 INFO:teuthology.orchestra.run.smithi186.stdout:^* hv02.front.sepia.ceph.com 3 6 377 31 -804us[ -803us] +/- 60ms 2023-11-02T09:53:01.477 INFO:teuthology.orchestra.run.smithi186.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 33 +261us[ +262us] +/- 68ms 2023-11-02T09:53:01.477 INFO:teuthology.orchestra.run.smithi186.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-11-02T09:53:01.478 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-11-02T09:53:01.487 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-11-02T09:53:01.488 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-11-02T09:53:01.497 DEBUG:teuthology.orchestra.run.smithi156:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-11-02T09:53:01.622 DEBUG:teuthology.orchestra.run.smithi186:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-11-02T09:53:01.729 DEBUG:teuthology.orchestra.run.smithi156:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-02T09:53:01.774 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-02T09:53:01.775 DEBUG:teuthology.orchestra.run.smithi186:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-02T09:53:01.819 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-02T09:53:01.820 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-11-02T09:53:01.831 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-11-02T09:53:01.860 INFO:teuthology.task.internal:Duration was 2071.906042 seconds 2023-11-02T09:53:01.860 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-11-02T09:53:01.872 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-11-02T09:53:01.873 DEBUG:teuthology.orchestra.run.smithi156:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-02T09:53:01.875 DEBUG:teuthology.orchestra.run.smithi186:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-02T09:53:01.930 INFO:teuthology.orchestra.run.smithi156.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-02T09:53:01.931 INFO:teuthology.orchestra.run.smithi186.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-02T09:53:02.195 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-11-02T09:53:02.196 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi156.front.sepia.ceph.com 2023-11-02T09:53:02.196 DEBUG:teuthology.orchestra.run.smithi156:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-02T09:53:02.228 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi186.front.sepia.ceph.com 2023-11-02T09:53:02.228 DEBUG:teuthology.orchestra.run.smithi186:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-02T09:53:02.265 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-11-02T09:53:02.265 DEBUG:teuthology.orchestra.run.smithi156:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-02T09:53:02.271 DEBUG:teuthology.orchestra.run.smithi186:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-02T09:53:02.346 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-11-02T09:53:02.346 DEBUG:teuthology.orchestra.run.smithi156:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-02T09:53:02.351 DEBUG:teuthology.orchestra.run.smithi186:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-02T09:53:02.488 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-11-02T09:53:02.500 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-11-02T09:53:02.500 DEBUG:teuthology.orchestra.run.smithi156:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-02T09:53:02.541 DEBUG:teuthology.orchestra.run.smithi186:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-02T09:53:02.580 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-11-02T09:53:02.591 DEBUG:teuthology.orchestra.run.smithi156:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-02T09:53:02.594 DEBUG:teuthology.orchestra.run.smithi186:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-02T09:53:02.630 INFO:teuthology.orchestra.run.smithi156.stdout:kernel.core_pattern = core 2023-11-02T09:53:02.658 INFO:teuthology.orchestra.run.smithi186.stdout:kernel.core_pattern = core 2023-11-02T09:53:02.698 DEBUG:teuthology.orchestra.run.smithi156:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-02T09:53:02.724 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-02T09:53:02.724 DEBUG:teuthology.orchestra.run.smithi186:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-02T09:53:02.765 WARNING:teuthology.task.internal:Found coredumps on ubuntu@smithi186.front.sepia.ceph.com, flagging run as failed 2023-11-02T09:53:02.765 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-11-02T09:53:02.781 INFO:teuthology.task.internal:Transferring archived files... 2023-11-02T09:53:02.782 DEBUG:teuthology.misc:Transferring archived files from smithi156:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/alimasa-2023-11-02_07:21:35-rgw:notifications-wip-alimasa-2pc-remove-issue-distro-default-smithi/7444142/remote/smithi156 2023-11-02T09:53:02.782 DEBUG:teuthology.orchestra.run.smithi156:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-02T09:53:02.833 DEBUG:teuthology.misc:Transferring archived files from smithi186:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/alimasa-2023-11-02_07:21:35-rgw:notifications-wip-alimasa-2pc-remove-issue-distro-default-smithi/7444142/remote/smithi186 2023-11-02T09:53:02.833 DEBUG:teuthology.orchestra.run.smithi186:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-02T09:54:00.603 INFO:teuthology.task.internal:Transferring binaries for coredumps... 2023-11-02T09:54:01.024 INFO:teuthology.task.internal: core looks like: /home/teuthworker/archive/alimasa-2023-11-02_07:21:35-rgw:notifications-wip-alimasa-2pc-remove-issue-distro-default-smithi/7444142/remote/smithi186/coredump/1698917541.84850.core.gz: gzip compressed data, was "1698917541.84850.core", last modified: Thu Nov 2 09:53:02 2023, max compression, original size modulo 2^32 826081280 2023-11-02T09:54:01.025 INFO:teuthology.task.internal:core is compressed, try accessing gzip file ... 2023-11-02T09:54:04.610 INFO:teuthology.task.internal: core looks like: /tmp/tmpb_xznl3o: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-osd -f --cluster ceph -i 6', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/bin/ceph-osd', platform: 'x86_64' 2023-11-02T09:54:04.697 INFO:teuthology.task.internal: dump_program: ceph-osd -f --cluster ceph -i 6 2023-11-02T09:54:04.698 DEBUG:teuthology.orchestra.run.smithi186:> which 'ceph-osd -f --cluster ceph -i 6' 2023-11-02T09:54:04.732 INFO:teuthology.orchestra.run.smithi186.stderr:/usr/bin/which: invalid option -- 'f' 2023-11-02T09:54:04.732 INFO:teuthology.orchestra.run.smithi186.stderr:/usr/bin/which: unrecognized option '--cluster' 2023-11-02T09:54:04.733 INFO:teuthology.orchestra.run.smithi186.stderr:/usr/bin/which: no 6 in (/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin) 2023-11-02T09:54:04.733 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-02T09:54:04.734 INFO:teuthology.orchestra.run.smithi186.stdout:/usr/bin/ceph-osd 2023-11-02T09:54:04.735 INFO:teuthology.orchestra.run.smithi186.stdout:/usr/bin/ceph 2023-11-02T09:54:04.735 ERROR:teuthology.run_tasks:Manager failed: internal.archive Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/task/internal/__init__.py", line 392, in archive yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/rgw.py", line 473, in task yield File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/rgw.py", line 300, in create_pools yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/rgw.py", line 242, in start_rgw rgwadmin(ctx, client, cmd=['gc', 'process', '--include-all'], check_status=True) File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/util/rgw.py", line 34, in rgwadmin proc = remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi156 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/task/internal/__init__.py", line 420, in archive fetch_binaries_for_coredumps(path, rem) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/task/internal/__init__.py", line 345, in fetch_binaries_for_coredumps remote_path = remote.sh(['which', dump_program]).rstrip() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 96, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi186 with status 1: "which 'ceph-osd -f --cluster ceph -i 6'" 2023-11-02T09:54:04.753 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-11-02T09:54:04.766 INFO:teuthology.task.internal:Not uploading archives. 2023-11-02T09:54:04.766 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-11-02T09:54:04.786 INFO:teuthology.task.internal:Tidying up after the test... 2023-11-02T09:54:04.787 DEBUG:teuthology.orchestra.run.smithi156:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-02T09:54:04.797 DEBUG:teuthology.orchestra.run.smithi186:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-02T09:54:04.827 INFO:teuthology.orchestra.run.smithi156.stdout: 262166 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Nov 2 09:53 /home/ubuntu/cephtest 2023-11-02T09:54:04.827 INFO:teuthology.orchestra.run.smithi156.stdout: 262167 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Nov 2 09:53 /home/ubuntu/cephtest/archive 2023-11-02T09:54:04.827 INFO:teuthology.orchestra.run.smithi156.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 2 09:53 /home/ubuntu/cephtest/archive/syslog 2023-11-02T09:54:04.828 INFO:teuthology.orchestra.run.smithi156.stdout: 265296 4 -rw-rw-rw- 1 ubuntu ubuntu 29 Nov 2 09:18 /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-11-02T09:54:04.828 INFO:teuthology.orchestra.run.smithi156.stdout: 265244 4 -rw-rw-rw- 1 ubuntu ubuntu 29 Nov 2 09:18 /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-11-02T09:54:04.828 INFO:teuthology.orchestra.run.smithi156.stdout: 265243 104 -rw-r--r-- 1 ubuntu ubuntu 103610 Nov 2 09:53 /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-02T09:54:04.829 INFO:teuthology.orchestra.run.smithi156.stdout: 411051 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 2 09:53 /home/ubuntu/cephtest/archive/audit 2023-11-02T09:54:04.829 INFO:teuthology.orchestra.run.smithi156.stdout: 411053 236 -rw------- 1 ubuntu ubuntu 240355 Nov 2 09:53 /home/ubuntu/cephtest/archive/audit/audit.log.gz 2023-11-02T09:54:04.830 INFO:teuthology.orchestra.run.smithi186.stdout: 262166 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Nov 2 09:53 /home/ubuntu/cephtest 2023-11-02T09:54:04.831 INFO:teuthology.orchestra.run.smithi186.stdout: 262167 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Nov 2 09:53 /home/ubuntu/cephtest/archive 2023-11-02T09:54:04.831 INFO:teuthology.orchestra.run.smithi186.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 2 09:53 /home/ubuntu/cephtest/archive/syslog 2023-11-02T09:54:04.831 INFO:teuthology.orchestra.run.smithi186.stdout: 265296 4 -rw-rw-rw- 1 ubuntu ubuntu 29 Nov 2 09:18 /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-11-02T09:54:04.832 INFO:teuthology.orchestra.run.smithi186.stdout: 265244 4 -rw-rw-rw- 1 ubuntu ubuntu 29 Nov 2 09:18 /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-11-02T09:54:04.832 INFO:teuthology.orchestra.run.smithi186.stdout: 265243 100 -rw-r--r-- 1 ubuntu ubuntu 100434 Nov 2 09:53 /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-02T09:54:04.832 INFO:teuthology.orchestra.run.smithi186.stdout: 524595 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 2 09:53 /home/ubuntu/cephtest/archive/audit 2023-11-02T09:54:04.833 INFO:teuthology.orchestra.run.smithi186.stdout: 524597 228 -rw------- 1 ubuntu ubuntu 232223 Nov 2 09:53 /home/ubuntu/cephtest/archive/audit/audit.log.gz 2023-11-02T09:54:04.833 INFO:teuthology.orchestra.run.smithi186.stdout: 262168 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 2 09:32 /home/ubuntu/cephtest/archive/coredump 2023-11-02T09:54:04.833 INFO:teuthology.orchestra.run.smithi186.stdout: 265304 78684 -rw------- 1 root root 826081280 Nov 2 09:32 /home/ubuntu/cephtest/archive/coredump/1698917541.84850.core 2023-11-02T09:54:04.834 INFO:teuthology.orchestra.run.smithi186.stdout: 265298 87112 -rw------- 1 root root 826077184 Nov 2 09:32 /home/ubuntu/cephtest/archive/coredump/1698917539.84818.core 2023-11-02T09:54:04.835 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-02T09:54:04.836 INFO:teuthology.orchestra.run.smithi156.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-11-02T09:54:04.837 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/rgw.py", line 473, in task yield File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/rgw.py", line 300, in create_pools yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/rgw.py", line 242, in start_rgw rgwadmin(ctx, client, cmd=['gc', 'process', '--include-all'], check_status=True) File "/home/teuthworker/src/git.ceph.com_ceph-c_84d22000a111c0f6e32c6bf0246b078c52c8bdde/qa/tasks/util/rgw.py", line 34, in rgwadmin proc = remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi156 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi156 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-11-02T09:54:04.852 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-11-02T09:54:04.864 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-11-02T09:54:04.876 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi156 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all' 2023-11-02T09:54:04.877 INFO:teuthology.nuke:Checking targets against current locks 2023-11-02T09:54:04.879 INFO:teuthology.orchestra.run.smithi186.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-11-02T09:54:04.941 DEBUG:teuthology.nuke:shortname: smithi156 2023-11-02T09:54:04.942 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-02T09:54:04.968 DEBUG:teuthology.nuke:shortname: smithi186 2023-11-02T09:54:04.969 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-02T09:54:04.973 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi156.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/alimasa-2023-11-02_07:21:35-rgw:notifications-wip-alimasa-2pc-remove-issue-distro-default-smithi/7444142', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-02 09:09:06.235620', 'locked_by': 'scheduled_alimasa@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLny8vT41KenT/XBLKWfPw5JqXTJ6Dgk/RyoCDIyrrrN3uH7A/XLi7LA5lj3S/JRoWvG5D7+etWFk2POCDrQXys='} 2023-11-02T09:54:04.993 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi186.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/alimasa-2023-11-02_07:21:35-rgw:notifications-wip-alimasa-2pc-remove-issue-distro-default-smithi/7444142', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-02 09:09:06.237064', 'locked_by': 'scheduled_alimasa@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEUgB4WEEEueDe7qvQI1h000GrLx2Uh8nxJMxsHr7LwwnVmTIxtBSW/5uo51qz3GYsdvIQJwPOsCA+YdWOisM+o='} 2023-11-02T09:54:05.027 INFO:teuthology.orchestra.console.smithi156:Power off 2023-11-02T09:54:05.028 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-02T09:54:05.052 DEBUG:teuthology.orchestra.console.smithi156:power off output: Chassis Power Control: Down/Off 2023-11-02T09:54:05.054 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-02T09:54:05.071 INFO:teuthology.orchestra.console.smithi186:Power off 2023-11-02T09:54:05.072 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-02T09:54:05.084 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2023-11-02T09:54:05.098 DEBUG:teuthology.orchestra.console.smithi186:power off output: Chassis Power Control: Down/Off 2023-11-02T09:54:05.098 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-02T09:54:05.123 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on 2023-11-02T09:54:09.086 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-02T09:54:09.125 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-02T09:54:09.200 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2023-11-02T09:54:09.236 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on 2023-11-02T09:54:13.204 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-02T09:54:13.237 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-02T09:54:13.314 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2023-11-02T09:54:13.349 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off 2023-11-02T09:54:13.416 INFO:teuthology.orchestra.console.smithi156:Power off completed 2023-11-02T09:54:13.450 INFO:teuthology.orchestra.console.smithi186:Power off completed 2023-11-02T09:54:13.555 INFO:teuthology.run:Summary data: description: rgw:notifications/{beast bluestore-bitmap centos_latest fixed-2 ignore-pg-availability overrides tasks/{0-install test_amqp test_kafka test_others}} duration: 2071.906041622162 failure_reason: 'Command failed on smithi156 with status 1: ''adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid foo.client.0 --purge-data --cluster ceph''' flavor: default owner: scheduled_alimasa@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=4ea5b41b06a842e9b3c14c228d71796e status: fail success: false 2023-11-02T09:54:13.556 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-02T09:54:13.628 INFO:teuthology.run:FAIL